2018-12-25 13:25:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 13:25:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 13:25:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 13:25:21 [WARNING ] (13, 1, 'bot')
2018-12-25 13:25:21 [WARNING ] (13, 1, 'bot')
2018-12-25 13:25:21 [WARNING ] (13, 1, 'bot')
2018-12-25 13:25:21 [WARNING ] (13, 1, 'bot')
2018-12-25 13:25:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 13:25:21 [DEBUG   ] Finished updating board flags in 2.038 seconds
2018-12-25 13:25:29 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-25 13:25:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 13:25:58 [DEBUG   ] Got command RPT from MCS: ref #948836
2018-12-25 13:25:58 [DEBUG   ] summary = ERROR
2018-12-25 13:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   948836  13 58477 48358377 A  ERRORERROR'
2018-12-25 13:25:58 [DEBUG   ] Got command RPT from MCS: ref #948837
2018-12-25 13:25:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 13:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   948837  77 58477 48358378 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 13:26:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 13:26:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 13:26:21 [WARNING ] (13, 1, 'bot')
2018-12-25 13:26:21 [WARNING ] (13, 1, 'bot')
2018-12-25 13:26:21 [WARNING ] (13, 1, 'bot')
2018-12-25 13:26:21 [WARNING ] (13, 1, 'bot')
2018-12-25 13:26:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 13:26:21 [DEBUG   ] Finished updating board flags in 1.912 seconds
2018-12-25 13:26:29 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 13:26:49 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-25 13:27:09 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-25 13:27:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 13:27:21 [WARNING ] (13, 1, 'bot')
2018-12-25 13:27:21 [WARNING ] (13, 1, 'bot')
2018-12-25 13:27:21 [WARNING ] (13, 1, 'bot')
2018-12-25 13:27:21 [WARNING ] (13, 1, 'bot')
2018-12-25 13:27:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 13:27:21 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-12-25 13:27:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 13:27:49 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 13:28:09 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-25 13:28:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 13:28:21 [WARNING ] (13, 1, 'bot')
2018-12-25 13:28:21 [WARNING ] (13, 1, 'bot')
2018-12-25 13:28:21 [WARNING ] (13, 1, 'bot')
2018-12-25 13:28:21 [WARNING ] (13, 1, 'bot')
2018-12-25 13:28:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 13:28:21 [DEBUG   ] Finished updating board flags in 1.774 seconds
2018-12-25 13:28:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 13:28:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 13:29:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 13:29:15 [DEBUG   ] Got command RPT from MCS: ref #948857
2018-12-25 13:29:15 [DEBUG   ] summary = ERROR
2018-12-25 13:29:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   948857  13 58477 48555697 A  ERRORERROR'
2018-12-25 13:29:15 [DEBUG   ] Got command RPT from MCS: ref #948858
2018-12-25 13:29:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 13:29:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   948858  77 58477 48555901 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 13:29:16 [DEBUG   ] Got command RPT from MCS: ref #948859
2018-12-25 13:29:16 [DEBUG   ] summary = ERROR
2018-12-25 13:29:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   948859  13 58477 48556105 A  ERRORERROR'
2018-12-25 13:29:16 [DEBUG   ] Got command RPT from MCS: ref #948860
2018-12-25 13:29:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 13:29:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   948860  77 58477 48556297 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 13:29:16 [DEBUG   ] Got command RPT from MCS: ref #948861
2018-12-25 13:29:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 13:29:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   948861  12 58477 48556501 A  ERRORB™™š'
2018-12-25 13:29:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 13:29:21 [WARNING ] (13, 1, 'bot')
2018-12-25 13:29:21 [WARNING ] (13, 1, 'bot')
2018-12-25 13:29:21 [WARNING ] (13, 1, 'bot')
2018-12-25 13:29:21 [WARNING ] (13, 1, 'bot')
2018-12-25 13:29:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 13:29:21 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-12-25 13:29:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 13:29:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 13:30:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 13:30:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 13:30:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 13:30:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 13:30:21 [WARNING ] (13, 1, 'bot')
2018-12-25 13:30:21 [WARNING ] (13, 1, 'bot')
2018-12-25 13:30:21 [WARNING ] (13, 1, 'bot')
2018-12-25 13:30:21 [WARNING ] (13, 1, 'bot')
2018-12-25 13:30:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 13:30:21 [DEBUG   ] Finished updating board flags in 1.698 seconds
2018-12-25 13:30:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 13:30:49 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-25 13:30:58 [DEBUG   ] Got command RPT from MCS: ref #948866
2018-12-25 13:30:58 [DEBUG   ] summary = ERROR
2018-12-25 13:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   948866  13 58477 48658385 A  ERRORERROR'
2018-12-25 13:30:58 [DEBUG   ] Got command RPT from MCS: ref #948867
2018-12-25 13:30:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 13:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   948867  77 58477 48658386 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 13:31:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 13:31:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 13:31:21 [WARNING ] (13, 1, 'bot')
2018-12-25 13:31:21 [WARNING ] (13, 1, 'bot')
2018-12-25 13:31:21 [WARNING ] (13, 1, 'bot')
2018-12-25 13:31:21 [WARNING ] (13, 1, 'bot')
2018-12-25 13:31:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 13:31:21 [DEBUG   ] Finished updating board flags in 1.485 seconds
2018-12-25 13:31:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 13:31:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 13:32:09 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-25 13:32:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-25 13:32:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 13:32:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-12-25 13:32:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 13:32:21 [WARNING ] (13, 1, 'bot')
2018-12-25 13:32:21 [WARNING ] (13, 1, 'bot')
2018-12-25 13:32:21 [WARNING ] (13, 1, 'bot')
2018-12-25 13:32:21 [WARNING ] (13, 1, 'bot')
2018-12-25 13:32:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 13:32:21 [DEBUG   ] Finished updating board flags in 1.468 seconds
2018-12-25 13:32:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 13:32:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 13:33:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 13:33:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 13:33:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 13:33:21 [WARNING ] (13, 1, 'bot')
2018-12-25 13:33:21 [WARNING ] (13, 1, 'bot')
2018-12-25 13:33:21 [WARNING ] (13, 1, 'bot')
2018-12-25 13:33:21 [WARNING ] (13, 1, 'bot')
2018-12-25 13:33:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 13:33:21 [DEBUG   ] Finished updating board flags in 1.503 seconds
2018-12-25 13:33:29 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-25 13:33:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 13:34:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 13:34:15 [DEBUG   ] Got command RPT from MCS: ref #948889
2018-12-25 13:34:15 [DEBUG   ] summary = ERROR
2018-12-25 13:34:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   948889  13 58477 48855781 A  ERRORERROR'
2018-12-25 13:34:15 [DEBUG   ] Got command RPT from MCS: ref #948890
2018-12-25 13:34:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 13:34:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   948890  77 58477 48855985 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 13:34:16 [DEBUG   ] Got command RPT from MCS: ref #948891
2018-12-25 13:34:16 [DEBUG   ] summary = ERROR
2018-12-25 13:34:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   948891  13 58477 48856177 A  ERRORERROR'
2018-12-25 13:34:16 [DEBUG   ] Got command RPT from MCS: ref #948893
2018-12-25 13:34:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 13:34:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   948893  77 58477 48856381 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 13:34:16 [DEBUG   ] Got command RPT from MCS: ref #948894
2018-12-25 13:34:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 13:34:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   948894  12 58477 48856585 A  ERRORB™™š'
2018-12-25 13:34:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 13:34:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 13:34:21 [WARNING ] (13, 1, 'bot')
2018-12-25 13:34:21 [WARNING ] (13, 1, 'bot')
2018-12-25 13:34:21 [WARNING ] (13, 1, 'bot')
2018-12-25 13:34:21 [WARNING ] (13, 1, 'bot')
2018-12-25 13:34:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 13:34:21 [DEBUG   ] Finished updating board flags in 1.513 seconds
2018-12-25 13:34:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 13:34:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 13:35:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 13:35:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 13:35:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:35:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:35:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:35:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:35:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 13:35:22 [DEBUG   ] Finished updating board flags in 2.181 seconds
2018-12-25 13:35:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 13:35:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 13:35:58 [DEBUG   ] Got command RPT from MCS: ref #948899
2018-12-25 13:35:58 [DEBUG   ] summary = ERROR
2018-12-25 13:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   948899  13 58477 48958385 A  ERRORERROR'
2018-12-25 13:35:58 [DEBUG   ] Got command RPT from MCS: ref #948900
2018-12-25 13:35:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 13:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   948900  77 58477 48958386 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 13:36:09 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-25 13:36:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 13:36:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:36:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:36:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:36:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:36:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 13:36:22 [DEBUG   ] Finished updating board flags in 2.016 seconds
2018-12-25 13:36:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 13:36:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 13:37:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 13:37:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 13:37:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 13:37:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-25 13:37:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:37:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:37:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:37:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:37:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 13:37:22 [DEBUG   ] Finished updating board flags in 2.037 seconds
2018-12-25 13:37:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 13:37:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 13:38:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 13:38:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 13:38:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:38:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:38:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:38:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:38:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 13:38:22 [DEBUG   ] Finished updating board flags in 1.896 seconds
2018-12-25 13:38:29 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 13:38:49 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-12-25 13:39:09 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 13:39:15 [DEBUG   ] Got command RPT from MCS: ref #948920
2018-12-25 13:39:15 [DEBUG   ] summary = ERROR
2018-12-25 13:39:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   948920  13 58477 49155857 A  ERRORERROR'
2018-12-25 13:39:16 [DEBUG   ] Got command RPT from MCS: ref #948921
2018-12-25 13:39:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 13:39:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   948921  77 58477 49156061 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 13:39:16 [DEBUG   ] Got command RPT from MCS: ref #948922
2018-12-25 13:39:16 [DEBUG   ] summary = ERROR
2018-12-25 13:39:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   948922  13 58477 49156265 A  ERRORERROR'
2018-12-25 13:39:16 [DEBUG   ] Got command RPT from MCS: ref #948923
2018-12-25 13:39:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 13:39:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   948923  77 58477 49156469 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 13:39:16 [DEBUG   ] Got command RPT from MCS: ref #948924
2018-12-25 13:39:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 13:39:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   948924  12 58477 49156661 A  ERRORB™™š'
2018-12-25 13:39:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 13:39:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 13:39:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-25 13:39:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:39:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:39:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:39:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:39:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 13:39:22 [DEBUG   ] Finished updating board flags in 1.811 seconds
2018-12-25 13:39:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 13:39:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 13:40:09 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 13:40:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 13:40:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 13:40:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:40:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:40:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:40:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:40:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 13:40:22 [DEBUG   ] Finished updating board flags in 1.792 seconds
2018-12-25 13:40:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 13:40:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 13:40:58 [DEBUG   ] Got command RPT from MCS: ref #948929
2018-12-25 13:40:58 [DEBUG   ] summary = ERROR
2018-12-25 13:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   948929  13 58477 49258385 A  ERRORERROR'
2018-12-25 13:40:58 [DEBUG   ] Got command RPT from MCS: ref #948930
2018-12-25 13:40:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 13:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   948930  77 58477 49258386 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 13:41:09 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 13:41:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 13:41:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:41:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:41:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:41:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:41:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 13:41:22 [DEBUG   ] Finished updating board flags in 1.622 seconds
2018-12-25 13:41:29 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 13:41:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 13:42:09 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 13:42:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 13:42:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:42:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:42:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:42:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:42:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 13:42:22 [DEBUG   ] Finished updating board flags in 1.610 seconds
2018-12-25 13:42:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 13:42:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 13:43:09 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 13:43:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 13:43:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 13:43:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:43:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:43:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:43:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:43:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 13:43:22 [DEBUG   ] Finished updating board flags in 1.678 seconds
2018-12-25 13:43:29 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 13:43:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 13:44:09 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 13:44:15 [DEBUG   ] Got command RPT from MCS: ref #948952
2018-12-25 13:44:15 [DEBUG   ] summary = ERROR
2018-12-25 13:44:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   948952  13 58477 49455945 A  ERRORERROR'
2018-12-25 13:44:16 [DEBUG   ] Got command RPT from MCS: ref #948953
2018-12-25 13:44:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 13:44:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   948953  77 58477 49456137 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 13:44:16 [DEBUG   ] Got command RPT from MCS: ref #948954
2018-12-25 13:44:16 [DEBUG   ] summary = ERROR
2018-12-25 13:44:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   948954  13 58477 49456341 A  ERRORERROR'
2018-12-25 13:44:16 [DEBUG   ] Got command RPT from MCS: ref #948956
2018-12-25 13:44:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 13:44:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   948956  77 58477 49456545 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 13:44:16 [DEBUG   ] Got command RPT from MCS: ref #948957
2018-12-25 13:44:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 13:44:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   948957  12 58477 49456749 A  ERRORB˜™š'
2018-12-25 13:44:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 13:44:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:44:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:44:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:44:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:44:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 13:44:22 [DEBUG   ] Finished updating board flags in 1.622 seconds
2018-12-25 13:44:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 13:44:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 13:45:09 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 13:45:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 13:45:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 13:45:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:45:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:45:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:45:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:45:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 13:45:22 [DEBUG   ] Finished updating board flags in 1.469 seconds
2018-12-25 13:45:29 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 13:45:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 13:45:58 [DEBUG   ] Got command RPT from MCS: ref #948966
2018-12-25 13:45:58 [DEBUG   ] summary = ERROR
2018-12-25 13:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   948966  13 58477 49558381 A  ERRORERROR'
2018-12-25 13:45:58 [DEBUG   ] Got command RPT from MCS: ref #948967
2018-12-25 13:45:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 13:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   948967  77 58477 49558382 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 13:46:09 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 13:46:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 13:46:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-12-25 13:46:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:46:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:46:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:46:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:46:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 13:46:22 [DEBUG   ] Finished updating board flags in 1.493 seconds
2018-12-25 13:46:29 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 13:46:49 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-12-25 13:47:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 13:47:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 13:47:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:47:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:47:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:47:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:47:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 13:47:22 [DEBUG   ] Finished updating board flags in 1.489 seconds
2018-12-25 13:47:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 13:47:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 13:48:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 13:48:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 13:48:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:48:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:48:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:48:22 [WARNING ] (13, 1, 'bot')
2018-12-25 13:48:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 13:48:22 [DEBUG   ] Finished updating board flags in 1.495 seconds
2018-12-25 13:48:29 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-25 13:48:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 13:49:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 13:49:16 [DEBUG   ] Got command RPT from MCS: ref #948987
2018-12-25 13:49:16 [DEBUG   ] summary = ERROR
2018-12-25 13:49:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   948987  13 58477 49756017 A  ERRORERROR'
2018-12-25 13:49:16 [DEBUG   ] Got command RPT from MCS: ref #948988
2018-12-25 13:49:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 13:49:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   948988  77 58477 49756221 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 13:49:16 [DEBUG   ] Got command RPT from MCS: ref #948989
2018-12-25 13:49:16 [DEBUG   ] summary = ERROR
2018-12-25 13:49:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   948989  13 58477 49756425 A  ERRORERROR'
2018-12-25 13:49:16 [DEBUG   ] Got command RPT from MCS: ref #948990
2018-12-25 13:49:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 13:49:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   948990  77 58477 49756629 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 13:49:16 [DEBUG   ] Got command RPT from MCS: ref #948991
2018-12-25 13:49:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 13:49:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   948991  12 58477 49756821 A  ERRORB™™š'
2018-12-25 13:49:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 13:49:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 13:49:23 [WARNING ] (13, 1, 'bot')
2018-12-25 13:49:23 [WARNING ] (13, 1, 'bot')
2018-12-25 13:49:23 [WARNING ] (13, 1, 'bot')
2018-12-25 13:49:23 [WARNING ] (13, 1, 'bot')
2018-12-25 13:49:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 13:49:23 [DEBUG   ] Finished updating board flags in 2.162 seconds
2018-12-25 13:49:29 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-12-25 13:49:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 13:50:09 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 13:50:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 13:50:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 13:50:23 [WARNING ] (13, 1, 'bot')
2018-12-25 13:50:23 [WARNING ] (13, 1, 'bot')
2018-12-25 13:50:23 [WARNING ] (13, 1, 'bot')
2018-12-25 13:50:23 [WARNING ] (13, 1, 'bot')
2018-12-25 13:50:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 13:50:23 [DEBUG   ] Finished updating board flags in 1.973 seconds
2018-12-25 13:50:29 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-25 13:50:50 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-25 13:50:58 [DEBUG   ] Got command RPT from MCS: ref #948992
2018-12-25 13:50:58 [DEBUG   ] summary = ERROR
2018-12-25 13:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   948992  13 58477 49858385 A  ERRORERROR'
2018-12-25 13:50:58 [DEBUG   ] Got command RPT from MCS: ref #948993
2018-12-25 13:50:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 13:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   948993  77 58477 49858386 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 13:51:10 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-25 13:51:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 13:51:23 [WARNING ] (13, 1, 'bot')
2018-12-25 13:51:23 [WARNING ] (13, 1, 'bot')
2018-12-25 13:51:23 [WARNING ] (13, 1, 'bot')
2018-12-25 13:51:23 [WARNING ] (13, 1, 'bot')
2018-12-25 13:51:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 13:51:23 [DEBUG   ] Finished updating board flags in 1.807 seconds
2018-12-25 13:51:30 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 13:51:50 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-25 13:52:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 13:52:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 13:52:23 [WARNING ] (13, 1, 'bot')
2018-12-25 13:52:23 [WARNING ] (13, 1, 'bot')
2018-12-25 13:52:23 [WARNING ] (13, 1, 'bot')
2018-12-25 13:52:23 [WARNING ] (13, 1, 'bot')
2018-12-25 13:52:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 13:52:23 [DEBUG   ] Finished updating board flags in 1.827 seconds
2018-12-25 13:52:30 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 13:52:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 13:53:10 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-25 13:53:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 13:53:23 [WARNING ] (13, 1, 'bot')
2018-12-25 13:53:23 [WARNING ] (13, 1, 'bot')
2018-12-25 13:53:23 [WARNING ] (13, 1, 'bot')
2018-12-25 13:53:23 [WARNING ] (13, 1, 'bot')
2018-12-25 13:53:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 13:53:23 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-12-25 13:53:30 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-25 13:53:50 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 13:54:10 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 13:54:16 [DEBUG   ] Got command RPT from MCS: ref #949015
2018-12-25 13:54:16 [DEBUG   ] summary = ERROR
2018-12-25 13:54:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949015  13 58477 50056105 A  ERRORERROR'
2018-12-25 13:54:16 [DEBUG   ] Got command RPT from MCS: ref #949016
2018-12-25 13:54:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 13:54:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949016  77 58477 50056297 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 13:54:16 [DEBUG   ] Got command RPT from MCS: ref #949017
2018-12-25 13:54:16 [DEBUG   ] summary = ERROR
2018-12-25 13:54:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949017  13 58477 50056501 A  ERRORERROR'
2018-12-25 13:54:16 [DEBUG   ] Got command RPT from MCS: ref #949019
2018-12-25 13:54:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 13:54:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949019  77 58477 50056705 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 13:54:16 [DEBUG   ] Got command RPT from MCS: ref #949021
2018-12-25 13:54:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 13:54:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949021  12 58477 50056909 A  ERRORB™™š'
2018-12-25 13:54:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 13:54:23 [WARNING ] (13, 1, 'bot')
2018-12-25 13:54:23 [WARNING ] (13, 1, 'bot')
2018-12-25 13:54:23 [WARNING ] (13, 1, 'bot')
2018-12-25 13:54:23 [WARNING ] (13, 1, 'bot')
2018-12-25 13:54:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 13:54:23 [DEBUG   ] Finished updating board flags in 1.844 seconds
2018-12-25 13:54:30 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-25 13:54:50 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-25 13:55:10 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 13:55:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 13:55:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 13:55:23 [WARNING ] (13, 1, 'bot')
2018-12-25 13:55:23 [WARNING ] (13, 1, 'bot')
2018-12-25 13:55:23 [WARNING ] (13, 1, 'bot')
2018-12-25 13:55:23 [WARNING ] (13, 1, 'bot')
2018-12-25 13:55:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 13:55:23 [DEBUG   ] Finished updating board flags in 1.821 seconds
2018-12-25 13:55:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 13:55:50 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-25 13:55:58 [DEBUG   ] Got command RPT from MCS: ref #949029
2018-12-25 13:55:58 [DEBUG   ] summary = ERROR
2018-12-25 13:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949029  13 58477 50158381 A  ERRORERROR'
2018-12-25 13:55:58 [DEBUG   ] Got command RPT from MCS: ref #949030
2018-12-25 13:55:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 13:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949030  77 58477 50158382 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 13:56:10 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-25 13:56:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 13:56:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 13:56:23 [WARNING ] (13, 1, 'bot')
2018-12-25 13:56:23 [WARNING ] (13, 1, 'bot')
2018-12-25 13:56:23 [WARNING ] (13, 1, 'bot')
2018-12-25 13:56:23 [WARNING ] (13, 1, 'bot')
2018-12-25 13:56:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 13:56:23 [DEBUG   ] Finished updating board flags in 1.808 seconds
2018-12-25 13:56:30 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 13:56:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 13:57:10 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-25 13:57:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 13:57:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 13:57:23 [WARNING ] (13, 1, 'bot')
2018-12-25 13:57:23 [WARNING ] (13, 1, 'bot')
2018-12-25 13:57:23 [WARNING ] (13, 1, 'bot')
2018-12-25 13:57:23 [WARNING ] (13, 1, 'bot')
2018-12-25 13:57:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 13:57:23 [DEBUG   ] Finished updating board flags in 1.691 seconds
2018-12-25 13:57:30 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-25 13:57:50 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 13:58:10 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 13:58:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 13:58:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 13:58:23 [WARNING ] (13, 1, 'bot')
2018-12-25 13:58:23 [WARNING ] (13, 1, 'bot')
2018-12-25 13:58:23 [WARNING ] (13, 1, 'bot')
2018-12-25 13:58:23 [WARNING ] (13, 1, 'bot')
2018-12-25 13:58:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 13:58:23 [DEBUG   ] Finished updating board flags in 1.649 seconds
2018-12-25 13:58:30 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-25 13:58:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 13:59:10 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 13:59:16 [DEBUG   ] Got command RPT from MCS: ref #949050
2018-12-25 13:59:16 [DEBUG   ] summary = ERROR
2018-12-25 13:59:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949050  13 58477 50356181 A  ERRORERROR'
2018-12-25 13:59:16 [DEBUG   ] Got command RPT from MCS: ref #949051
2018-12-25 13:59:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 13:59:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949051  77 58477 50356385 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 13:59:16 [DEBUG   ] Got command RPT from MCS: ref #949052
2018-12-25 13:59:16 [DEBUG   ] summary = ERROR
2018-12-25 13:59:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949052  13 58477 50356577 A  ERRORERROR'
2018-12-25 13:59:16 [DEBUG   ] Got command RPT from MCS: ref #949053
2018-12-25 13:59:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 13:59:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949053  77 58477 50356781 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 13:59:16 [DEBUG   ] Got command RPT from MCS: ref #949054
2018-12-25 13:59:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 13:59:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949054  12 58477 50356985 A  ERRORB™™š'
2018-12-25 13:59:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 13:59:23 [WARNING ] (13, 1, 'bot')
2018-12-25 13:59:23 [WARNING ] (13, 1, 'bot')
2018-12-25 13:59:23 [WARNING ] (13, 1, 'bot')
2018-12-25 13:59:23 [WARNING ] (13, 1, 'bot')
2018-12-25 13:59:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 13:59:23 [DEBUG   ] Finished updating board flags in 1.574 seconds
2018-12-25 13:59:30 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-25 13:59:50 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-25 14:00:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 14:00:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:00:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 14:00:23 [WARNING ] (13, 1, 'bot')
2018-12-25 14:00:23 [WARNING ] (13, 1, 'bot')
2018-12-25 14:00:23 [WARNING ] (13, 1, 'bot')
2018-12-25 14:00:23 [WARNING ] (13, 1, 'bot')
2018-12-25 14:00:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:00:23 [DEBUG   ] Finished updating board flags in 1.497 seconds
2018-12-25 14:00:30 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 14:00:50 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-25 14:00:58 [DEBUG   ] Got command RPT from MCS: ref #949059
2018-12-25 14:00:58 [DEBUG   ] summary = ERROR
2018-12-25 14:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949059  13 58477 50458389 A  ERRORERROR'
2018-12-25 14:00:58 [DEBUG   ] Got command RPT from MCS: ref #949060
2018-12-25 14:00:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 14:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949060  77 58477 50458390 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 14:01:10 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 14:01:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:01:23 [WARNING ] (13, 1, 'bot')
2018-12-25 14:01:23 [WARNING ] (13, 1, 'bot')
2018-12-25 14:01:23 [WARNING ] (13, 1, 'bot')
2018-12-25 14:01:23 [WARNING ] (13, 1, 'bot')
2018-12-25 14:01:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:01:23 [DEBUG   ] Finished updating board flags in 1.493 seconds
2018-12-25 14:01:30 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 14:01:50 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 14:02:10 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 14:02:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:02:24 [WARNING ] (13, 1, 'bot')
2018-12-25 14:02:24 [WARNING ] (13, 1, 'bot')
2018-12-25 14:02:24 [WARNING ] (13, 1, 'bot')
2018-12-25 14:02:24 [WARNING ] (13, 1, 'bot')
2018-12-25 14:02:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:02:24 [DEBUG   ] Finished updating board flags in 2.303 seconds
2018-12-25 14:02:30 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 14:02:50 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 14:03:10 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 14:03:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:03:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 14:03:24 [WARNING ] (13, 1, 'bot')
2018-12-25 14:03:24 [WARNING ] (13, 1, 'bot')
2018-12-25 14:03:24 [WARNING ] (13, 1, 'bot')
2018-12-25 14:03:24 [WARNING ] (13, 1, 'bot')
2018-12-25 14:03:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:03:24 [DEBUG   ] Finished updating board flags in 2.106 seconds
2018-12-25 14:03:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 14:03:50 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-25 14:04:10 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 14:04:16 [DEBUG   ] Got command RPT from MCS: ref #949082
2018-12-25 14:04:16 [DEBUG   ] summary = ERROR
2018-12-25 14:04:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949082  13 58477 50656265 A  ERRORERROR'
2018-12-25 14:04:16 [DEBUG   ] Got command RPT from MCS: ref #949083
2018-12-25 14:04:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 14:04:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949083  77 58477 50656457 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 14:04:16 [DEBUG   ] Got command RPT from MCS: ref #949084
2018-12-25 14:04:16 [DEBUG   ] summary = ERROR
2018-12-25 14:04:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949084  13 58477 50656661 A  ERRORERROR'
2018-12-25 14:04:16 [DEBUG   ] Got command RPT from MCS: ref #949086
2018-12-25 14:04:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 14:04:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949086  77 58477 50656865 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 14:04:17 [DEBUG   ] Got command RPT from MCS: ref #949087
2018-12-25 14:04:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 14:04:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949087  12 58477 50657069 A  ERRORB™™š'
2018-12-25 14:04:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:04:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 14:04:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 14:04:24 [WARNING ] (13, 1, 'bot')
2018-12-25 14:04:24 [WARNING ] (13, 1, 'bot')
2018-12-25 14:04:24 [WARNING ] (13, 1, 'bot')
2018-12-25 14:04:24 [WARNING ] (13, 1, 'bot')
2018-12-25 14:04:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:04:24 [DEBUG   ] Finished updating board flags in 2.041 seconds
2018-12-25 14:04:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 14:04:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 14:05:10 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 14:05:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 14:05:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:05:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 14:05:24 [WARNING ] (13, 1, 'bot')
2018-12-25 14:05:24 [WARNING ] (13, 1, 'bot')
2018-12-25 14:05:24 [WARNING ] (13, 1, 'bot')
2018-12-25 14:05:24 [WARNING ] (13, 1, 'bot')
2018-12-25 14:05:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:05:24 [DEBUG   ] Finished updating board flags in 1.947 seconds
2018-12-25 14:05:30 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 14:05:50 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 14:05:58 [DEBUG   ] Got command RPT from MCS: ref #949092
2018-12-25 14:05:58 [DEBUG   ] summary = ERROR
2018-12-25 14:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949092  13 58477 50758385 A  ERRORERROR'
2018-12-25 14:05:58 [DEBUG   ] Got command RPT from MCS: ref #949093
2018-12-25 14:05:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 14:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949093  77 58477 50758386 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 14:06:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 14:06:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:06:24 [WARNING ] (13, 1, 'bot')
2018-12-25 14:06:24 [WARNING ] (13, 1, 'bot')
2018-12-25 14:06:24 [WARNING ] (13, 1, 'bot')
2018-12-25 14:06:24 [WARNING ] (13, 1, 'bot')
2018-12-25 14:06:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:06:24 [DEBUG   ] Finished updating board flags in 1.822 seconds
2018-12-25 14:06:30 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 14:06:50 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 14:07:10 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 14:07:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-12-25 14:07:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:07:24 [WARNING ] (13, 1, 'bot')
2018-12-25 14:07:24 [WARNING ] (13, 1, 'bot')
2018-12-25 14:07:24 [WARNING ] (13, 1, 'bot')
2018-12-25 14:07:24 [WARNING ] (13, 1, 'bot')
2018-12-25 14:07:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:07:24 [DEBUG   ] Finished updating board flags in 1.855 seconds
2018-12-25 14:07:30 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 14:07:50 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 14:08:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 14:08:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:08:24 [WARNING ] (13, 1, 'bot')
2018-12-25 14:08:24 [WARNING ] (13, 1, 'bot')
2018-12-25 14:08:24 [WARNING ] (13, 1, 'bot')
2018-12-25 14:08:24 [WARNING ] (13, 1, 'bot')
2018-12-25 14:08:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:08:24 [DEBUG   ] Finished updating board flags in 1.771 seconds
2018-12-25 14:08:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 14:08:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 14:09:10 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 14:09:16 [DEBUG   ] Got command RPT from MCS: ref #949113
2018-12-25 14:09:16 [DEBUG   ] summary = ERROR
2018-12-25 14:09:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949113  13 58477 50956345 A  ERRORERROR'
2018-12-25 14:09:16 [DEBUG   ] Got command RPT from MCS: ref #949114
2018-12-25 14:09:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 14:09:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949114  77 58477 50956537 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 14:09:16 [DEBUG   ] Got command RPT from MCS: ref #949115
2018-12-25 14:09:16 [DEBUG   ] summary = ERROR
2018-12-25 14:09:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949115  13 58477 50956741 A  ERRORERROR'
2018-12-25 14:09:16 [DEBUG   ] Got command RPT from MCS: ref #949116
2018-12-25 14:09:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 14:09:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949116  77 58477 50956945 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 14:09:17 [DEBUG   ] Got command RPT from MCS: ref #949117
2018-12-25 14:09:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 14:09:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949117  12 58477 50957149 A  ERRORB™™š'
2018-12-25 14:09:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:09:24 [WARNING ] (13, 1, 'bot')
2018-12-25 14:09:24 [WARNING ] (13, 1, 'bot')
2018-12-25 14:09:24 [WARNING ] (13, 1, 'bot')
2018-12-25 14:09:24 [WARNING ] (13, 1, 'bot')
2018-12-25 14:09:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:09:24 [DEBUG   ] Finished updating board flags in 1.625 seconds
2018-12-25 14:09:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 14:09:50 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 14:10:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 14:10:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:10:24 [WARNING ] (13, 1, 'bot')
2018-12-25 14:10:24 [WARNING ] (13, 1, 'bot')
2018-12-25 14:10:24 [WARNING ] (13, 1, 'bot')
2018-12-25 14:10:24 [WARNING ] (13, 1, 'bot')
2018-12-25 14:10:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:10:24 [DEBUG   ] Finished updating board flags in 1.565 seconds
2018-12-25 14:10:30 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-25 14:10:50 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 14:10:58 [DEBUG   ] Got command RPT from MCS: ref #949122
2018-12-25 14:10:58 [DEBUG   ] summary = ERROR
2018-12-25 14:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949122  13 58477 51058385 A  ERRORERROR'
2018-12-25 14:10:58 [DEBUG   ] Got command RPT from MCS: ref #949123
2018-12-25 14:10:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 14:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949123  77 58477 51058386 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 14:11:10 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 14:11:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 14:11:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:11:24 [WARNING ] (13, 1, 'bot')
2018-12-25 14:11:24 [WARNING ] (13, 1, 'bot')
2018-12-25 14:11:24 [WARNING ] (13, 1, 'bot')
2018-12-25 14:11:24 [WARNING ] (13, 1, 'bot')
2018-12-25 14:11:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:11:24 [DEBUG   ] Finished updating board flags in 1.509 seconds
2018-12-25 14:11:30 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-12-25 14:11:50 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-25 14:12:10 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-25 14:12:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:12:24 [WARNING ] (13, 1, 'bot')
2018-12-25 14:12:24 [WARNING ] (13, 1, 'bot')
2018-12-25 14:12:24 [WARNING ] (13, 1, 'bot')
2018-12-25 14:12:24 [WARNING ] (13, 1, 'bot')
2018-12-25 14:12:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:12:24 [DEBUG   ] Finished updating board flags in 1.501 seconds
2018-12-25 14:12:30 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 14:12:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 14:13:10 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-25 14:13:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:13:25 [WARNING ] (13, 1, 'bot')
2018-12-25 14:13:25 [WARNING ] (13, 1, 'bot')
2018-12-25 14:13:25 [WARNING ] (13, 1, 'bot')
2018-12-25 14:13:25 [WARNING ] (13, 1, 'bot')
2018-12-25 14:13:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:13:25 [DEBUG   ] Finished updating board flags in 2.215 seconds
2018-12-25 14:13:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 14:13:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 14:14:10 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-25 14:14:16 [DEBUG   ] Got command RPT from MCS: ref #949145
2018-12-25 14:14:16 [DEBUG   ] summary = ERROR
2018-12-25 14:14:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949145  13 58477 51256425 A  ERRORERROR'
2018-12-25 14:14:16 [DEBUG   ] Got command RPT from MCS: ref #949146
2018-12-25 14:14:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 14:14:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949146  77 58477 51256617 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 14:14:16 [DEBUG   ] Got command RPT from MCS: ref #949147
2018-12-25 14:14:16 [DEBUG   ] summary = ERROR
2018-12-25 14:14:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949147  13 58477 51256821 A  ERRORERROR'
2018-12-25 14:14:17 [DEBUG   ] Got command RPT from MCS: ref #949149
2018-12-25 14:14:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 14:14:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949149  77 58477 51257025 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 14:14:17 [DEBUG   ] Got command RPT from MCS: ref #949150
2018-12-25 14:14:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 14:14:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949150  12 58477 51257229 A  ERRORB˜™š'
2018-12-25 14:14:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:14:25 [WARNING ] (13, 1, 'bot')
2018-12-25 14:14:25 [WARNING ] (13, 1, 'bot')
2018-12-25 14:14:25 [WARNING ] (13, 1, 'bot')
2018-12-25 14:14:25 [WARNING ] (13, 1, 'bot')
2018-12-25 14:14:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:14:25 [DEBUG   ] Finished updating board flags in 2.189 seconds
2018-12-25 14:14:30 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-25 14:14:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 14:15:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 14:15:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:15:25 [WARNING ] (13, 1, 'bot')
2018-12-25 14:15:25 [WARNING ] (13, 1, 'bot')
2018-12-25 14:15:25 [WARNING ] (13, 1, 'bot')
2018-12-25 14:15:25 [WARNING ] (13, 1, 'bot')
2018-12-25 14:15:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:15:25 [DEBUG   ] Finished updating board flags in 2.023 seconds
2018-12-25 14:15:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 14:15:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 14:15:58 [DEBUG   ] Got command RPT from MCS: ref #949159
2018-12-25 14:15:58 [DEBUG   ] summary = ERROR
2018-12-25 14:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949159  13 58477 51358393 A  ERRORERROR'
2018-12-25 14:15:58 [DEBUG   ] Got command RPT from MCS: ref #949160
2018-12-25 14:15:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 14:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949160  77 58477 51358394 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 14:16:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 14:16:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:16:25 [WARNING ] (13, 1, 'bot')
2018-12-25 14:16:25 [WARNING ] (13, 1, 'bot')
2018-12-25 14:16:25 [WARNING ] (13, 1, 'bot')
2018-12-25 14:16:25 [WARNING ] (13, 1, 'bot')
2018-12-25 14:16:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:16:25 [DEBUG   ] Finished updating board flags in 2.051 seconds
2018-12-25 14:16:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 14:16:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 14:17:10 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-25 14:17:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:17:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-25 14:17:25 [WARNING ] (13, 1, 'bot')
2018-12-25 14:17:25 [WARNING ] (13, 1, 'bot')
2018-12-25 14:17:25 [WARNING ] (13, 1, 'bot')
2018-12-25 14:17:25 [WARNING ] (13, 1, 'bot')
2018-12-25 14:17:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:17:25 [DEBUG   ] Finished updating board flags in 1.936 seconds
2018-12-25 14:17:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 14:17:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 14:18:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 14:18:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:18:25 [WARNING ] (13, 1, 'bot')
2018-12-25 14:18:25 [WARNING ] (13, 1, 'bot')
2018-12-25 14:18:25 [WARNING ] (13, 1, 'bot')
2018-12-25 14:18:25 [WARNING ] (13, 1, 'bot')
2018-12-25 14:18:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:18:25 [DEBUG   ] Finished updating board flags in 1.824 seconds
2018-12-25 14:18:30 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-12-25 14:18:50 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-12-25 14:19:10 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-25 14:19:16 [DEBUG   ] Got command RPT from MCS: ref #949180
2018-12-25 14:19:16 [DEBUG   ] summary = ERROR
2018-12-25 14:19:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949180  13 58477 51556505 A  ERRORERROR'
2018-12-25 14:19:16 [DEBUG   ] Got command RPT from MCS: ref #949181
2018-12-25 14:19:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 14:19:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949181  77 58477 51556697 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 14:19:16 [DEBUG   ] Got command RPT from MCS: ref #949182
2018-12-25 14:19:16 [DEBUG   ] summary = ERROR
2018-12-25 14:19:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949182  13 58477 51556901 A  ERRORERROR'
2018-12-25 14:19:17 [DEBUG   ] Got command RPT from MCS: ref #949183
2018-12-25 14:19:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 14:19:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949183  77 58477 51557105 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 14:19:17 [DEBUG   ] Got command RPT from MCS: ref #949184
2018-12-25 14:19:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 14:19:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949184  12 58477 51557297 A  ERRORB™™š'
2018-12-25 14:19:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:19:25 [WARNING ] (13, 1, 'bot')
2018-12-25 14:19:25 [WARNING ] (13, 1, 'bot')
2018-12-25 14:19:25 [WARNING ] (13, 1, 'bot')
2018-12-25 14:19:25 [WARNING ] (13, 1, 'bot')
2018-12-25 14:19:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:19:25 [DEBUG   ] Finished updating board flags in 1.748 seconds
2018-12-25 14:19:31 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-12-25 14:19:51 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-25 14:20:00 [DEBUG   ] Got command TBN from MCS: ref #949185
2018-12-25 14:20:00 [DEBUG   ] spawn_process: at 2018-12-25 14:20:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1545747601']
2018-12-25 14:20:00 [DEBUG   ] spawn_process: at 2018-12-25 14:20:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1545747601']
2018-12-25 14:20:00 [DEBUG   ] tbn = exited with status True, code 0x00
2018-12-25 14:20:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN   949185   8 58477 51600217 A  ERROR'
2018-12-25 14:20:00 [DEBUG   ] spawn_process: at 2018-12-25 14:20:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1545747601']
2018-12-25 14:20:00 [DEBUG   ] spawn_process: at 2018-12-25 14:20:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1545747601']
2018-12-25 14:20:00 [DEBUG   ] spawn_process: at 2018-12-25 14:20:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1545747601']
2018-12-25 14:20:00 [DEBUG   ] spawn_process: at 2018-12-25 14:20:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1545747601']
2018-12-25 14:20:00 [DEBUG   ] spawn_process: at 2018-12-25 14:20:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1545747601']
2018-12-25 14:20:00 [DEBUG   ] spawn_process: at 2018-12-25 14:20:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1545747601']
2018-12-25 14:20:00 [DEBUG   ] spawn_process: at 2018-12-25 14:20:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1545747601']
2018-12-25 14:20:00 [DEBUG   ] spawn_process: at 2018-12-25 14:20:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1545747601']
2018-12-25 14:20:00 [DEBUG   ] spawn_process: at 2018-12-25 14:20:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1545747601']
2018-12-25 14:20:00 [DEBUG   ] spawn_process: at 2018-12-25 14:20:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1545747601']
2018-12-25 14:20:00 [DEBUG   ] spawn_process: at 2018-12-25 14:20:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1545747601']
2018-12-25 14:20:00 [DEBUG   ] spawn_process: at 2018-12-25 14:20:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1545747601']
2018-12-25 14:20:00 [DEBUG   ] spawn_process: at 2018-12-25 14:20:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1545747601']
2018-12-25 14:20:00 [DEBUG   ] spawn_process: at 2018-12-25 14:20:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1545747601']
2018-12-25 14:20:00 [DEBUG   ] spawn_process: at 2018-12-25 14:20:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1545747601']
2018-12-25 14:20:00 [DEBUG   ] spawn_process: at 2018-12-25 14:20:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1545747601']
2018-12-25 14:20:00 [DEBUG   ] spawn_process: at 2018-12-25 14:20:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1545747601']
2018-12-25 14:20:00 [DEBUG   ] spawn_process: at 2018-12-25 14:20:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1545747601']
2018-12-25 14:20:00 [DEBUG   ] spawn_process: at 2018-12-25 14:20:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1545747601']
2018-12-25 14:20:00 [DEBUG   ] spawn_process: at 2018-12-25 14:20:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1545747601']
2018-12-25 14:20:00 [DEBUG   ] spawn_process: at 2018-12-25 14:20:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1545747601']
2018-12-25 14:20:00 [DEBUG   ] spawn_process: at 2018-12-25 14:20:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1545747601']
2018-12-25 14:20:00 [DEBUG   ] spawn_process: at 2018-12-25 14:20:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1545747601']
2018-12-25 14:20:00 [DEBUG   ] spawn_process: at 2018-12-25 14:20:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1545747601']
2018-12-25 14:20:00 [INFO    ] Finished spawning TBN in 0.043 s
2018-12-25 14:20:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 14:20:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:20:25 [WARNING ] (13, 1, 'bot')
2018-12-25 14:20:25 [WARNING ] (13, 1, 'bot')
2018-12-25 14:20:25 [WARNING ] (13, 1, 'bot')
2018-12-25 14:20:25 [WARNING ] (13, 1, 'bot')
2018-12-25 14:20:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:20:25 [DEBUG   ] Finished updating board flags in 1.625 seconds
2018-12-25 14:20:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 14:20:51 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-25 14:20:58 [DEBUG   ] Got command RPT from MCS: ref #949186
2018-12-25 14:20:58 [DEBUG   ] summary = ERROR
2018-12-25 14:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949186  13 58477 51658397 A  ERRORERROR'
2018-12-25 14:20:58 [DEBUG   ] Got command RPT from MCS: ref #949187
2018-12-25 14:20:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 14:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949187  77 58477 51658398 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 14:21:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 14:21:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:21:25 [WARNING ] (13, 1, 'bot')
2018-12-25 14:21:25 [WARNING ] (13, 1, 'bot')
2018-12-25 14:21:25 [WARNING ] (13, 1, 'bot')
2018-12-25 14:21:25 [WARNING ] (13, 1, 'bot')
2018-12-25 14:21:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:21:25 [DEBUG   ] Finished updating board flags in 1.592 seconds
2018-12-25 14:21:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 14:21:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 14:22:11 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-25 14:22:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:22:25 [WARNING ] (13, 1, 'bot')
2018-12-25 14:22:25 [WARNING ] (13, 1, 'bot')
2018-12-25 14:22:25 [WARNING ] (13, 1, 'bot')
2018-12-25 14:22:25 [WARNING ] (13, 1, 'bot')
2018-12-25 14:22:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:22:25 [DEBUG   ] Finished updating board flags in 1.466 seconds
2018-12-25 14:22:31 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-25 14:22:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 14:23:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 14:23:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:23:25 [WARNING ] (13, 1, 'bot')
2018-12-25 14:23:25 [WARNING ] (13, 1, 'bot')
2018-12-25 14:23:25 [WARNING ] (13, 1, 'bot')
2018-12-25 14:23:25 [WARNING ] (13, 1, 'bot')
2018-12-25 14:23:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:23:25 [DEBUG   ] Finished updating board flags in 1.468 seconds
2018-12-25 14:23:31 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-25 14:23:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 14:24:11 [DEBUG   ] Got command TBW from MCS: ref #949210
2018-12-25 14:24:11 [WARNING ] AntennaStats: no access to lwa28
2018-12-25 14:24:11 [WARNING ] AntennaStats: last command was /usr/local/bin/lwa28 /lwa/software/amplitude
2018-12-25 14:24:11 [WARNING ] AntennaStats: last command output as 
2018-12-25 14:24:11 [DEBUG   ] Finished updating ant stats in 1.175 seconds
2018-12-25 14:24:11 [DEBUG   ] tbw = exited with status True, code 0x00
2018-12-25 14:24:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW   949210   8 58477 51851290 A  ERROR'
2018-12-25 14:24:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2018-12-25 14:24:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2018-12-25 14:24:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2018-12-25 14:24:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2018-12-25 14:24:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2018-12-25 14:24:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2018-12-25 14:24:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2018-12-25 14:24:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2018-12-25 14:24:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2018-12-25 14:24:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2018-12-25 14:24:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2018-12-25 14:24:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2018-12-25 14:24:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2018-12-25 14:24:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2018-12-25 14:24:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2018-12-25 14:24:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2018-12-25 14:24:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2018-12-25 14:24:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2018-12-25 14:24:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2018-12-25 14:24:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2018-12-25 14:24:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2018-12-25 14:24:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2018-12-25 14:24:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2018-12-25 14:24:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2018-12-25 14:24:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2018-12-25 14:24:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2018-12-25 14:24:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2018-12-25 14:24:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2018-12-25 14:24:14 [DEBUG   ] spawn_process: at 2018-12-25 14:24:14 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2018-12-25 14:24:14 [DEBUG   ] spawn_process: at 2018-12-25 14:24:14 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2018-12-25 14:24:14 [DEBUG   ] spawn_process: at 2018-12-25 14:24:14 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2018-12-25 14:24:14 [DEBUG   ] spawn_process: at 2018-12-25 14:24:14 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2018-12-25 14:24:14 [DEBUG   ] spawn_process: at 2018-12-25 14:24:14 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2018-12-25 14:24:14 [DEBUG   ] spawn_process: at 2018-12-25 14:24:14 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2018-12-25 14:24:14 [DEBUG   ] spawn_process: at 2018-12-25 14:24:14 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2018-12-25 14:24:14 [DEBUG   ] spawn_process: at 2018-12-25 14:24:14 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2018-12-25 14:24:14 [DEBUG   ] spawn_process: at 2018-12-25 14:24:14 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2018-12-25 14:24:14 [DEBUG   ] spawn_process: at 2018-12-25 14:24:14 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2018-12-25 14:24:14 [DEBUG   ] spawn_process: at 2018-12-25 14:24:14 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2018-12-25 14:24:14 [DEBUG   ] spawn_process: at 2018-12-25 14:24:14 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2018-12-25 14:24:14 [DEBUG   ] spawn_process: at 2018-12-25 14:24:14 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2018-12-25 14:24:14 [DEBUG   ] spawn_process: at 2018-12-25 14:24:14 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2018-12-25 14:24:14 [DEBUG   ] spawn_process: at 2018-12-25 14:24:14 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2018-12-25 14:24:14 [DEBUG   ] spawn_process: at 2018-12-25 14:24:14 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2018-12-25 14:24:14 [DEBUG   ] spawn_process: at 2018-12-25 14:24:14 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2018-12-25 14:24:14 [DEBUG   ] spawn_process: at 2018-12-25 14:24:14 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2018-12-25 14:24:14 [DEBUG   ] spawn_process: at 2018-12-25 14:24:14 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2018-12-25 14:24:14 [DEBUG   ] spawn_process: at 2018-12-25 14:24:14 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2018-12-25 14:24:14 [DEBUG   ] spawn_process: at 2018-12-25 14:24:14 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2018-12-25 14:24:14 [DEBUG   ] spawn_process: at 2018-12-25 14:24:14 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2018-12-25 14:24:14 [DEBUG   ] spawn_process: at 2018-12-25 14:24:14 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2018-12-25 14:24:14 [DEBUG   ] spawn_process: at 2018-12-25 14:24:14 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2018-12-25 14:24:14 [DEBUG   ] spawn_process: at 2018-12-25 14:24:14 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2018-12-25 14:24:14 [DEBUG   ] spawn_process: at 2018-12-25 14:24:14 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2018-12-25 14:24:14 [INFO    ] Finished spawning TBW
2018-12-25 14:24:16 [DEBUG   ] Got command RPT from MCS: ref #949212
2018-12-25 14:24:16 [DEBUG   ] summary = ERROR
2018-12-25 14:24:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949212  13 58477 51856585 A  ERRORERROR'
2018-12-25 14:24:16 [DEBUG   ] Got command RPT from MCS: ref #949213
2018-12-25 14:24:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 14:24:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949213  77 58477 51856777 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 14:24:16 [DEBUG   ] Got command RPT from MCS: ref #949214
2018-12-25 14:24:16 [DEBUG   ] summary = ERROR
2018-12-25 14:24:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949214  13 58477 51856981 A  ERRORERROR'
2018-12-25 14:24:17 [DEBUG   ] Got command RPT from MCS: ref #949216
2018-12-25 14:24:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 14:24:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949216  77 58477 51857185 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 14:24:17 [DEBUG   ] Got command RPT from MCS: ref #949217
2018-12-25 14:24:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 14:24:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949217  12 58477 51857389 A  ERRORB™™š'
2018-12-25 14:24:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:24:25 [WARNING ] (13, 1, 'bot')
2018-12-25 14:24:25 [WARNING ] (13, 1, 'bot')
2018-12-25 14:24:25 [WARNING ] (13, 1, 'bot')
2018-12-25 14:24:25 [WARNING ] (13, 1, 'bot')
2018-12-25 14:24:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:24:25 [DEBUG   ] Finished updating board flags in 1.075 seconds
2018-12-25 14:25:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-25 14:25:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:25:26 [WARNING ] (13, 1, 'bot')
2018-12-25 14:25:26 [WARNING ] (13, 1, 'bot')
2018-12-25 14:25:26 [WARNING ] (13, 1, 'bot')
2018-12-25 14:25:26 [WARNING ] (13, 1, 'bot')
2018-12-25 14:25:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:25:26 [DEBUG   ] Finished updating board flags in 2.151 seconds
2018-12-25 14:25:58 [DEBUG   ] Got command RPT from MCS: ref #949229
2018-12-25 14:25:58 [DEBUG   ] summary = ERROR
2018-12-25 14:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949229  13 58477 51958397 A  ERRORERROR'
2018-12-25 14:25:58 [DEBUG   ] Got command RPT from MCS: ref #949230
2018-12-25 14:25:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 14:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949230  77 58477 51958398 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 14:26:02 [INFO    ] __waitForTBW - TBW finished in 107.972 s
2018-12-25 14:26:03 [DEBUG   ] Finished updating ant stats in 0.452 seconds
2018-12-25 14:26:03 [INFO    ] Started antennas statistics background thread
2018-12-25 14:26:03 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2018-12-25 14:26:03 [DEBUG   ] spawn_process: at 2018-12-25 14:26:03 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1545747965']
2018-12-25 14:26:03 [DEBUG   ] spawn_process: at 2018-12-25 14:26:03 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1545747965']
2018-12-25 14:26:03 [DEBUG   ] spawn_process: at 2018-12-25 14:26:03 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1545747965']
2018-12-25 14:26:03 [DEBUG   ] spawn_process: at 2018-12-25 14:26:03 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1545747965']
2018-12-25 14:26:03 [DEBUG   ] spawn_process: at 2018-12-25 14:26:03 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1545747965']
2018-12-25 14:26:03 [DEBUG   ] spawn_process: at 2018-12-25 14:26:03 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1545747965']
2018-12-25 14:26:03 [DEBUG   ] spawn_process: at 2018-12-25 14:26:03 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1545747965']
2018-12-25 14:26:03 [DEBUG   ] spawn_process: at 2018-12-25 14:26:03 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1545747965']
2018-12-25 14:26:03 [DEBUG   ] spawn_process: at 2018-12-25 14:26:03 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1545747965']
2018-12-25 14:26:03 [DEBUG   ] spawn_process: at 2018-12-25 14:26:03 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1545747965']
2018-12-25 14:26:03 [DEBUG   ] spawn_process: at 2018-12-25 14:26:03 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1545747965']
2018-12-25 14:26:03 [DEBUG   ] spawn_process: at 2018-12-25 14:26:03 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1545747965']
2018-12-25 14:26:03 [DEBUG   ] spawn_process: at 2018-12-25 14:26:03 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1545747965']
2018-12-25 14:26:03 [DEBUG   ] spawn_process: at 2018-12-25 14:26:03 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1545747965']
2018-12-25 14:26:03 [DEBUG   ] spawn_process: at 2018-12-25 14:26:03 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1545747965']
2018-12-25 14:26:03 [DEBUG   ] spawn_process: at 2018-12-25 14:26:03 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1545747965']
2018-12-25 14:26:03 [DEBUG   ] spawn_process: at 2018-12-25 14:26:03 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1545747965']
2018-12-25 14:26:03 [DEBUG   ] spawn_process: at 2018-12-25 14:26:03 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1545747965']
2018-12-25 14:26:03 [DEBUG   ] spawn_process: at 2018-12-25 14:26:03 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1545747965']
2018-12-25 14:26:03 [DEBUG   ] spawn_process: at 2018-12-25 14:26:03 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1545747965']
2018-12-25 14:26:03 [DEBUG   ] spawn_process: at 2018-12-25 14:26:03 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1545747965']
2018-12-25 14:26:03 [DEBUG   ] spawn_process: at 2018-12-25 14:26:03 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1545747965']
2018-12-25 14:26:03 [DEBUG   ] spawn_process: at 2018-12-25 14:26:03 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1545747965']
2018-12-25 14:26:03 [DEBUG   ] spawn_process: at 2018-12-25 14:26:03 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1545747965']
2018-12-25 14:26:03 [DEBUG   ] spawn_process: at 2018-12-25 14:26:03 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1545747965']
2018-12-25 14:26:03 [DEBUG   ] spawn_process: at 2018-12-25 14:26:03 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1545747965']
2018-12-25 14:26:03 [INFO    ] Finished spawning TBN in 0.048 s
2018-12-25 14:26:23 [DEBUG   ] Finished updating ant stats in 0.470 seconds
2018-12-25 14:26:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:26:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 14:26:26 [WARNING ] (13, 1, 'bot')
2018-12-25 14:26:26 [WARNING ] (13, 1, 'bot')
2018-12-25 14:26:26 [WARNING ] (13, 1, 'bot')
2018-12-25 14:26:26 [WARNING ] (13, 1, 'bot')
2018-12-25 14:26:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:26:26 [DEBUG   ] Finished updating board flags in 2.177 seconds
2018-12-25 14:26:43 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-12-25 14:27:04 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-25 14:27:24 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-25 14:27:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:27:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-25 14:27:26 [WARNING ] (13, 1, 'bot')
2018-12-25 14:27:26 [WARNING ] (13, 1, 'bot')
2018-12-25 14:27:26 [WARNING ] (13, 1, 'bot')
2018-12-25 14:27:26 [WARNING ] (13, 1, 'bot')
2018-12-25 14:27:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:27:26 [DEBUG   ] Finished updating board flags in 1.858 seconds
2018-12-25 14:27:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 14:28:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 14:28:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 14:28:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:28:26 [WARNING ] (13, 1, 'bot')
2018-12-25 14:28:26 [WARNING ] (13, 1, 'bot')
2018-12-25 14:28:26 [WARNING ] (13, 1, 'bot')
2018-12-25 14:28:26 [WARNING ] (13, 1, 'bot')
2018-12-25 14:28:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:28:26 [DEBUG   ] Finished updating board flags in 1.808 seconds
2018-12-25 14:28:44 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-25 14:29:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 14:29:16 [DEBUG   ] Got command RPT from MCS: ref #949253
2018-12-25 14:29:16 [DEBUG   ] summary = ERROR
2018-12-25 14:29:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949253  13 58477 52156657 A  ERRORERROR'
2018-12-25 14:29:16 [DEBUG   ] Got command RPT from MCS: ref #949254
2018-12-25 14:29:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 14:29:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949254  77 58477 52156861 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 14:29:17 [DEBUG   ] Got command RPT from MCS: ref #949255
2018-12-25 14:29:17 [DEBUG   ] summary = ERROR
2018-12-25 14:29:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949255  13 58477 52157065 A  ERRORERROR'
2018-12-25 14:29:17 [DEBUG   ] Got command RPT from MCS: ref #949256
2018-12-25 14:29:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 14:29:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949256  77 58477 52157257 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 14:29:17 [DEBUG   ] Got command RPT from MCS: ref #949257
2018-12-25 14:29:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 14:29:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949257  12 58477 52157461 A  ERRORB™™š'
2018-12-25 14:29:24 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 14:29:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:29:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 14:29:26 [WARNING ] (13, 1, 'bot')
2018-12-25 14:29:26 [WARNING ] (13, 1, 'bot')
2018-12-25 14:29:26 [WARNING ] (13, 1, 'bot')
2018-12-25 14:29:26 [WARNING ] (13, 1, 'bot')
2018-12-25 14:29:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:29:26 [DEBUG   ] Finished updating board flags in 1.815 seconds
2018-12-25 14:29:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 14:30:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-25 14:30:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-25 14:30:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:30:26 [WARNING ] (13, 1, 'bot')
2018-12-25 14:30:26 [WARNING ] (13, 1, 'bot')
2018-12-25 14:30:26 [WARNING ] (13, 1, 'bot')
2018-12-25 14:30:26 [WARNING ] (13, 1, 'bot')
2018-12-25 14:30:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:30:26 [DEBUG   ] Finished updating board flags in 1.789 seconds
2018-12-25 14:30:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 14:30:58 [DEBUG   ] Got command RPT from MCS: ref #949262
2018-12-25 14:30:58 [DEBUG   ] summary = ERROR
2018-12-25 14:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949262  13 58477 52258389 A  ERRORERROR'
2018-12-25 14:30:58 [DEBUG   ] Got command RPT from MCS: ref #949263
2018-12-25 14:30:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 14:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949263  77 58477 52258390 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 14:31:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 14:31:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 14:31:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 14:31:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:31:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-25 14:31:26 [WARNING ] (13, 1, 'bot')
2018-12-25 14:31:26 [WARNING ] (13, 1, 'bot')
2018-12-25 14:31:26 [WARNING ] (13, 1, 'bot')
2018-12-25 14:31:26 [WARNING ] (13, 1, 'bot')
2018-12-25 14:31:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:31:26 [DEBUG   ] Finished updating board flags in 1.701 seconds
2018-12-25 14:31:44 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-25 14:32:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 14:32:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 14:32:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 14:32:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:32:26 [WARNING ] (13, 1, 'bot')
2018-12-25 14:32:26 [WARNING ] (13, 1, 'bot')
2018-12-25 14:32:26 [WARNING ] (13, 1, 'bot')
2018-12-25 14:32:26 [WARNING ] (13, 1, 'bot')
2018-12-25 14:32:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:32:26 [DEBUG   ] Finished updating board flags in 1.504 seconds
2018-12-25 14:32:44 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-25 14:33:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 14:33:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 14:33:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 14:33:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:33:26 [WARNING ] (13, 1, 'bot')
2018-12-25 14:33:26 [WARNING ] (13, 1, 'bot')
2018-12-25 14:33:26 [WARNING ] (13, 1, 'bot')
2018-12-25 14:33:26 [WARNING ] (13, 1, 'bot')
2018-12-25 14:33:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:33:26 [DEBUG   ] Finished updating board flags in 1.499 seconds
2018-12-25 14:33:44 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-25 14:34:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 14:34:16 [DEBUG   ] Got command RPT from MCS: ref #949285
2018-12-25 14:34:16 [DEBUG   ] summary = ERROR
2018-12-25 14:34:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949285  13 58477 52456737 A  ERRORERROR'
2018-12-25 14:34:16 [DEBUG   ] Got command RPT from MCS: ref #949286
2018-12-25 14:34:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 14:34:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949286  77 58477 52456941 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 14:34:17 [DEBUG   ] Got command RPT from MCS: ref #949287
2018-12-25 14:34:17 [DEBUG   ] summary = ERROR
2018-12-25 14:34:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949287  13 58477 52457145 A  ERRORERROR'
2018-12-25 14:34:17 [DEBUG   ] Got command RPT from MCS: ref #949289
2018-12-25 14:34:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 14:34:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949289  77 58477 52457337 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 14:34:17 [DEBUG   ] Got command RPT from MCS: ref #949291
2018-12-25 14:34:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 14:34:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949291  12 58477 52457541 A  ERRORB™™š'
2018-12-25 14:34:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 14:34:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:34:26 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 14:34:26 [WARNING ] (13, 1, 'bot')
2018-12-25 14:34:26 [WARNING ] (13, 1, 'bot')
2018-12-25 14:34:26 [WARNING ] (13, 1, 'bot')
2018-12-25 14:34:26 [WARNING ] (13, 1, 'bot')
2018-12-25 14:34:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:34:26 [DEBUG   ] Finished updating board flags in 1.501 seconds
2018-12-25 14:34:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 14:35:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 14:35:24 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 14:35:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:35:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 14:35:26 [WARNING ] (13, 1, 'bot')
2018-12-25 14:35:26 [WARNING ] (13, 1, 'bot')
2018-12-25 14:35:26 [WARNING ] (13, 1, 'bot')
2018-12-25 14:35:26 [WARNING ] (13, 1, 'bot')
2018-12-25 14:35:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:35:26 [DEBUG   ] Finished updating board flags in 1.490 seconds
2018-12-25 14:35:44 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 14:35:58 [DEBUG   ] Got command RPT from MCS: ref #949295
2018-12-25 14:35:58 [DEBUG   ] summary = ERROR
2018-12-25 14:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949295  13 58477 52558393 A  ERRORERROR'
2018-12-25 14:35:58 [DEBUG   ] Got command RPT from MCS: ref #949296
2018-12-25 14:35:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 14:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949296  77 58477 52558394 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 14:36:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 14:36:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 14:36:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:36:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-25 14:36:27 [WARNING ] (13, 1, 'bot')
2018-12-25 14:36:27 [WARNING ] (13, 1, 'bot')
2018-12-25 14:36:27 [WARNING ] (13, 1, 'bot')
2018-12-25 14:36:27 [WARNING ] (13, 1, 'bot')
2018-12-25 14:36:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:36:27 [DEBUG   ] Finished updating board flags in 2.151 seconds
2018-12-25 14:36:44 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 14:37:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 14:37:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 14:37:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:37:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 14:37:27 [WARNING ] (13, 1, 'bot')
2018-12-25 14:37:27 [WARNING ] (13, 1, 'bot')
2018-12-25 14:37:27 [WARNING ] (13, 1, 'bot')
2018-12-25 14:37:27 [WARNING ] (13, 1, 'bot')
2018-12-25 14:37:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:37:27 [DEBUG   ] Finished updating board flags in 2.019 seconds
2018-12-25 14:37:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 14:38:04 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 14:38:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 14:38:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:38:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-12-25 14:38:27 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 14:38:27 [WARNING ] (13, 1, 'bot')
2018-12-25 14:38:27 [WARNING ] (13, 1, 'bot')
2018-12-25 14:38:27 [WARNING ] (13, 1, 'bot')
2018-12-25 14:38:27 [WARNING ] (13, 1, 'bot')
2018-12-25 14:38:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:38:27 [DEBUG   ] Finished updating board flags in 2.076 seconds
2018-12-25 14:38:44 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 14:39:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 14:39:16 [DEBUG   ] Got command RPT from MCS: ref #949321
2018-12-25 14:39:16 [DEBUG   ] summary = ERROR
2018-12-25 14:39:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949321  13 58477 52756825 A  ERRORERROR'
2018-12-25 14:39:17 [DEBUG   ] Got command RPT from MCS: ref #949322
2018-12-25 14:39:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 14:39:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949322  77 58477 52757017 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 14:39:17 [DEBUG   ] Got command RPT from MCS: ref #949323
2018-12-25 14:39:17 [DEBUG   ] summary = ERROR
2018-12-25 14:39:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949323  13 58477 52757221 A  ERRORERROR'
2018-12-25 14:39:17 [DEBUG   ] Got command RPT from MCS: ref #949324
2018-12-25 14:39:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 14:39:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949324  77 58477 52757425 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 14:39:17 [DEBUG   ] Got command RPT from MCS: ref #949325
2018-12-25 14:39:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 14:39:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949325  12 58477 52757629 A  ERRORB™™š'
2018-12-25 14:39:24 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 14:39:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:39:27 [WARNING ] (13, 1, 'bot')
2018-12-25 14:39:27 [WARNING ] (13, 1, 'bot')
2018-12-25 14:39:27 [WARNING ] (13, 1, 'bot')
2018-12-25 14:39:27 [WARNING ] (13, 1, 'bot')
2018-12-25 14:39:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:39:27 [DEBUG   ] Finished updating board flags in 1.877 seconds
2018-12-25 14:39:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 14:40:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 14:40:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 14:40:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:40:27 [WARNING ] (13, 1, 'bot')
2018-12-25 14:40:27 [WARNING ] (13, 1, 'bot')
2018-12-25 14:40:27 [WARNING ] (13, 1, 'bot')
2018-12-25 14:40:27 [WARNING ] (13, 1, 'bot')
2018-12-25 14:40:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:40:27 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-12-25 14:40:44 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 14:40:58 [DEBUG   ] Got command RPT from MCS: ref #949330
2018-12-25 14:40:58 [DEBUG   ] summary = ERROR
2018-12-25 14:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949330  13 58477 52858393 A  ERRORERROR'
2018-12-25 14:40:58 [DEBUG   ] Got command RPT from MCS: ref #949331
2018-12-25 14:40:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 14:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949331  77 58477 52858394 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 14:41:04 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 14:41:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 14:41:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 14:41:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:41:27 [WARNING ] (13, 1, 'bot')
2018-12-25 14:41:27 [WARNING ] (13, 1, 'bot')
2018-12-25 14:41:27 [WARNING ] (13, 1, 'bot')
2018-12-25 14:41:27 [WARNING ] (13, 1, 'bot')
2018-12-25 14:41:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:41:27 [DEBUG   ] Finished updating board flags in 1.782 seconds
2018-12-25 14:41:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 14:42:04 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 14:42:24 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 14:42:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:42:27 [WARNING ] (13, 1, 'bot')
2018-12-25 14:42:27 [WARNING ] (13, 1, 'bot')
2018-12-25 14:42:27 [WARNING ] (13, 1, 'bot')
2018-12-25 14:42:27 [WARNING ] (13, 1, 'bot')
2018-12-25 14:42:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:42:27 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-12-25 14:42:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 14:43:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 14:43:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 14:43:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:43:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 14:43:27 [WARNING ] (13, 1, 'bot')
2018-12-25 14:43:27 [WARNING ] (13, 1, 'bot')
2018-12-25 14:43:27 [WARNING ] (13, 1, 'bot')
2018-12-25 14:43:27 [WARNING ] (13, 1, 'bot')
2018-12-25 14:43:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:43:27 [DEBUG   ] Finished updating board flags in 1.697 seconds
2018-12-25 14:43:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 14:44:04 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 14:44:16 [DEBUG   ] Got command RPT from MCS: ref #949358
2018-12-25 14:44:16 [DEBUG   ] summary = ERROR
2018-12-25 14:44:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949358  13 58477 53056897 A  ERRORERROR'
2018-12-25 14:44:17 [DEBUG   ] Got command RPT from MCS: ref #949359
2018-12-25 14:44:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 14:44:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949359  77 58477 53057101 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 14:44:17 [DEBUG   ] Got command RPT from MCS: ref #949360
2018-12-25 14:44:17 [DEBUG   ] summary = ERROR
2018-12-25 14:44:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949360  13 58477 53057305 A  ERRORERROR'
2018-12-25 14:44:17 [DEBUG   ] Got command RPT from MCS: ref #949362
2018-12-25 14:44:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 14:44:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949362  77 58477 53057509 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 14:44:17 [DEBUG   ] Got command RPT from MCS: ref #949364
2018-12-25 14:44:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 14:44:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949364  12 58477 53057701 A  ERRORB˜™š'
2018-12-25 14:44:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 14:44:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:44:27 [WARNING ] (13, 1, 'bot')
2018-12-25 14:44:27 [WARNING ] (13, 1, 'bot')
2018-12-25 14:44:27 [WARNING ] (13, 1, 'bot')
2018-12-25 14:44:27 [WARNING ] (13, 1, 'bot')
2018-12-25 14:44:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:44:27 [DEBUG   ] Finished updating board flags in 1.505 seconds
2018-12-25 14:44:44 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 14:45:04 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 14:45:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 14:45:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-25 14:45:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:45:27 [WARNING ] (13, 1, 'bot')
2018-12-25 14:45:27 [WARNING ] (13, 1, 'bot')
2018-12-25 14:45:27 [WARNING ] (13, 1, 'bot')
2018-12-25 14:45:27 [WARNING ] (13, 1, 'bot')
2018-12-25 14:45:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:45:27 [DEBUG   ] Finished updating board flags in 1.515 seconds
2018-12-25 14:45:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 14:45:58 [DEBUG   ] Got command RPT from MCS: ref #949372
2018-12-25 14:45:58 [DEBUG   ] summary = ERROR
2018-12-25 14:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949372  13 58477 53158397 A  ERRORERROR'
2018-12-25 14:45:58 [DEBUG   ] Got command RPT from MCS: ref #949373
2018-12-25 14:45:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 14:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949373  77 58477 53158398 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 14:46:04 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 14:46:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 14:46:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-25 14:46:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:46:27 [WARNING ] (13, 1, 'bot')
2018-12-25 14:46:27 [WARNING ] (13, 1, 'bot')
2018-12-25 14:46:27 [WARNING ] (13, 1, 'bot')
2018-12-25 14:46:27 [WARNING ] (13, 1, 'bot')
2018-12-25 14:46:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:46:27 [DEBUG   ] Finished updating board flags in 1.531 seconds
2018-12-25 14:46:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 14:47:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 14:47:24 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 14:47:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:47:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 14:47:28 [WARNING ] (13, 1, 'bot')
2018-12-25 14:47:28 [WARNING ] (13, 1, 'bot')
2018-12-25 14:47:28 [WARNING ] (13, 1, 'bot')
2018-12-25 14:47:28 [WARNING ] (13, 1, 'bot')
2018-12-25 14:47:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:47:28 [DEBUG   ] Finished updating board flags in 2.193 seconds
2018-12-25 14:47:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 14:48:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 14:48:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 14:48:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:48:28 [WARNING ] (13, 1, 'bot')
2018-12-25 14:48:28 [WARNING ] (13, 1, 'bot')
2018-12-25 14:48:28 [WARNING ] (13, 1, 'bot')
2018-12-25 14:48:28 [WARNING ] (13, 1, 'bot')
2018-12-25 14:48:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:48:28 [DEBUG   ] Finished updating board flags in 2.089 seconds
2018-12-25 14:48:44 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 14:49:04 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 14:49:16 [DEBUG   ] Got command RPT from MCS: ref #949393
2018-12-25 14:49:16 [DEBUG   ] summary = ERROR
2018-12-25 14:49:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949393  13 58477 53356985 A  ERRORERROR'
2018-12-25 14:49:17 [DEBUG   ] Got command RPT from MCS: ref #949394
2018-12-25 14:49:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 14:49:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949394  77 58477 53357177 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 14:49:17 [DEBUG   ] Got command RPT from MCS: ref #949395
2018-12-25 14:49:17 [DEBUG   ] summary = ERROR
2018-12-25 14:49:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949395  13 58477 53357381 A  ERRORERROR'
2018-12-25 14:49:17 [DEBUG   ] Got command RPT from MCS: ref #949396
2018-12-25 14:49:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 14:49:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949396  77 58477 53357585 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 14:49:17 [DEBUG   ] Got command RPT from MCS: ref #949397
2018-12-25 14:49:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 14:49:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949397  12 58477 53357789 A  ERRORB™™š'
2018-12-25 14:49:24 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 14:49:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:49:28 [WARNING ] (13, 1, 'bot')
2018-12-25 14:49:28 [WARNING ] (13, 1, 'bot')
2018-12-25 14:49:28 [WARNING ] (13, 1, 'bot')
2018-12-25 14:49:28 [WARNING ] (13, 1, 'bot')
2018-12-25 14:49:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:49:28 [DEBUG   ] Finished updating board flags in 1.868 seconds
2018-12-25 14:49:44 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-25 14:50:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 14:50:24 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-12-25 14:50:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:50:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 14:50:28 [WARNING ] (13, 1, 'bot')
2018-12-25 14:50:28 [WARNING ] (13, 1, 'bot')
2018-12-25 14:50:28 [WARNING ] (13, 1, 'bot')
2018-12-25 14:50:28 [WARNING ] (13, 1, 'bot')
2018-12-25 14:50:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:50:28 [DEBUG   ] Finished updating board flags in 1.822 seconds
2018-12-25 14:50:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 14:50:58 [DEBUG   ] Got command RPT from MCS: ref #949398
2018-12-25 14:50:58 [DEBUG   ] summary = ERROR
2018-12-25 14:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949398  13 58477 53458393 A  ERRORERROR'
2018-12-25 14:50:58 [DEBUG   ] Got command RPT from MCS: ref #949399
2018-12-25 14:50:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 14:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949399  77 58477 53458394 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 14:51:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 14:51:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 14:51:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:51:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 14:51:28 [WARNING ] (13, 1, 'bot')
2018-12-25 14:51:28 [WARNING ] (13, 1, 'bot')
2018-12-25 14:51:28 [WARNING ] (13, 1, 'bot')
2018-12-25 14:51:28 [WARNING ] (13, 1, 'bot')
2018-12-25 14:51:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:51:28 [DEBUG   ] Finished updating board flags in 1.779 seconds
2018-12-25 14:51:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 14:52:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 14:52:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 14:52:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:52:28 [WARNING ] (13, 1, 'bot')
2018-12-25 14:52:28 [WARNING ] (13, 1, 'bot')
2018-12-25 14:52:28 [WARNING ] (13, 1, 'bot')
2018-12-25 14:52:28 [WARNING ] (13, 1, 'bot')
2018-12-25 14:52:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:52:28 [DEBUG   ] Finished updating board flags in 1.619 seconds
2018-12-25 14:52:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 14:53:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 14:53:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 14:53:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:53:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 14:53:28 [WARNING ] (13, 1, 'bot')
2018-12-25 14:53:28 [WARNING ] (13, 1, 'bot')
2018-12-25 14:53:28 [WARNING ] (13, 1, 'bot')
2018-12-25 14:53:28 [WARNING ] (13, 1, 'bot')
2018-12-25 14:53:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:53:28 [DEBUG   ] Finished updating board flags in 1.597 seconds
2018-12-25 14:53:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 14:54:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-25 14:54:17 [DEBUG   ] Got command RPT from MCS: ref #949421
2018-12-25 14:54:17 [DEBUG   ] summary = ERROR
2018-12-25 14:54:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949421  13 58477 53657057 A  ERRORERROR'
2018-12-25 14:54:17 [DEBUG   ] Got command RPT from MCS: ref #949422
2018-12-25 14:54:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 14:54:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949422  77 58477 53657261 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 14:54:17 [DEBUG   ] Got command RPT from MCS: ref #949423
2018-12-25 14:54:17 [DEBUG   ] summary = ERROR
2018-12-25 14:54:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949423  13 58477 53657465 A  ERRORERROR'
2018-12-25 14:54:17 [DEBUG   ] Got command RPT from MCS: ref #949425
2018-12-25 14:54:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 14:54:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949425  77 58477 53657669 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 14:54:17 [DEBUG   ] Got command RPT from MCS: ref #949427
2018-12-25 14:54:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 14:54:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949427  12 58477 53657861 A  ERRORB™™š'
2018-12-25 14:54:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 14:54:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:54:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 14:54:28 [WARNING ] (13, 1, 'bot')
2018-12-25 14:54:28 [WARNING ] (13, 1, 'bot')
2018-12-25 14:54:28 [WARNING ] (13, 1, 'bot')
2018-12-25 14:54:28 [WARNING ] (13, 1, 'bot')
2018-12-25 14:54:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:54:28 [DEBUG   ] Finished updating board flags in 1.438 seconds
2018-12-25 14:54:44 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 14:55:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 14:55:24 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-25 14:55:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:55:28 [WARNING ] (13, 1, 'bot')
2018-12-25 14:55:28 [WARNING ] (13, 1, 'bot')
2018-12-25 14:55:28 [WARNING ] (13, 1, 'bot')
2018-12-25 14:55:28 [WARNING ] (13, 1, 'bot')
2018-12-25 14:55:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:55:28 [DEBUG   ] Finished updating board flags in 1.566 seconds
2018-12-25 14:55:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 14:55:58 [DEBUG   ] Got command RPT from MCS: ref #949435
2018-12-25 14:55:58 [DEBUG   ] summary = ERROR
2018-12-25 14:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949435  13 58477 53758405 A  ERRORERROR'
2018-12-25 14:55:58 [DEBUG   ] Got command RPT from MCS: ref #949436
2018-12-25 14:55:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 14:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949436  77 58477 53758406 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 14:56:04 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 14:56:24 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-25 14:56:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:56:29 [WARNING ] (13, 1, 'bot')
2018-12-25 14:56:29 [WARNING ] (13, 1, 'bot')
2018-12-25 14:56:29 [WARNING ] (13, 1, 'bot')
2018-12-25 14:56:29 [WARNING ] (13, 1, 'bot')
2018-12-25 14:56:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:56:29 [DEBUG   ] Finished updating board flags in 2.321 seconds
2018-12-25 14:56:44 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-12-25 14:57:04 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-12-25 14:57:24 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-25 14:57:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:57:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-12-25 14:57:29 [WARNING ] (13, 1, 'bot')
2018-12-25 14:57:29 [WARNING ] (13, 1, 'bot')
2018-12-25 14:57:29 [WARNING ] (13, 1, 'bot')
2018-12-25 14:57:29 [WARNING ] (13, 1, 'bot')
2018-12-25 14:57:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:57:29 [DEBUG   ] Finished updating board flags in 2.073 seconds
2018-12-25 14:57:45 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-25 14:58:05 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-25 14:58:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 14:58:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:58:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 14:58:29 [WARNING ] (13, 1, 'bot')
2018-12-25 14:58:29 [WARNING ] (13, 1, 'bot')
2018-12-25 14:58:29 [WARNING ] (13, 1, 'bot')
2018-12-25 14:58:29 [WARNING ] (13, 1, 'bot')
2018-12-25 14:58:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:58:29 [DEBUG   ] Finished updating board flags in 2.015 seconds
2018-12-25 14:58:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-25 14:59:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 14:59:17 [DEBUG   ] Got command RPT from MCS: ref #949456
2018-12-25 14:59:17 [DEBUG   ] summary = ERROR
2018-12-25 14:59:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949456  13 58477 53957145 A  ERRORERROR'
2018-12-25 14:59:17 [DEBUG   ] Got command RPT from MCS: ref #949457
2018-12-25 14:59:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 14:59:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949457  77 58477 53957337 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 14:59:17 [DEBUG   ] Got command RPT from MCS: ref #949458
2018-12-25 14:59:17 [DEBUG   ] summary = ERROR
2018-12-25 14:59:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949458  13 58477 53957541 A  ERRORERROR'
2018-12-25 14:59:17 [DEBUG   ] Got command RPT from MCS: ref #949459
2018-12-25 14:59:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 14:59:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949459  77 58477 53957745 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 14:59:17 [DEBUG   ] Got command RPT from MCS: ref #949460
2018-12-25 14:59:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 14:59:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949460  12 58477 53957949 A  ERRORB™™š'
2018-12-25 14:59:25 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 14:59:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 14:59:29 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 14:59:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 14:59:29 [WARNING ] (13, 1, 'bot')
2018-12-25 14:59:29 [WARNING ] (13, 1, 'bot')
2018-12-25 14:59:29 [WARNING ] (13, 1, 'bot')
2018-12-25 14:59:29 [WARNING ] (13, 1, 'bot')
2018-12-25 14:59:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 14:59:29 [DEBUG   ] Finished updating board flags in 1.994 seconds
2018-12-25 14:59:45 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 15:00:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-25 15:00:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 15:00:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:00:29 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 15:00:29 [WARNING ] (13, 1, 'bot')
2018-12-25 15:00:29 [WARNING ] (13, 1, 'bot')
2018-12-25 15:00:29 [WARNING ] (13, 1, 'bot')
2018-12-25 15:00:29 [WARNING ] (13, 1, 'bot')
2018-12-25 15:00:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:00:29 [DEBUG   ] Finished updating board flags in 1.816 seconds
2018-12-25 15:00:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 15:00:58 [DEBUG   ] Got command RPT from MCS: ref #949465
2018-12-25 15:00:58 [DEBUG   ] summary = ERROR
2018-12-25 15:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949465  13 58477 54058401 A  ERRORERROR'
2018-12-25 15:00:58 [DEBUG   ] Got command RPT from MCS: ref #949466
2018-12-25 15:00:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 15:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949466  77 58477 54058402 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 15:01:05 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 15:01:25 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-12-25 15:01:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:01:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-25 15:01:29 [WARNING ] (13, 1, 'bot')
2018-12-25 15:01:29 [WARNING ] (13, 1, 'bot')
2018-12-25 15:01:29 [WARNING ] (13, 1, 'bot')
2018-12-25 15:01:29 [WARNING ] (13, 1, 'bot')
2018-12-25 15:01:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:01:29 [DEBUG   ] Finished updating board flags in 1.792 seconds
2018-12-25 15:01:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 15:02:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 15:02:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 15:02:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:02:29 [WARNING ] (13, 1, 'bot')
2018-12-25 15:02:29 [WARNING ] (13, 1, 'bot')
2018-12-25 15:02:29 [WARNING ] (13, 1, 'bot')
2018-12-25 15:02:29 [WARNING ] (13, 1, 'bot')
2018-12-25 15:02:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:02:29 [DEBUG   ] Finished updating board flags in 1.621 seconds
2018-12-25 15:02:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 15:03:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 15:03:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 15:03:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:03:29 [WARNING ] (13, 1, 'bot')
2018-12-25 15:03:29 [WARNING ] (13, 1, 'bot')
2018-12-25 15:03:29 [WARNING ] (13, 1, 'bot')
2018-12-25 15:03:29 [WARNING ] (13, 1, 'bot')
2018-12-25 15:03:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:03:29 [DEBUG   ] Finished updating board flags in 1.686 seconds
2018-12-25 15:03:45 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-25 15:04:05 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-12-25 15:04:17 [DEBUG   ] Got command RPT from MCS: ref #949488
2018-12-25 15:04:17 [DEBUG   ] summary = ERROR
2018-12-25 15:04:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949488  13 58477 54257213 A  ERRORERROR'
2018-12-25 15:04:17 [DEBUG   ] Got command RPT from MCS: ref #949489
2018-12-25 15:04:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 15:04:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949489  77 58477 54257417 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 15:04:17 [DEBUG   ] Got command RPT from MCS: ref #949490
2018-12-25 15:04:17 [DEBUG   ] summary = ERROR
2018-12-25 15:04:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949490  13 58477 54257621 A  ERRORERROR'
2018-12-25 15:04:17 [DEBUG   ] Got command RPT from MCS: ref #949492
2018-12-25 15:04:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 15:04:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949492  77 58477 54257825 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 15:04:18 [DEBUG   ] Got command RPT from MCS: ref #949493
2018-12-25 15:04:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 15:04:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949493  12 58477 54258017 A  ERRORB™™š'
2018-12-25 15:04:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 15:04:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:04:29 [WARNING ] (13, 1, 'bot')
2018-12-25 15:04:29 [WARNING ] (13, 1, 'bot')
2018-12-25 15:04:29 [WARNING ] (13, 1, 'bot')
2018-12-25 15:04:29 [WARNING ] (13, 1, 'bot')
2018-12-25 15:04:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:04:29 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-12-25 15:04:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 15:05:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 15:05:25 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-25 15:05:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 15:05:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:05:29 [WARNING ] (13, 1, 'bot')
2018-12-25 15:05:29 [WARNING ] (13, 1, 'bot')
2018-12-25 15:05:29 [WARNING ] (13, 1, 'bot')
2018-12-25 15:05:29 [WARNING ] (13, 1, 'bot')
2018-12-25 15:05:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:05:29 [DEBUG   ] Finished updating board flags in 1.486 seconds
2018-12-25 15:05:46 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-25 15:05:58 [DEBUG   ] Got command RPT from MCS: ref #949498
2018-12-25 15:05:58 [DEBUG   ] summary = ERROR
2018-12-25 15:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949498  13 58477 54358401 A  ERRORERROR'
2018-12-25 15:05:58 [DEBUG   ] Got command RPT from MCS: ref #949499
2018-12-25 15:05:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 15:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949499  77 58477 54358402 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 15:06:06 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-25 15:06:26 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-25 15:06:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2018-12-25 15:06:28 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 15:06:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:06:29 [WARNING ] (13, 1, 'bot')
2018-12-25 15:06:29 [WARNING ] (13, 1, 'bot')
2018-12-25 15:06:29 [WARNING ] (13, 1, 'bot')
2018-12-25 15:06:29 [WARNING ] (13, 1, 'bot')
2018-12-25 15:06:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:06:29 [DEBUG   ] Finished updating board flags in 1.470 seconds
2018-12-25 15:06:46 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-25 15:07:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 15:07:26 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-25 15:07:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:07:29 [WARNING ] (13, 1, 'bot')
2018-12-25 15:07:29 [WARNING ] (13, 1, 'bot')
2018-12-25 15:07:29 [WARNING ] (13, 1, 'bot')
2018-12-25 15:07:29 [WARNING ] (13, 1, 'bot')
2018-12-25 15:07:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:07:29 [DEBUG   ] Finished updating board flags in 1.478 seconds
2018-12-25 15:07:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 15:08:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 15:08:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 15:08:28 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 15:08:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:08:29 [WARNING ] (13, 1, 'bot')
2018-12-25 15:08:29 [WARNING ] (13, 1, 'bot')
2018-12-25 15:08:29 [WARNING ] (13, 1, 'bot')
2018-12-25 15:08:29 [WARNING ] (13, 1, 'bot')
2018-12-25 15:08:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:08:29 [DEBUG   ] Finished updating board flags in 1.481 seconds
2018-12-25 15:08:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 15:09:06 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 15:09:17 [DEBUG   ] Got command RPT from MCS: ref #949519
2018-12-25 15:09:17 [DEBUG   ] summary = ERROR
2018-12-25 15:09:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949519  13 58477 54557293 A  ERRORERROR'
2018-12-25 15:09:17 [DEBUG   ] Got command RPT from MCS: ref #949520
2018-12-25 15:09:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 15:09:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949520  77 58477 54557497 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 15:09:17 [DEBUG   ] Got command RPT from MCS: ref #949521
2018-12-25 15:09:17 [DEBUG   ] summary = ERROR
2018-12-25 15:09:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949521  13 58477 54557701 A  ERRORERROR'
2018-12-25 15:09:17 [DEBUG   ] Got command RPT from MCS: ref #949522
2018-12-25 15:09:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 15:09:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949522  77 58477 54557905 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 15:09:18 [DEBUG   ] Got command RPT from MCS: ref #949523
2018-12-25 15:09:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 15:09:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949523  12 58477 54558097 A  ERRORB˜™š'
2018-12-25 15:09:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 15:09:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:09:30 [WARNING ] (13, 1, 'bot')
2018-12-25 15:09:30 [WARNING ] (13, 1, 'bot')
2018-12-25 15:09:30 [WARNING ] (13, 1, 'bot')
2018-12-25 15:09:30 [WARNING ] (13, 1, 'bot')
2018-12-25 15:09:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:09:30 [DEBUG   ] Finished updating board flags in 2.180 seconds
2018-12-25 15:09:46 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 15:10:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 15:10:26 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 15:10:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:10:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 15:10:30 [WARNING ] (13, 1, 'bot')
2018-12-25 15:10:30 [WARNING ] (13, 1, 'bot')
2018-12-25 15:10:30 [WARNING ] (13, 1, 'bot')
2018-12-25 15:10:30 [WARNING ] (13, 1, 'bot')
2018-12-25 15:10:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:10:30 [DEBUG   ] Finished updating board flags in 2.030 seconds
2018-12-25 15:10:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 15:10:58 [DEBUG   ] Got command RPT from MCS: ref #949528
2018-12-25 15:10:58 [DEBUG   ] summary = ERROR
2018-12-25 15:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949528  13 58477 54658397 A  ERRORERROR'
2018-12-25 15:10:58 [DEBUG   ] Got command RPT from MCS: ref #949529
2018-12-25 15:10:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 15:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949529  77 58477 54658398 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 15:11:06 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 15:11:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 15:11:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:11:30 [WARNING ] (13, 1, 'bot')
2018-12-25 15:11:30 [WARNING ] (13, 1, 'bot')
2018-12-25 15:11:30 [WARNING ] (13, 1, 'bot')
2018-12-25 15:11:30 [WARNING ] (13, 1, 'bot')
2018-12-25 15:11:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:11:30 [DEBUG   ] Finished updating board flags in 1.980 seconds
2018-12-25 15:11:46 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 15:12:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 15:12:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 15:12:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:12:30 [WARNING ] (13, 1, 'bot')
2018-12-25 15:12:30 [WARNING ] (13, 1, 'bot')
2018-12-25 15:12:30 [WARNING ] (13, 1, 'bot')
2018-12-25 15:12:30 [WARNING ] (13, 1, 'bot')
2018-12-25 15:12:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:12:30 [DEBUG   ] Finished updating board flags in 1.928 seconds
2018-12-25 15:12:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 15:13:06 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 15:13:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 15:13:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:13:30 [WARNING ] (13, 1, 'bot')
2018-12-25 15:13:30 [WARNING ] (13, 1, 'bot')
2018-12-25 15:13:30 [WARNING ] (13, 1, 'bot')
2018-12-25 15:13:30 [WARNING ] (13, 1, 'bot')
2018-12-25 15:13:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:13:30 [DEBUG   ] Finished updating board flags in 1.663 seconds
2018-12-25 15:13:46 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-25 15:14:06 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-25 15:14:17 [DEBUG   ] Got command RPT from MCS: ref #949551
2018-12-25 15:14:17 [DEBUG   ] summary = ERROR
2018-12-25 15:14:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949551  13 58477 54857373 A  ERRORERROR'
2018-12-25 15:14:17 [DEBUG   ] Got command RPT from MCS: ref #949552
2018-12-25 15:14:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 15:14:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949552  77 58477 54857577 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 15:14:17 [DEBUG   ] Got command RPT from MCS: ref #949553
2018-12-25 15:14:17 [DEBUG   ] summary = ERROR
2018-12-25 15:14:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949553  13 58477 54857781 A  ERRORERROR'
2018-12-25 15:14:17 [DEBUG   ] Got command RPT from MCS: ref #949555
2018-12-25 15:14:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 15:14:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949555  77 58477 54857985 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 15:14:18 [DEBUG   ] Got command RPT from MCS: ref #949556
2018-12-25 15:14:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 15:14:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949556  12 58477 54858177 A  ERRORB˜™š'
2018-12-25 15:14:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 15:14:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 15:14:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:14:30 [WARNING ] (13, 1, 'bot')
2018-12-25 15:14:30 [WARNING ] (13, 1, 'bot')
2018-12-25 15:14:30 [WARNING ] (13, 1, 'bot')
2018-12-25 15:14:30 [WARNING ] (13, 1, 'bot')
2018-12-25 15:14:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:14:30 [DEBUG   ] Finished updating board flags in 1.631 seconds
2018-12-25 15:14:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 15:15:06 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 15:15:26 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-25 15:15:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:15:30 [WARNING ] (13, 1, 'bot')
2018-12-25 15:15:30 [WARNING ] (13, 1, 'bot')
2018-12-25 15:15:30 [WARNING ] (13, 1, 'bot')
2018-12-25 15:15:30 [WARNING ] (13, 1, 'bot')
2018-12-25 15:15:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:15:30 [DEBUG   ] Finished updating board flags in 1.579 seconds
2018-12-25 15:15:46 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-25 15:15:58 [DEBUG   ] Got command RPT from MCS: ref #949565
2018-12-25 15:15:58 [DEBUG   ] summary = ERROR
2018-12-25 15:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949565  13 58477 54958401 A  ERRORERROR'
2018-12-25 15:15:58 [DEBUG   ] Got command RPT from MCS: ref #949566
2018-12-25 15:15:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 15:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949566  77 58477 54958402 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 15:16:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 15:16:26 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 15:16:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:16:30 [WARNING ] (13, 1, 'bot')
2018-12-25 15:16:30 [WARNING ] (13, 1, 'bot')
2018-12-25 15:16:30 [WARNING ] (13, 1, 'bot')
2018-12-25 15:16:30 [WARNING ] (13, 1, 'bot')
2018-12-25 15:16:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:16:30 [DEBUG   ] Finished updating board flags in 1.417 seconds
2018-12-25 15:16:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 15:17:06 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-25 15:17:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 15:17:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 15:17:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:17:30 [WARNING ] (13, 1, 'bot')
2018-12-25 15:17:30 [WARNING ] (13, 1, 'bot')
2018-12-25 15:17:30 [WARNING ] (13, 1, 'bot')
2018-12-25 15:17:30 [WARNING ] (13, 1, 'bot')
2018-12-25 15:17:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:17:30 [DEBUG   ] Finished updating board flags in 1.403 seconds
2018-12-25 15:17:46 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 15:18:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 15:18:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 15:18:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:18:30 [WARNING ] (13, 1, 'bot')
2018-12-25 15:18:30 [WARNING ] (13, 1, 'bot')
2018-12-25 15:18:30 [WARNING ] (13, 1, 'bot')
2018-12-25 15:18:30 [WARNING ] (13, 1, 'bot')
2018-12-25 15:18:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:18:30 [DEBUG   ] Finished updating board flags in 1.463 seconds
2018-12-25 15:18:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 15:19:06 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 15:19:17 [DEBUG   ] Got command RPT from MCS: ref #949586
2018-12-25 15:19:17 [DEBUG   ] summary = ERROR
2018-12-25 15:19:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949586  13 58477 55157457 A  ERRORERROR'
2018-12-25 15:19:17 [DEBUG   ] Got command RPT from MCS: ref #949587
2018-12-25 15:19:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 15:19:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949587  77 58477 55157661 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 15:19:17 [DEBUG   ] Got command RPT from MCS: ref #949588
2018-12-25 15:19:17 [DEBUG   ] summary = ERROR
2018-12-25 15:19:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949588  13 58477 55157865 A  ERRORERROR'
2018-12-25 15:19:18 [DEBUG   ] Got command RPT from MCS: ref #949589
2018-12-25 15:19:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 15:19:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949589  77 58477 55158057 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 15:19:18 [DEBUG   ] Got command RPT from MCS: ref #949590
2018-12-25 15:19:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 15:19:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949590  12 58477 55158261 A  ERRORB™™š'
2018-12-25 15:19:26 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-25 15:19:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:19:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-25 15:19:30 [WARNING ] (13, 1, 'bot')
2018-12-25 15:19:30 [WARNING ] (13, 1, 'bot')
2018-12-25 15:19:30 [WARNING ] (13, 1, 'bot')
2018-12-25 15:19:30 [WARNING ] (13, 1, 'bot')
2018-12-25 15:19:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:19:30 [DEBUG   ] Finished updating board flags in 1.485 seconds
2018-12-25 15:19:46 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-12-25 15:20:06 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-25 15:20:27 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-25 15:20:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-25 15:20:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:20:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-25 15:20:30 [WARNING ] (13, 1, 'bot')
2018-12-25 15:20:30 [WARNING ] (13, 1, 'bot')
2018-12-25 15:20:30 [WARNING ] (13, 1, 'bot')
2018-12-25 15:20:30 [WARNING ] (13, 1, 'bot')
2018-12-25 15:20:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:20:30 [DEBUG   ] Finished updating board flags in 1.481 seconds
2018-12-25 15:20:47 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-25 15:20:58 [DEBUG   ] Got command RPT from MCS: ref #949591
2018-12-25 15:20:58 [DEBUG   ] summary = ERROR
2018-12-25 15:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949591  13 58477 55258409 A  ERRORERROR'
2018-12-25 15:20:58 [DEBUG   ] Got command RPT from MCS: ref #949592
2018-12-25 15:20:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 15:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949592  77 58477 55258410 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 15:21:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 15:21:27 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 15:21:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:21:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 15:21:31 [WARNING ] (13, 1, 'bot')
2018-12-25 15:21:31 [WARNING ] (13, 1, 'bot')
2018-12-25 15:21:31 [WARNING ] (13, 1, 'bot')
2018-12-25 15:21:31 [WARNING ] (13, 1, 'bot')
2018-12-25 15:21:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:21:31 [DEBUG   ] Finished updating board flags in 2.184 seconds
2018-12-25 15:21:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 15:22:07 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-25 15:22:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 15:22:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:22:31 [WARNING ] (13, 1, 'bot')
2018-12-25 15:22:31 [WARNING ] (13, 1, 'bot')
2018-12-25 15:22:31 [WARNING ] (13, 1, 'bot')
2018-12-25 15:22:31 [WARNING ] (13, 1, 'bot')
2018-12-25 15:22:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:22:31 [DEBUG   ] Finished updating board flags in 2.000 seconds
2018-12-25 15:22:47 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 15:23:07 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-25 15:23:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 15:23:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:23:31 [WARNING ] (13, 1, 'bot')
2018-12-25 15:23:31 [WARNING ] (13, 1, 'bot')
2018-12-25 15:23:31 [WARNING ] (13, 1, 'bot')
2018-12-25 15:23:31 [WARNING ] (13, 1, 'bot')
2018-12-25 15:23:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:23:31 [DEBUG   ] Finished updating board flags in 1.982 seconds
2018-12-25 15:23:47 [DEBUG   ] Finished updating ant stats in 0.790 seconds
2018-12-25 15:24:07 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2018-12-25 15:24:17 [DEBUG   ] Got command RPT from MCS: ref #949614
2018-12-25 15:24:17 [DEBUG   ] summary = ERROR
2018-12-25 15:24:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949614  13 58477 55457541 A  ERRORERROR'
2018-12-25 15:24:17 [DEBUG   ] Got command RPT from MCS: ref #949615
2018-12-25 15:24:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 15:24:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949615  77 58477 55457733 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 15:24:17 [DEBUG   ] Got command RPT from MCS: ref #949616
2018-12-25 15:24:17 [DEBUG   ] summary = ERROR
2018-12-25 15:24:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949616  13 58477 55457937 A  ERRORERROR'
2018-12-25 15:24:18 [DEBUG   ] Got command RPT from MCS: ref #949618
2018-12-25 15:24:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 15:24:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949618  77 58477 55458141 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 15:24:18 [DEBUG   ] Got command RPT from MCS: ref #949620
2018-12-25 15:24:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 15:24:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949620  12 58477 55458345 A  ERRORB™™š'
2018-12-25 15:24:28 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-12-25 15:24:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:24:31 [WARNING ] (13, 1, 'bot')
2018-12-25 15:24:31 [WARNING ] (13, 1, 'bot')
2018-12-25 15:24:31 [WARNING ] (13, 1, 'bot')
2018-12-25 15:24:31 [WARNING ] (13, 1, 'bot')
2018-12-25 15:24:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:24:31 [DEBUG   ] Finished updating board flags in 1.798 seconds
2018-12-25 15:24:48 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-25 15:25:08 [DEBUG   ] Finished updating ant stats in 1.176 seconds
2018-12-25 15:25:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 15:25:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 15:25:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:25:31 [WARNING ] (13, 1, 'bot')
2018-12-25 15:25:31 [WARNING ] (13, 1, 'bot')
2018-12-25 15:25:31 [WARNING ] (13, 1, 'bot')
2018-12-25 15:25:31 [WARNING ] (13, 1, 'bot')
2018-12-25 15:25:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:25:31 [DEBUG   ] Finished updating board flags in 1.610 seconds
2018-12-25 15:25:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 15:25:58 [DEBUG   ] Got command RPT from MCS: ref #949628
2018-12-25 15:25:58 [DEBUG   ] summary = ERROR
2018-12-25 15:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949628  13 58477 55558409 A  ERRORERROR'
2018-12-25 15:25:58 [DEBUG   ] Got command RPT from MCS: ref #949629
2018-12-25 15:25:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 15:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949629  77 58477 55558410 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 15:26:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 15:26:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 15:26:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:26:31 [WARNING ] (13, 1, 'bot')
2018-12-25 15:26:31 [WARNING ] (13, 1, 'bot')
2018-12-25 15:26:31 [WARNING ] (13, 1, 'bot')
2018-12-25 15:26:31 [WARNING ] (13, 1, 'bot')
2018-12-25 15:26:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:26:31 [DEBUG   ] Finished updating board flags in 1.709 seconds
2018-12-25 15:26:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 15:27:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 15:27:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 15:27:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:27:31 [WARNING ] (13, 1, 'bot')
2018-12-25 15:27:31 [WARNING ] (13, 1, 'bot')
2018-12-25 15:27:31 [WARNING ] (13, 1, 'bot')
2018-12-25 15:27:31 [WARNING ] (13, 1, 'bot')
2018-12-25 15:27:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:27:31 [DEBUG   ] Finished updating board flags in 1.488 seconds
2018-12-25 15:27:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 15:28:08 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-25 15:28:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 15:28:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:28:31 [WARNING ] (13, 1, 'bot')
2018-12-25 15:28:31 [WARNING ] (13, 1, 'bot')
2018-12-25 15:28:31 [WARNING ] (13, 1, 'bot')
2018-12-25 15:28:31 [WARNING ] (13, 1, 'bot')
2018-12-25 15:28:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:28:31 [DEBUG   ] Finished updating board flags in 1.421 seconds
2018-12-25 15:28:48 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-25 15:29:08 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 15:29:17 [DEBUG   ] Got command RPT from MCS: ref #949649
2018-12-25 15:29:17 [DEBUG   ] summary = ERROR
2018-12-25 15:29:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949649  13 58477 55757625 A  ERRORERROR'
2018-12-25 15:29:17 [DEBUG   ] Got command RPT from MCS: ref #949650
2018-12-25 15:29:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 15:29:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949650  77 58477 55757817 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 15:29:18 [DEBUG   ] Got command RPT from MCS: ref #949651
2018-12-25 15:29:18 [DEBUG   ] summary = ERROR
2018-12-25 15:29:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949651  13 58477 55758021 A  ERRORERROR'
2018-12-25 15:29:18 [DEBUG   ] Got command RPT from MCS: ref #949652
2018-12-25 15:29:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 15:29:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949652  77 58477 55758225 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 15:29:18 [DEBUG   ] Got command RPT from MCS: ref #949653
2018-12-25 15:29:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 15:29:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949653  12 58477 55758417 A  ERRORB˜™š'
2018-12-25 15:29:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 15:29:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:29:31 [WARNING ] (13, 1, 'bot')
2018-12-25 15:29:31 [WARNING ] (13, 1, 'bot')
2018-12-25 15:29:31 [WARNING ] (13, 1, 'bot')
2018-12-25 15:29:31 [WARNING ] (13, 1, 'bot')
2018-12-25 15:29:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:29:31 [DEBUG   ] Finished updating board flags in 1.378 seconds
2018-12-25 15:29:48 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-25 15:30:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 15:30:28 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 15:30:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:30:31 [WARNING ] (13, 1, 'bot')
2018-12-25 15:30:31 [WARNING ] (13, 1, 'bot')
2018-12-25 15:30:31 [WARNING ] (13, 1, 'bot')
2018-12-25 15:30:31 [WARNING ] (13, 1, 'bot')
2018-12-25 15:30:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:30:31 [DEBUG   ] Finished updating board flags in 1.427 seconds
2018-12-25 15:30:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 15:30:58 [DEBUG   ] Got command RPT from MCS: ref #949658
2018-12-25 15:30:58 [DEBUG   ] summary = ERROR
2018-12-25 15:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949658  13 58477 55858405 A  ERRORERROR'
2018-12-25 15:30:58 [DEBUG   ] Got command RPT from MCS: ref #949659
2018-12-25 15:30:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 15:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949659  77 58477 55858406 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 15:31:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 15:31:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 15:31:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:31:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:31:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:31:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:31:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:31:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:31:32 [DEBUG   ] Finished updating board flags in 2.203 seconds
2018-12-25 15:31:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 15:32:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 15:32:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 15:32:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:32:32 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 15:32:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:32:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:32:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:32:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:32:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:32:32 [DEBUG   ] Finished updating board flags in 2.209 seconds
2018-12-25 15:32:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 15:33:08 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 15:33:28 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-25 15:33:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:33:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:33:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:33:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:33:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:33:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:33:32 [DEBUG   ] Finished updating board flags in 2.209 seconds
2018-12-25 15:33:48 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-12-25 15:34:08 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-25 15:34:17 [DEBUG   ] Got command RPT from MCS: ref #949681
2018-12-25 15:34:17 [DEBUG   ] summary = ERROR
2018-12-25 15:34:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949681  13 58477 56057705 A  ERRORERROR'
2018-12-25 15:34:17 [DEBUG   ] Got command RPT from MCS: ref #949682
2018-12-25 15:34:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 15:34:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949682  77 58477 56057897 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 15:34:18 [DEBUG   ] Got command RPT from MCS: ref #949683
2018-12-25 15:34:18 [DEBUG   ] summary = ERROR
2018-12-25 15:34:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949683  13 58477 56058101 A  ERRORERROR'
2018-12-25 15:34:18 [DEBUG   ] Got command RPT from MCS: ref #949685
2018-12-25 15:34:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 15:34:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949685  77 58477 56058305 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 15:34:18 [DEBUG   ] Got command RPT from MCS: ref #949686
2018-12-25 15:34:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 15:34:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949686  12 58477 56058509 A  ERRORB™™š'
2018-12-25 15:34:29 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-25 15:34:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 15:34:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:34:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:34:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:34:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:34:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:34:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:34:32 [DEBUG   ] Finished updating board flags in 2.175 seconds
2018-12-25 15:34:49 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-25 15:35:09 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 15:35:29 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-25 15:35:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:35:32 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 15:35:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:35:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:35:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:35:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:35:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:35:32 [DEBUG   ] Finished updating board flags in 1.991 seconds
2018-12-25 15:35:49 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-25 15:35:58 [DEBUG   ] Got command RPT from MCS: ref #949691
2018-12-25 15:35:58 [DEBUG   ] summary = ERROR
2018-12-25 15:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949691  13 58477 56158413 A  ERRORERROR'
2018-12-25 15:35:58 [DEBUG   ] Got command RPT from MCS: ref #949692
2018-12-25 15:35:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 15:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949692  77 58477 56158414 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 15:36:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 15:36:29 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 15:36:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:36:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-25 15:36:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:36:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:36:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:36:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:36:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:36:32 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-12-25 15:36:49 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-25 15:37:09 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-12-25 15:37:30 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-25 15:37:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:37:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:37:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:37:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:37:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:37:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:37:32 [DEBUG   ] Finished updating board flags in 1.787 seconds
2018-12-25 15:37:50 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-25 15:38:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 15:38:30 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 15:38:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:38:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:38:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:38:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:38:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:38:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:38:32 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-12-25 15:38:50 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 15:39:10 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-25 15:39:17 [DEBUG   ] Got command RPT from MCS: ref #949712
2018-12-25 15:39:17 [DEBUG   ] summary = ERROR
2018-12-25 15:39:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949712  13 58477 56357781 A  ERRORERROR'
2018-12-25 15:39:17 [DEBUG   ] Got command RPT from MCS: ref #949713
2018-12-25 15:39:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 15:39:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949713  77 58477 56357985 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 15:39:18 [DEBUG   ] Got command RPT from MCS: ref #949714
2018-12-25 15:39:18 [DEBUG   ] summary = ERROR
2018-12-25 15:39:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949714  13 58477 56358177 A  ERRORERROR'
2018-12-25 15:39:18 [DEBUG   ] Got command RPT from MCS: ref #949715
2018-12-25 15:39:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 15:39:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949715  77 58477 56358381 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 15:39:18 [DEBUG   ] Got command RPT from MCS: ref #949716
2018-12-25 15:39:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 15:39:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949716  12 58477 56358585 A  ERRORB˜™š'
2018-12-25 15:39:30 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 15:39:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:39:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:39:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:39:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:39:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:39:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:39:32 [DEBUG   ] Finished updating board flags in 1.610 seconds
2018-12-25 15:39:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 15:40:10 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-25 15:40:30 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-25 15:40:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:40:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:40:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:40:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:40:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:40:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:40:32 [DEBUG   ] Finished updating board flags in 1.584 seconds
2018-12-25 15:40:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 15:40:58 [DEBUG   ] Got command RPT from MCS: ref #949721
2018-12-25 15:40:58 [DEBUG   ] summary = ERROR
2018-12-25 15:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949721  13 58477 56458409 A  ERRORERROR'
2018-12-25 15:40:58 [DEBUG   ] Got command RPT from MCS: ref #949722
2018-12-25 15:40:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 15:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949722  77 58477 56458410 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 15:41:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 15:41:30 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 15:41:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:41:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:41:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:41:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:41:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:41:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:41:32 [DEBUG   ] Finished updating board flags in 1.423 seconds
2018-12-25 15:41:50 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-25 15:42:10 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-12-25 15:42:31 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-25 15:42:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:42:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:42:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:42:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:42:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:42:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:42:32 [DEBUG   ] Finished updating board flags in 1.385 seconds
2018-12-25 15:42:50 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-25 15:43:11 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-12-25 15:43:31 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-25 15:43:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:43:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:43:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:43:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:43:32 [WARNING ] (13, 1, 'bot')
2018-12-25 15:43:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:43:32 [DEBUG   ] Finished updating board flags in 1.355 seconds
2018-12-25 15:43:51 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 15:44:11 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-25 15:44:17 [DEBUG   ] Got command RPT from MCS: ref #949744
2018-12-25 15:44:17 [DEBUG   ] summary = ERROR
2018-12-25 15:44:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949744  13 58477 56657857 A  ERRORERROR'
2018-12-25 15:44:18 [DEBUG   ] Got command RPT from MCS: ref #949745
2018-12-25 15:44:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 15:44:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949745  77 58477 56658061 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 15:44:18 [DEBUG   ] Got command RPT from MCS: ref #949746
2018-12-25 15:44:18 [DEBUG   ] summary = ERROR
2018-12-25 15:44:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949746  13 58477 56658265 A  ERRORERROR'
2018-12-25 15:44:18 [DEBUG   ] Got command RPT from MCS: ref #949748
2018-12-25 15:44:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 15:44:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949748  77 58477 56658469 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 15:44:18 [DEBUG   ] Got command RPT from MCS: ref #949750
2018-12-25 15:44:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 15:44:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949750  12 58477 56658661 A  ERRORB™™š'
2018-12-25 15:44:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 15:44:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:44:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:44:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:44:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:44:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:44:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:44:33 [DEBUG   ] Finished updating board flags in 2.059 seconds
2018-12-25 15:44:51 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-25 15:45:11 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-25 15:45:31 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-25 15:45:32 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 15:45:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:45:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-25 15:45:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:45:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:45:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:45:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:45:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:45:33 [DEBUG   ] Finished updating board flags in 2.007 seconds
2018-12-25 15:45:51 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-25 15:45:58 [DEBUG   ] Got command RPT from MCS: ref #949758
2018-12-25 15:45:58 [DEBUG   ] summary = ERROR
2018-12-25 15:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949758  13 58477 56758409 A  ERRORERROR'
2018-12-25 15:45:58 [DEBUG   ] Got command RPT from MCS: ref #949759
2018-12-25 15:45:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 15:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949759  77 58477 56758410 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 15:46:11 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-25 15:46:32 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-25 15:46:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:46:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:46:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:46:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:46:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:46:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:46:33 [DEBUG   ] Finished updating board flags in 1.988 seconds
2018-12-25 15:46:52 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-25 15:47:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 15:47:32 [DEBUG   ] Finished updating ant stats in 1.250 seconds
2018-12-25 15:47:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:47:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:47:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:47:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:47:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:47:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:47:33 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-12-25 15:47:52 [DEBUG   ] Finished updating ant stats in 1.155 seconds
2018-12-25 15:48:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 15:48:32 [DEBUG   ] Finished updating ant stats in 1.047 seconds
2018-12-25 15:48:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:48:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:48:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:48:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:48:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:48:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:48:33 [DEBUG   ] Finished updating board flags in 1.794 seconds
2018-12-25 15:48:52 [DEBUG   ] Finished updating ant stats in 0.960 seconds
2018-12-25 15:49:12 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-25 15:49:17 [DEBUG   ] Got command RPT from MCS: ref #949779
2018-12-25 15:49:17 [DEBUG   ] summary = ERROR
2018-12-25 15:49:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949779  13 58477 56957945 A  ERRORERROR'
2018-12-25 15:49:18 [DEBUG   ] Got command RPT from MCS: ref #949780
2018-12-25 15:49:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 15:49:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949780  77 58477 56958149 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 15:49:18 [DEBUG   ] Got command RPT from MCS: ref #949781
2018-12-25 15:49:18 [DEBUG   ] summary = ERROR
2018-12-25 15:49:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949781  13 58477 56958341 A  ERRORERROR'
2018-12-25 15:49:18 [DEBUG   ] Got command RPT from MCS: ref #949782
2018-12-25 15:49:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 15:49:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949782  77 58477 56958545 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 15:49:18 [DEBUG   ] Got command RPT from MCS: ref #949783
2018-12-25 15:49:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 15:49:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949783  12 58477 56958749 A  ERRORB˜™š'
2018-12-25 15:49:32 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 15:49:32 [DEBUG   ] Finished updating ant stats in 0.648 seconds
2018-12-25 15:49:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:49:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:49:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:49:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:49:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:49:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:49:33 [DEBUG   ] Finished updating board flags in 1.601 seconds
2018-12-25 15:49:52 [DEBUG   ] Finished updating ant stats in 0.554 seconds
2018-12-25 15:50:12 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-25 15:50:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:50:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 15:50:33 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-12-25 15:50:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:50:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:50:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:50:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:50:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:50:33 [DEBUG   ] Finished updating board flags in 1.608 seconds
2018-12-25 15:50:53 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-25 15:50:58 [DEBUG   ] Got command RPT from MCS: ref #949784
2018-12-25 15:50:58 [DEBUG   ] summary = ERROR
2018-12-25 15:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949784  13 58477 57058413 A  ERRORERROR'
2018-12-25 15:50:58 [DEBUG   ] Got command RPT from MCS: ref #949785
2018-12-25 15:50:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 15:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949785  77 58477 57058414 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 15:51:13 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 15:51:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:51:33 [DEBUG   ] Finished updating ant stats in 1.242 seconds
2018-12-25 15:51:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:51:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:51:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:51:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:51:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:51:33 [DEBUG   ] Finished updating board flags in 1.654 seconds
2018-12-25 15:51:53 [DEBUG   ] Finished updating ant stats in 1.159 seconds
2018-12-25 15:52:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 15:52:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 15:52:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:52:33 [DEBUG   ] Finished updating ant stats in 1.044 seconds
2018-12-25 15:52:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:52:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:52:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:52:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:52:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:52:33 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-12-25 15:52:53 [DEBUG   ] Finished updating ant stats in 0.954 seconds
2018-12-25 15:53:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 15:53:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-25 15:53:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:53:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 15:53:33 [DEBUG   ] Finished updating ant stats in 0.845 seconds
2018-12-25 15:53:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:53:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:53:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:53:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:53:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:53:33 [DEBUG   ] Finished updating board flags in 1.588 seconds
2018-12-25 15:53:53 [DEBUG   ] Finished updating ant stats in 0.760 seconds
2018-12-25 15:54:13 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-25 15:54:18 [DEBUG   ] Got command RPT from MCS: ref #949807
2018-12-25 15:54:18 [DEBUG   ] summary = ERROR
2018-12-25 15:54:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949807  13 58477 57258025 A  ERRORERROR'
2018-12-25 15:54:18 [DEBUG   ] Got command RPT from MCS: ref #949808
2018-12-25 15:54:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 15:54:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949808  77 58477 57258229 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 15:54:18 [DEBUG   ] Got command RPT from MCS: ref #949809
2018-12-25 15:54:18 [DEBUG   ] summary = ERROR
2018-12-25 15:54:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949809  13 58477 57258421 A  ERRORERROR'
2018-12-25 15:54:18 [DEBUG   ] Got command RPT from MCS: ref #949811
2018-12-25 15:54:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 15:54:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949811  77 58477 57258625 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 15:54:18 [DEBUG   ] Got command RPT from MCS: ref #949812
2018-12-25 15:54:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 15:54:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949812  12 58477 57258829 A  ERRORB™™š'
2018-12-25 15:54:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:54:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:54:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:54:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:54:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:54:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:54:33 [DEBUG   ] Finished updating board flags in 1.454 seconds
2018-12-25 15:54:34 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-25 15:54:54 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-25 15:55:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 15:55:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:55:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:55:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:55:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:55:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:55:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:55:33 [DEBUG   ] Finished updating board flags in 1.450 seconds
2018-12-25 15:55:34 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 15:55:54 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 15:55:58 [DEBUG   ] Got command RPT from MCS: ref #949821
2018-12-25 15:55:58 [DEBUG   ] summary = ERROR
2018-12-25 15:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949821  13 58477 57358417 A  ERRORERROR'
2018-12-25 15:55:58 [DEBUG   ] Got command RPT from MCS: ref #949822
2018-12-25 15:55:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 15:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949822  77 58477 57358418 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 15:56:14 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-25 15:56:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:56:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:56:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:56:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:56:33 [WARNING ] (13, 1, 'bot')
2018-12-25 15:56:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:56:33 [DEBUG   ] Finished updating board flags in 1.464 seconds
2018-12-25 15:56:34 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 15:56:54 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 15:57:14 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-25 15:57:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 15:57:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:57:34 [DEBUG   ] Finished updating ant stats in 1.048 seconds
2018-12-25 15:57:34 [WARNING ] (13, 1, 'bot')
2018-12-25 15:57:34 [WARNING ] (13, 1, 'bot')
2018-12-25 15:57:34 [WARNING ] (13, 1, 'bot')
2018-12-25 15:57:34 [WARNING ] (13, 1, 'bot')
2018-12-25 15:57:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:57:34 [DEBUG   ] Finished updating board flags in 2.312 seconds
2018-12-25 15:57:54 [DEBUG   ] Finished updating ant stats in 0.950 seconds
2018-12-25 15:58:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 15:58:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:58:34 [DEBUG   ] Finished updating ant stats in 0.848 seconds
2018-12-25 15:58:34 [WARNING ] (13, 1, 'bot')
2018-12-25 15:58:34 [WARNING ] (13, 1, 'bot')
2018-12-25 15:58:34 [WARNING ] (13, 1, 'bot')
2018-12-25 15:58:34 [WARNING ] (13, 1, 'bot')
2018-12-25 15:58:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:58:34 [DEBUG   ] Finished updating board flags in 2.208 seconds
2018-12-25 15:58:54 [DEBUG   ] Finished updating ant stats in 0.750 seconds
2018-12-25 15:59:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 15:59:18 [DEBUG   ] Got command RPT from MCS: ref #949842
2018-12-25 15:59:18 [DEBUG   ] summary = ERROR
2018-12-25 15:59:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949842  13 58477 57558109 A  ERRORERROR'
2018-12-25 15:59:18 [DEBUG   ] Got command RPT from MCS: ref #949843
2018-12-25 15:59:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 15:59:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949843  77 58477 57558301 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 15:59:18 [DEBUG   ] Got command RPT from MCS: ref #949844
2018-12-25 15:59:18 [DEBUG   ] summary = ERROR
2018-12-25 15:59:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949844  13 58477 57558505 A  ERRORERROR'
2018-12-25 15:59:18 [DEBUG   ] Got command RPT from MCS: ref #949845
2018-12-25 15:59:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 15:59:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949845  77 58477 57558709 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 15:59:18 [DEBUG   ] Got command RPT from MCS: ref #949846
2018-12-25 15:59:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 15:59:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949846  12 58477 57558901 A  ERRORB˜™š'
2018-12-25 15:59:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2018-12-25 15:59:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 15:59:34 [DEBUG   ] Finished updating ant stats in 0.645 seconds
2018-12-25 15:59:34 [WARNING ] (13, 1, 'bot')
2018-12-25 15:59:34 [WARNING ] (13, 1, 'bot')
2018-12-25 15:59:34 [WARNING ] (13, 1, 'bot')
2018-12-25 15:59:34 [WARNING ] (13, 1, 'bot')
2018-12-25 15:59:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 15:59:34 [DEBUG   ] Finished updating board flags in 2.117 seconds
2018-12-25 15:59:54 [DEBUG   ] Finished updating ant stats in 0.560 seconds
2018-12-25 16:00:15 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-12-25 16:00:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:00:34 [WARNING ] (13, 1, 'bot')
2018-12-25 16:00:34 [WARNING ] (13, 1, 'bot')
2018-12-25 16:00:34 [WARNING ] (13, 1, 'bot')
2018-12-25 16:00:34 [WARNING ] (13, 1, 'bot')
2018-12-25 16:00:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:00:34 [DEBUG   ] Finished updating board flags in 2.037 seconds
2018-12-25 16:00:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 16:00:55 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-25 16:00:58 [DEBUG   ] Got command RPT from MCS: ref #949851
2018-12-25 16:00:58 [DEBUG   ] summary = ERROR
2018-12-25 16:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949851  13 58477 57658421 A  ERRORERROR'
2018-12-25 16:00:58 [DEBUG   ] Got command RPT from MCS: ref #949852
2018-12-25 16:00:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 16:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949852  77 58477 57658422 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 16:01:15 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-25 16:01:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:01:34 [WARNING ] (13, 1, 'bot')
2018-12-25 16:01:34 [WARNING ] (13, 1, 'bot')
2018-12-25 16:01:34 [WARNING ] (13, 1, 'bot')
2018-12-25 16:01:34 [WARNING ] (13, 1, 'bot')
2018-12-25 16:01:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:01:34 [DEBUG   ] Finished updating board flags in 1.963 seconds
2018-12-25 16:01:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 16:01:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 16:02:15 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 16:02:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:02:34 [WARNING ] (13, 1, 'bot')
2018-12-25 16:02:34 [WARNING ] (13, 1, 'bot')
2018-12-25 16:02:34 [WARNING ] (13, 1, 'bot')
2018-12-25 16:02:34 [WARNING ] (13, 1, 'bot')
2018-12-25 16:02:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:02:34 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-12-25 16:02:35 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-25 16:02:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 16:03:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 16:03:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 16:03:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:03:34 [WARNING ] (13, 1, 'bot')
2018-12-25 16:03:34 [WARNING ] (13, 1, 'bot')
2018-12-25 16:03:34 [WARNING ] (13, 1, 'bot')
2018-12-25 16:03:34 [WARNING ] (13, 1, 'bot')
2018-12-25 16:03:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:03:34 [DEBUG   ] Finished updating board flags in 1.795 seconds
2018-12-25 16:03:35 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 16:03:55 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-25 16:04:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 16:04:18 [DEBUG   ] Got command RPT from MCS: ref #949874
2018-12-25 16:04:18 [DEBUG   ] summary = ERROR
2018-12-25 16:04:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949874  13 58477 57858189 A  ERRORERROR'
2018-12-25 16:04:18 [DEBUG   ] Got command RPT from MCS: ref #949875
2018-12-25 16:04:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 16:04:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949875  77 58477 57858381 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 16:04:18 [DEBUG   ] Got command RPT from MCS: ref #949876
2018-12-25 16:04:18 [DEBUG   ] summary = ERROR
2018-12-25 16:04:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949876  13 58477 57858585 A  ERRORERROR'
2018-12-25 16:04:18 [DEBUG   ] Got command RPT from MCS: ref #949878
2018-12-25 16:04:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 16:04:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949878  77 58477 57858789 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 16:04:18 [DEBUG   ] Got command RPT from MCS: ref #949879
2018-12-25 16:04:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 16:04:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949879  12 58477 57858993 A  ERRORB™™š'
2018-12-25 16:04:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:04:34 [WARNING ] (13, 1, 'bot')
2018-12-25 16:04:34 [WARNING ] (13, 1, 'bot')
2018-12-25 16:04:34 [WARNING ] (13, 1, 'bot')
2018-12-25 16:04:34 [WARNING ] (13, 1, 'bot')
2018-12-25 16:04:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:04:34 [DEBUG   ] Finished updating board flags in 1.572 seconds
2018-12-25 16:04:35 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 16:04:55 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 16:05:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 16:05:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:05:34 [WARNING ] (13, 1, 'bot')
2018-12-25 16:05:34 [WARNING ] (13, 1, 'bot')
2018-12-25 16:05:34 [WARNING ] (13, 1, 'bot')
2018-12-25 16:05:34 [WARNING ] (13, 1, 'bot')
2018-12-25 16:05:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:05:34 [DEBUG   ] Finished updating board flags in 1.534 seconds
2018-12-25 16:05:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 16:05:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 16:05:58 [DEBUG   ] Got command RPT from MCS: ref #949884
2018-12-25 16:05:58 [DEBUG   ] summary = ERROR
2018-12-25 16:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949884  13 58477 57958421 A  ERRORERROR'
2018-12-25 16:05:58 [DEBUG   ] Got command RPT from MCS: ref #949885
2018-12-25 16:05:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 16:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949885  77 58477 57958422 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 16:06:15 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 16:06:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:06:34 [WARNING ] (13, 1, 'bot')
2018-12-25 16:06:34 [WARNING ] (13, 1, 'bot')
2018-12-25 16:06:34 [WARNING ] (13, 1, 'bot')
2018-12-25 16:06:34 [WARNING ] (13, 1, 'bot')
2018-12-25 16:06:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:06:34 [DEBUG   ] Finished updating board flags in 1.533 seconds
2018-12-25 16:06:35 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-25 16:06:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-25 16:07:16 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-25 16:07:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 16:07:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:07:35 [WARNING ] (13, 1, 'bot')
2018-12-25 16:07:35 [WARNING ] (13, 1, 'bot')
2018-12-25 16:07:35 [WARNING ] (13, 1, 'bot')
2018-12-25 16:07:35 [WARNING ] (13, 1, 'bot')
2018-12-25 16:07:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:07:35 [DEBUG   ] Finished updating board flags in 2.187 seconds
2018-12-25 16:07:36 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-25 16:07:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 16:08:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 16:08:34 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 16:08:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:08:35 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 16:08:35 [WARNING ] (13, 1, 'bot')
2018-12-25 16:08:35 [WARNING ] (13, 1, 'bot')
2018-12-25 16:08:35 [WARNING ] (13, 1, 'bot')
2018-12-25 16:08:35 [WARNING ] (13, 1, 'bot')
2018-12-25 16:08:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:08:35 [DEBUG   ] Finished updating board flags in 2.052 seconds
2018-12-25 16:08:36 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 16:08:56 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-25 16:09:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 16:09:18 [DEBUG   ] Got command RPT from MCS: ref #949905
2018-12-25 16:09:18 [DEBUG   ] summary = ERROR
2018-12-25 16:09:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949905  13 58477 58158265 A  ERRORERROR'
2018-12-25 16:09:18 [DEBUG   ] Got command RPT from MCS: ref #949906
2018-12-25 16:09:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 16:09:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949906  77 58477 58158469 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 16:09:18 [DEBUG   ] Got command RPT from MCS: ref #949907
2018-12-25 16:09:18 [DEBUG   ] summary = ERROR
2018-12-25 16:09:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949907  13 58477 58158661 A  ERRORERROR'
2018-12-25 16:09:18 [DEBUG   ] Got command RPT from MCS: ref #949908
2018-12-25 16:09:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 16:09:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949908  77 58477 58158865 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 16:09:19 [DEBUG   ] Got command RPT from MCS: ref #949909
2018-12-25 16:09:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 16:09:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949909  12 58477 58159069 A  ERRORB˜™š'
2018-12-25 16:09:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:09:35 [WARNING ] (13, 1, 'bot')
2018-12-25 16:09:35 [WARNING ] (13, 1, 'bot')
2018-12-25 16:09:35 [WARNING ] (13, 1, 'bot')
2018-12-25 16:09:35 [WARNING ] (13, 1, 'bot')
2018-12-25 16:09:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:09:35 [DEBUG   ] Finished updating board flags in 1.934 seconds
2018-12-25 16:09:36 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-25 16:09:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 16:10:16 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-25 16:10:34 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 16:10:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:10:35 [WARNING ] (13, 1, 'bot')
2018-12-25 16:10:35 [WARNING ] (13, 1, 'bot')
2018-12-25 16:10:35 [WARNING ] (13, 1, 'bot')
2018-12-25 16:10:35 [WARNING ] (13, 1, 'bot')
2018-12-25 16:10:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:10:35 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-12-25 16:10:36 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-25 16:10:57 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-25 16:10:58 [DEBUG   ] Got command RPT from MCS: ref #949914
2018-12-25 16:10:58 [DEBUG   ] summary = ERROR
2018-12-25 16:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949914  13 58477 58258417 A  ERRORERROR'
2018-12-25 16:10:58 [DEBUG   ] Got command RPT from MCS: ref #949915
2018-12-25 16:10:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 16:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949915  77 58477 58258418 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 16:11:17 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-12-25 16:11:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:11:35 [WARNING ] (13, 1, 'bot')
2018-12-25 16:11:35 [WARNING ] (13, 1, 'bot')
2018-12-25 16:11:35 [WARNING ] (13, 1, 'bot')
2018-12-25 16:11:35 [WARNING ] (13, 1, 'bot')
2018-12-25 16:11:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:11:35 [DEBUG   ] Finished updating board flags in 1.760 seconds
2018-12-25 16:11:37 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-25 16:11:57 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 16:12:17 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 16:12:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:12:35 [WARNING ] (13, 1, 'bot')
2018-12-25 16:12:35 [WARNING ] (13, 1, 'bot')
2018-12-25 16:12:35 [WARNING ] (13, 1, 'bot')
2018-12-25 16:12:35 [WARNING ] (13, 1, 'bot')
2018-12-25 16:12:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:12:35 [DEBUG   ] Finished updating board flags in 1.587 seconds
2018-12-25 16:12:37 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-25 16:12:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 16:13:17 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 16:13:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:13:35 [WARNING ] (13, 1, 'bot')
2018-12-25 16:13:35 [WARNING ] (13, 1, 'bot')
2018-12-25 16:13:35 [WARNING ] (13, 1, 'bot')
2018-12-25 16:13:35 [WARNING ] (13, 1, 'bot')
2018-12-25 16:13:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:13:35 [DEBUG   ] Finished updating board flags in 1.368 seconds
2018-12-25 16:13:37 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-25 16:13:57 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-25 16:14:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 16:14:18 [DEBUG   ] Got command RPT from MCS: ref #949937
2018-12-25 16:14:18 [DEBUG   ] summary = ERROR
2018-12-25 16:14:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949937  13 58477 58458349 A  ERRORERROR'
2018-12-25 16:14:18 [DEBUG   ] Got command RPT from MCS: ref #949938
2018-12-25 16:14:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 16:14:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949938  77 58477 58458541 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 16:14:18 [DEBUG   ] Got command RPT from MCS: ref #949939
2018-12-25 16:14:18 [DEBUG   ] summary = ERROR
2018-12-25 16:14:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949939  13 58477 58458745 A  ERRORERROR'
2018-12-25 16:14:18 [DEBUG   ] Got command RPT from MCS: ref #949941
2018-12-25 16:14:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 16:14:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949941  77 58477 58458949 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 16:14:19 [DEBUG   ] Got command RPT from MCS: ref #949943
2018-12-25 16:14:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 16:14:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949943  12 58477 58459153 A  ERRORB˜™š'
2018-12-25 16:14:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:14:35 [WARNING ] (13, 1, 'bot')
2018-12-25 16:14:35 [WARNING ] (13, 1, 'bot')
2018-12-25 16:14:35 [WARNING ] (13, 1, 'bot')
2018-12-25 16:14:35 [WARNING ] (13, 1, 'bot')
2018-12-25 16:14:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:14:35 [DEBUG   ] Finished updating board flags in 1.360 seconds
2018-12-25 16:14:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 16:14:57 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 16:15:17 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-25 16:15:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 16:15:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:15:36 [WARNING ] (13, 1, 'bot')
2018-12-25 16:15:36 [WARNING ] (13, 1, 'bot')
2018-12-25 16:15:36 [WARNING ] (13, 1, 'bot')
2018-12-25 16:15:36 [WARNING ] (13, 1, 'bot')
2018-12-25 16:15:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:15:36 [DEBUG   ] Finished updating board flags in 2.081 seconds
2018-12-25 16:15:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 16:15:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 16:15:58 [DEBUG   ] Got command RPT from MCS: ref #949951
2018-12-25 16:15:58 [DEBUG   ] summary = ERROR
2018-12-25 16:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949951  13 58477 58558417 A  ERRORERROR'
2018-12-25 16:15:58 [DEBUG   ] Got command RPT from MCS: ref #949952
2018-12-25 16:15:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 16:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949952  77 58477 58558418 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 16:16:17 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 16:16:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-25 16:16:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:16:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 16:16:36 [WARNING ] (13, 1, 'bot')
2018-12-25 16:16:36 [WARNING ] (13, 1, 'bot')
2018-12-25 16:16:36 [WARNING ] (13, 1, 'bot')
2018-12-25 16:16:36 [WARNING ] (13, 1, 'bot')
2018-12-25 16:16:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:16:36 [DEBUG   ] Finished updating board flags in 1.971 seconds
2018-12-25 16:16:37 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-25 16:16:57 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-25 16:17:18 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-25 16:17:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:17:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 16:17:36 [WARNING ] (13, 1, 'bot')
2018-12-25 16:17:36 [WARNING ] (13, 1, 'bot')
2018-12-25 16:17:36 [WARNING ] (13, 1, 'bot')
2018-12-25 16:17:36 [WARNING ] (13, 1, 'bot')
2018-12-25 16:17:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:17:36 [DEBUG   ] Finished updating board flags in 1.808 seconds
2018-12-25 16:17:38 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-25 16:17:58 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 16:18:18 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 16:18:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:18:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 16:18:36 [WARNING ] (13, 1, 'bot')
2018-12-25 16:18:36 [WARNING ] (13, 1, 'bot')
2018-12-25 16:18:36 [WARNING ] (13, 1, 'bot')
2018-12-25 16:18:36 [WARNING ] (13, 1, 'bot')
2018-12-25 16:18:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:18:36 [DEBUG   ] Finished updating board flags in 1.792 seconds
2018-12-25 16:18:38 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-25 16:18:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 16:19:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 16:19:18 [DEBUG   ] Got command RPT from MCS: ref #949972
2018-12-25 16:19:18 [DEBUG   ] summary = ERROR
2018-12-25 16:19:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949972  13 58477 58758425 A  ERRORERROR'
2018-12-25 16:19:18 [DEBUG   ] Got command RPT from MCS: ref #949973
2018-12-25 16:19:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 16:19:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949973  77 58477 58758629 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 16:19:18 [DEBUG   ] Got command RPT from MCS: ref #949974
2018-12-25 16:19:18 [DEBUG   ] summary = ERROR
2018-12-25 16:19:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949974  13 58477 58758833 A  ERRORERROR'
2018-12-25 16:19:19 [DEBUG   ] Got command RPT from MCS: ref #949975
2018-12-25 16:19:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 16:19:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949975  77 58477 58759025 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 16:19:19 [DEBUG   ] Got command RPT from MCS: ref #949976
2018-12-25 16:19:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 16:19:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949976  12 58477 58759229 A  ERRORB™™š'
2018-12-25 16:19:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:19:36 [WARNING ] (13, 1, 'bot')
2018-12-25 16:19:36 [WARNING ] (13, 1, 'bot')
2018-12-25 16:19:36 [WARNING ] (13, 1, 'bot')
2018-12-25 16:19:36 [WARNING ] (13, 1, 'bot')
2018-12-25 16:19:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:19:36 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-12-25 16:19:38 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 16:19:58 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-25 16:20:18 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-25 16:20:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:20:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 16:20:36 [WARNING ] (13, 1, 'bot')
2018-12-25 16:20:36 [WARNING ] (13, 1, 'bot')
2018-12-25 16:20:36 [WARNING ] (13, 1, 'bot')
2018-12-25 16:20:36 [WARNING ] (13, 1, 'bot')
2018-12-25 16:20:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:20:36 [DEBUG   ] Finished updating board flags in 1.610 seconds
2018-12-25 16:20:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 16:20:58 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-12-25 16:20:58 [DEBUG   ] Got command RPT from MCS: ref #949977
2018-12-25 16:20:58 [DEBUG   ] summary = ERROR
2018-12-25 16:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949977  13 58477 58858425 A  ERRORERROR'
2018-12-25 16:20:58 [DEBUG   ] Got command RPT from MCS: ref #949978
2018-12-25 16:20:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 16:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   949978  77 58477 58858426 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 16:21:18 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-25 16:21:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:21:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 16:21:36 [WARNING ] (13, 1, 'bot')
2018-12-25 16:21:36 [WARNING ] (13, 1, 'bot')
2018-12-25 16:21:36 [WARNING ] (13, 1, 'bot')
2018-12-25 16:21:36 [WARNING ] (13, 1, 'bot')
2018-12-25 16:21:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:21:36 [DEBUG   ] Finished updating board flags in 1.587 seconds
2018-12-25 16:21:38 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-25 16:21:58 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-25 16:22:19 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-25 16:22:35 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 16:22:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:22:36 [WARNING ] (13, 1, 'bot')
2018-12-25 16:22:36 [WARNING ] (13, 1, 'bot')
2018-12-25 16:22:36 [WARNING ] (13, 1, 'bot')
2018-12-25 16:22:36 [WARNING ] (13, 1, 'bot')
2018-12-25 16:22:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:22:36 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-12-25 16:22:39 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-25 16:22:59 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-25 16:23:19 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-25 16:23:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:23:36 [WARNING ] (13, 1, 'bot')
2018-12-25 16:23:36 [WARNING ] (13, 1, 'bot')
2018-12-25 16:23:36 [WARNING ] (13, 1, 'bot')
2018-12-25 16:23:36 [WARNING ] (13, 1, 'bot')
2018-12-25 16:23:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:23:36 [DEBUG   ] Finished updating board flags in 1.398 seconds
2018-12-25 16:23:39 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-25 16:23:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 16:24:18 [DEBUG   ] Got command RPT from MCS: ref #950000
2018-12-25 16:24:18 [DEBUG   ] summary = ERROR
2018-12-25 16:24:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950000  13 58477 59058505 A  ERRORERROR'
2018-12-25 16:24:18 [DEBUG   ] Got command RPT from MCS: ref #950001
2018-12-25 16:24:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 16:24:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950001  77 58477 59058709 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 16:24:18 [DEBUG   ] Got command RPT from MCS: ref #950002
2018-12-25 16:24:18 [DEBUG   ] summary = ERROR
2018-12-25 16:24:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950002  13 58477 59058913 A  ERRORERROR'
2018-12-25 16:24:19 [DEBUG   ] Got command RPT from MCS: ref #950004
2018-12-25 16:24:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 16:24:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950004  77 58477 59059117 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 16:24:19 [DEBUG   ] Got command RPT from MCS: ref #950005
2018-12-25 16:24:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 16:24:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950005  12 58477 59059309 A  ERRORB˜™š'
2018-12-25 16:24:19 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2018-12-25 16:24:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:24:36 [WARNING ] (13, 1, 'bot')
2018-12-25 16:24:36 [WARNING ] (13, 1, 'bot')
2018-12-25 16:24:36 [WARNING ] (13, 1, 'bot')
2018-12-25 16:24:36 [WARNING ] (13, 1, 'bot')
2018-12-25 16:24:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:24:36 [DEBUG   ] Finished updating board flags in 1.369 seconds
2018-12-25 16:24:39 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 16:24:59 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2018-12-25 16:25:19 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 16:25:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:25:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:25:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:25:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:25:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:25:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:25:37 [DEBUG   ] Finished updating board flags in 2.035 seconds
2018-12-25 16:25:39 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 16:25:58 [DEBUG   ] Got command RPT from MCS: ref #950014
2018-12-25 16:25:58 [DEBUG   ] summary = ERROR
2018-12-25 16:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950014  13 58477 59158421 A  ERRORERROR'
2018-12-25 16:25:58 [DEBUG   ] Got command RPT from MCS: ref #950015
2018-12-25 16:25:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 16:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950015  77 58477 59158422 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 16:25:59 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 16:26:19 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 16:26:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:26:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:26:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:26:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:26:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:26:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:26:37 [DEBUG   ] Finished updating board flags in 2.072 seconds
2018-12-25 16:26:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 16:26:59 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 16:27:19 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 16:27:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:27:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-12-25 16:27:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:27:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:27:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:27:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:27:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:27:37 [DEBUG   ] Finished updating board flags in 1.947 seconds
2018-12-25 16:27:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 16:27:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 16:28:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 16:28:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:28:37 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 16:28:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:28:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:28:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:28:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:28:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:28:37 [DEBUG   ] Finished updating board flags in 1.832 seconds
2018-12-25 16:28:39 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 16:28:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 16:29:18 [DEBUG   ] Got command RPT from MCS: ref #950035
2018-12-25 16:29:18 [DEBUG   ] summary = ERROR
2018-12-25 16:29:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950035  13 58477 59358589 A  ERRORERROR'
2018-12-25 16:29:18 [DEBUG   ] Got command RPT from MCS: ref #950036
2018-12-25 16:29:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 16:29:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950036  77 58477 59358797 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 16:29:18 [DEBUG   ] Got command RPT from MCS: ref #950037
2018-12-25 16:29:18 [DEBUG   ] summary = ERROR
2018-12-25 16:29:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950037  13 58477 59358985 A  ERRORERROR'
2018-12-25 16:29:19 [DEBUG   ] Got command RPT from MCS: ref #950038
2018-12-25 16:29:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 16:29:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950038  77 58477 59359197 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 16:29:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 16:29:19 [DEBUG   ] Got command RPT from MCS: ref #950039
2018-12-25 16:29:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 16:29:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950039  12 58477 59359389 A  ERRORB™™š'
2018-12-25 16:29:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-25 16:29:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:29:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:29:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:29:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:29:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:29:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:29:37 [DEBUG   ] Finished updating board flags in 1.826 seconds
2018-12-25 16:29:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 16:29:59 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 16:30:19 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2018-12-25 16:30:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:30:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 16:30:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:30:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:30:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:30:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:30:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:30:37 [DEBUG   ] Finished updating board flags in 1.808 seconds
2018-12-25 16:30:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-25 16:30:58 [DEBUG   ] Got command RPT from MCS: ref #950044
2018-12-25 16:30:58 [DEBUG   ] summary = ERROR
2018-12-25 16:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950044  13 58477 59458425 A  ERRORERROR'
2018-12-25 16:30:58 [DEBUG   ] Got command RPT from MCS: ref #950045
2018-12-25 16:30:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 16:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950045  77 58477 59458426 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 16:31:00 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-25 16:31:20 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-25 16:31:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:31:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:31:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:31:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:31:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:31:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:31:37 [DEBUG   ] Finished updating board flags in 1.733 seconds
2018-12-25 16:31:40 [DEBUG   ] Finished updating ant stats in 1.054 seconds
2018-12-25 16:32:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 16:32:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 16:32:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 16:32:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:32:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:32:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:32:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:32:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:32:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:32:37 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-12-25 16:32:40 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-25 16:33:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 16:33:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 16:33:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:33:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:33:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:33:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:33:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:33:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:33:37 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-12-25 16:33:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 16:34:00 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2018-12-25 16:34:18 [DEBUG   ] Got command RPT from MCS: ref #950067
2018-12-25 16:34:18 [DEBUG   ] summary = ERROR
2018-12-25 16:34:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950067  13 58477 59658669 A  ERRORERROR'
2018-12-25 16:34:18 [DEBUG   ] Got command RPT from MCS: ref #950068
2018-12-25 16:34:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 16:34:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950068  77 58477 59658873 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 16:34:19 [DEBUG   ] Got command RPT from MCS: ref #950069
2018-12-25 16:34:19 [DEBUG   ] summary = ERROR
2018-12-25 16:34:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950069  13 58477 59659065 A  ERRORERROR'
2018-12-25 16:34:19 [DEBUG   ] Got command RPT from MCS: ref #950071
2018-12-25 16:34:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 16:34:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950071  77 58477 59659269 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 16:34:19 [DEBUG   ] Got command RPT from MCS: ref #950072
2018-12-25 16:34:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 16:34:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950072  12 58477 59659473 A  ERRORB˜™š'
2018-12-25 16:34:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 16:34:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:34:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:34:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:34:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:34:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:34:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:34:37 [DEBUG   ] Finished updating board flags in 1.583 seconds
2018-12-25 16:34:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 16:35:00 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 16:35:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 16:35:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 16:35:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:35:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:35:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:35:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:35:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:35:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:35:37 [DEBUG   ] Finished updating board flags in 1.445 seconds
2018-12-25 16:35:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 16:35:58 [DEBUG   ] Got command RPT from MCS: ref #950077
2018-12-25 16:35:58 [DEBUG   ] summary = ERROR
2018-12-25 16:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950077  13 58477 59758425 A  ERRORERROR'
2018-12-25 16:35:58 [DEBUG   ] Got command RPT from MCS: ref #950078
2018-12-25 16:35:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 16:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950078  77 58477 59758426 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 16:36:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 16:36:20 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 16:36:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 16:36:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:36:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:36:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:36:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:36:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:36:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:36:37 [DEBUG   ] Finished updating board flags in 1.425 seconds
2018-12-25 16:36:40 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-25 16:37:00 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-25 16:37:21 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-25 16:37:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:37:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:37:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:37:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:37:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:37:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:37:37 [DEBUG   ] Finished updating board flags in 1.425 seconds
2018-12-25 16:37:41 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-25 16:38:01 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-25 16:38:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-25 16:38:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:38:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-12-25 16:38:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:38:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:38:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:38:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:38:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:38:37 [DEBUG   ] Finished updating board flags in 1.428 seconds
2018-12-25 16:38:41 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-25 16:39:01 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-25 16:39:18 [DEBUG   ] Got command RPT from MCS: ref #950098
2018-12-25 16:39:18 [DEBUG   ] summary = ERROR
2018-12-25 16:39:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950098  13 58477 59958749 A  ERRORERROR'
2018-12-25 16:39:18 [DEBUG   ] Got command RPT from MCS: ref #950099
2018-12-25 16:39:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 16:39:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950099  77 58477 59958953 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 16:39:19 [DEBUG   ] Got command RPT from MCS: ref #950100
2018-12-25 16:39:19 [DEBUG   ] summary = ERROR
2018-12-25 16:39:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950100  13 58477 59959157 A  ERRORERROR'
2018-12-25 16:39:19 [DEBUG   ] Got command RPT from MCS: ref #950101
2018-12-25 16:39:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 16:39:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950101  77 58477 59959349 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 16:39:19 [DEBUG   ] Got command RPT from MCS: ref #950102
2018-12-25 16:39:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 16:39:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950102  12 58477 59959553 A  ERRORB˜™š'
2018-12-25 16:39:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 16:39:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:39:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-12-25 16:39:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:39:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:39:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:39:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:39:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:39:37 [DEBUG   ] Finished updating board flags in 1.423 seconds
2018-12-25 16:39:41 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 16:40:01 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-12-25 16:40:21 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-25 16:40:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:40:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:40:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:40:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:40:37 [WARNING ] (13, 1, 'bot')
2018-12-25 16:40:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:40:37 [DEBUG   ] Finished updating board flags in 1.506 seconds
2018-12-25 16:40:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 16:40:58 [DEBUG   ] Got command RPT from MCS: ref #950107
2018-12-25 16:40:58 [DEBUG   ] summary = ERROR
2018-12-25 16:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950107  13 58477 60058429 A  ERRORERROR'
2018-12-25 16:40:58 [DEBUG   ] Got command RPT from MCS: ref #950108
2018-12-25 16:40:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 16:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950108  77 58477 60058430 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 16:41:01 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-12-25 16:41:21 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-25 16:41:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:41:38 [WARNING ] (13, 1, 'bot')
2018-12-25 16:41:38 [WARNING ] (13, 1, 'bot')
2018-12-25 16:41:38 [WARNING ] (13, 1, 'bot')
2018-12-25 16:41:38 [WARNING ] (13, 1, 'bot')
2018-12-25 16:41:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:41:38 [DEBUG   ] Finished updating board flags in 2.245 seconds
2018-12-25 16:41:41 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-25 16:42:01 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2018-12-25 16:42:21 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-12-25 16:42:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:42:38 [WARNING ] (13, 1, 'bot')
2018-12-25 16:42:38 [WARNING ] (13, 1, 'bot')
2018-12-25 16:42:38 [WARNING ] (13, 1, 'bot')
2018-12-25 16:42:38 [WARNING ] (13, 1, 'bot')
2018-12-25 16:42:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:42:38 [DEBUG   ] Finished updating board flags in 2.111 seconds
2018-12-25 16:42:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 16:43:02 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 16:43:22 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 16:43:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-25 16:43:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:43:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 16:43:38 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 16:43:38 [WARNING ] (13, 1, 'bot')
2018-12-25 16:43:38 [WARNING ] (13, 1, 'bot')
2018-12-25 16:43:38 [WARNING ] (13, 1, 'bot')
2018-12-25 16:43:38 [WARNING ] (13, 1, 'bot')
2018-12-25 16:43:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:43:38 [DEBUG   ] Finished updating board flags in 2.024 seconds
2018-12-25 16:43:42 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-25 16:44:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 16:44:18 [DEBUG   ] Got command RPT from MCS: ref #950130
2018-12-25 16:44:18 [DEBUG   ] summary = ERROR
2018-12-25 16:44:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950130  13 58477 60258825 A  ERRORERROR'
2018-12-25 16:44:19 [DEBUG   ] Got command RPT from MCS: ref #950131
2018-12-25 16:44:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 16:44:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950131  77 58477 60259029 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 16:44:19 [DEBUG   ] Got command RPT from MCS: ref #950132
2018-12-25 16:44:19 [DEBUG   ] summary = ERROR
2018-12-25 16:44:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950132  13 58477 60259233 A  ERRORERROR'
2018-12-25 16:44:19 [DEBUG   ] Got command RPT from MCS: ref #950134
2018-12-25 16:44:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 16:44:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950134  77 58477 60259437 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 16:44:19 [DEBUG   ] Got command RPT from MCS: ref #950135
2018-12-25 16:44:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 16:44:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950135  12 58477 60259629 A  ERRORB™™š'
2018-12-25 16:44:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 16:44:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:44:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-12-25 16:44:38 [WARNING ] (13, 1, 'bot')
2018-12-25 16:44:38 [WARNING ] (13, 1, 'bot')
2018-12-25 16:44:38 [WARNING ] (13, 1, 'bot')
2018-12-25 16:44:38 [WARNING ] (13, 1, 'bot')
2018-12-25 16:44:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:44:38 [DEBUG   ] Finished updating board flags in 1.987 seconds
2018-12-25 16:44:42 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 16:45:02 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-25 16:45:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 16:45:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 16:45:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:45:38 [WARNING ] (13, 1, 'bot')
2018-12-25 16:45:38 [WARNING ] (13, 1, 'bot')
2018-12-25 16:45:38 [WARNING ] (13, 1, 'bot')
2018-12-25 16:45:38 [WARNING ] (13, 1, 'bot')
2018-12-25 16:45:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:45:38 [DEBUG   ] Finished updating board flags in 1.821 seconds
2018-12-25 16:45:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 16:45:58 [DEBUG   ] Got command RPT from MCS: ref #950144
2018-12-25 16:45:58 [DEBUG   ] summary = ERROR
2018-12-25 16:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950144  13 58477 60358429 A  ERRORERROR'
2018-12-25 16:45:58 [DEBUG   ] Got command RPT from MCS: ref #950145
2018-12-25 16:45:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 16:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950145  77 58477 60358430 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 16:46:02 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 16:46:22 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-25 16:46:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:46:38 [WARNING ] (13, 1, 'bot')
2018-12-25 16:46:38 [WARNING ] (13, 1, 'bot')
2018-12-25 16:46:38 [WARNING ] (13, 1, 'bot')
2018-12-25 16:46:38 [WARNING ] (13, 1, 'bot')
2018-12-25 16:46:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:46:38 [DEBUG   ] Finished updating board flags in 1.791 seconds
2018-12-25 16:46:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 16:47:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 16:47:22 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-12-25 16:47:37 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 16:47:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:47:38 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 16:47:38 [WARNING ] (13, 1, 'bot')
2018-12-25 16:47:38 [WARNING ] (13, 1, 'bot')
2018-12-25 16:47:38 [WARNING ] (13, 1, 'bot')
2018-12-25 16:47:38 [WARNING ] (13, 1, 'bot')
2018-12-25 16:47:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:47:38 [DEBUG   ] Finished updating board flags in 1.630 seconds
2018-12-25 16:47:42 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-25 16:48:03 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-12-25 16:48:23 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-25 16:48:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:48:38 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 16:48:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 16:48:38 [WARNING ] (13, 1, 'bot')
2018-12-25 16:48:38 [WARNING ] (13, 1, 'bot')
2018-12-25 16:48:38 [WARNING ] (13, 1, 'bot')
2018-12-25 16:48:38 [WARNING ] (13, 1, 'bot')
2018-12-25 16:48:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:48:38 [DEBUG   ] Finished updating board flags in 1.572 seconds
2018-12-25 16:48:43 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-25 16:49:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 16:49:18 [DEBUG   ] Got command RPT from MCS: ref #950165
2018-12-25 16:49:18 [DEBUG   ] summary = ERROR
2018-12-25 16:49:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950165  13 58477 60558909 A  ERRORERROR'
2018-12-25 16:49:19 [DEBUG   ] Got command RPT from MCS: ref #950166
2018-12-25 16:49:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 16:49:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950166  77 58477 60559113 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 16:49:19 [DEBUG   ] Got command RPT from MCS: ref #950167
2018-12-25 16:49:19 [DEBUG   ] summary = ERROR
2018-12-25 16:49:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950167  13 58477 60559317 A  ERRORERROR'
2018-12-25 16:49:19 [DEBUG   ] Got command RPT from MCS: ref #950168
2018-12-25 16:49:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 16:49:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950168  77 58477 60559509 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 16:49:19 [DEBUG   ] Got command RPT from MCS: ref #950169
2018-12-25 16:49:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 16:49:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950169  12 58477 60559713 A  ERRORB˜™š'
2018-12-25 16:49:23 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 16:49:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:49:38 [WARNING ] (13, 1, 'bot')
2018-12-25 16:49:38 [WARNING ] (13, 1, 'bot')
2018-12-25 16:49:38 [WARNING ] (13, 1, 'bot')
2018-12-25 16:49:38 [WARNING ] (13, 1, 'bot')
2018-12-25 16:49:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:49:38 [DEBUG   ] Finished updating board flags in 1.412 seconds
2018-12-25 16:49:43 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-25 16:50:03 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-25 16:50:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 16:50:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:50:38 [WARNING ] (13, 1, 'bot')
2018-12-25 16:50:38 [WARNING ] (13, 1, 'bot')
2018-12-25 16:50:38 [WARNING ] (13, 1, 'bot')
2018-12-25 16:50:38 [WARNING ] (13, 1, 'bot')
2018-12-25 16:50:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:50:38 [DEBUG   ] Finished updating board flags in 1.385 seconds
2018-12-25 16:50:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 16:50:58 [DEBUG   ] Got command RPT from MCS: ref #950170
2018-12-25 16:50:58 [DEBUG   ] summary = ERROR
2018-12-25 16:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950170  13 58477 60658429 A  ERRORERROR'
2018-12-25 16:50:58 [DEBUG   ] Got command RPT from MCS: ref #950171
2018-12-25 16:50:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 16:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950171  77 58477 60658430 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 16:51:03 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 16:51:23 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-25 16:51:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:51:38 [WARNING ] (13, 1, 'bot')
2018-12-25 16:51:38 [WARNING ] (13, 1, 'bot')
2018-12-25 16:51:38 [WARNING ] (13, 1, 'bot')
2018-12-25 16:51:38 [WARNING ] (13, 1, 'bot')
2018-12-25 16:51:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:51:38 [DEBUG   ] Finished updating board flags in 1.407 seconds
2018-12-25 16:51:44 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-25 16:52:04 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-25 16:52:24 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-25 16:52:37 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 16:52:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:52:38 [WARNING ] (13, 1, 'bot')
2018-12-25 16:52:38 [WARNING ] (13, 1, 'bot')
2018-12-25 16:52:38 [WARNING ] (13, 1, 'bot')
2018-12-25 16:52:38 [WARNING ] (13, 1, 'bot')
2018-12-25 16:52:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:52:38 [DEBUG   ] Finished updating board flags in 1.331 seconds
2018-12-25 16:52:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 16:53:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 16:53:24 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 16:53:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-25 16:53:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:53:39 [WARNING ] (13, 1, 'bot')
2018-12-25 16:53:39 [WARNING ] (13, 1, 'bot')
2018-12-25 16:53:39 [WARNING ] (13, 1, 'bot')
2018-12-25 16:53:39 [WARNING ] (13, 1, 'bot')
2018-12-25 16:53:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:53:39 [DEBUG   ] Finished updating board flags in 2.083 seconds
2018-12-25 16:53:44 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-25 16:54:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 16:54:18 [DEBUG   ] Got command RPT from MCS: ref #950193
2018-12-25 16:54:18 [DEBUG   ] summary = ERROR
2018-12-25 16:54:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950193  13 58477 60858993 A  ERRORERROR'
2018-12-25 16:54:19 [DEBUG   ] Got command RPT from MCS: ref #950194
2018-12-25 16:54:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 16:54:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950194  77 58477 60859185 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 16:54:19 [DEBUG   ] Got command RPT from MCS: ref #950195
2018-12-25 16:54:19 [DEBUG   ] summary = ERROR
2018-12-25 16:54:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950195  13 58477 60859389 A  ERRORERROR'
2018-12-25 16:54:19 [DEBUG   ] Got command RPT from MCS: ref #950197
2018-12-25 16:54:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 16:54:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950197  77 58477 60859593 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 16:54:19 [DEBUG   ] Got command RPT from MCS: ref #950198
2018-12-25 16:54:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 16:54:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950198  12 58477 60859797 A  ERRORB˜™š'
2018-12-25 16:54:24 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 16:54:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:54:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 16:54:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 16:54:39 [WARNING ] (13, 1, 'bot')
2018-12-25 16:54:39 [WARNING ] (13, 1, 'bot')
2018-12-25 16:54:39 [WARNING ] (13, 1, 'bot')
2018-12-25 16:54:39 [WARNING ] (13, 1, 'bot')
2018-12-25 16:54:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:54:39 [DEBUG   ] Finished updating board flags in 1.988 seconds
2018-12-25 16:54:44 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-25 16:55:04 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-25 16:55:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 16:55:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:55:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 16:55:39 [WARNING ] (13, 1, 'bot')
2018-12-25 16:55:39 [WARNING ] (13, 1, 'bot')
2018-12-25 16:55:39 [WARNING ] (13, 1, 'bot')
2018-12-25 16:55:39 [WARNING ] (13, 1, 'bot')
2018-12-25 16:55:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:55:39 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-12-25 16:55:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 16:55:58 [DEBUG   ] Got command RPT from MCS: ref #950207
2018-12-25 16:55:58 [DEBUG   ] summary = ERROR
2018-12-25 16:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950207  13 58477 60958433 A  ERRORERROR'
2018-12-25 16:55:58 [DEBUG   ] Got command RPT from MCS: ref #950208
2018-12-25 16:55:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 16:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950208  77 58477 60958434 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 16:56:04 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 16:56:24 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-25 16:56:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:56:39 [WARNING ] (13, 1, 'bot')
2018-12-25 16:56:39 [WARNING ] (13, 1, 'bot')
2018-12-25 16:56:39 [WARNING ] (13, 1, 'bot')
2018-12-25 16:56:39 [WARNING ] (13, 1, 'bot')
2018-12-25 16:56:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:56:39 [DEBUG   ] Finished updating board flags in 1.811 seconds
2018-12-25 16:56:45 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-25 16:57:05 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-25 16:57:25 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-25 16:57:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:57:39 [WARNING ] (13, 1, 'bot')
2018-12-25 16:57:39 [WARNING ] (13, 1, 'bot')
2018-12-25 16:57:39 [WARNING ] (13, 1, 'bot')
2018-12-25 16:57:39 [WARNING ] (13, 1, 'bot')
2018-12-25 16:57:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:57:39 [DEBUG   ] Finished updating board flags in 1.787 seconds
2018-12-25 16:57:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 16:58:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 16:58:25 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-25 16:58:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:58:39 [WARNING ] (13, 1, 'bot')
2018-12-25 16:58:39 [WARNING ] (13, 1, 'bot')
2018-12-25 16:58:39 [WARNING ] (13, 1, 'bot')
2018-12-25 16:58:39 [WARNING ] (13, 1, 'bot')
2018-12-25 16:58:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:58:39 [DEBUG   ] Finished updating board flags in 1.619 seconds
2018-12-25 16:58:45 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-25 16:59:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 16:59:19 [DEBUG   ] Got command RPT from MCS: ref #950228
2018-12-25 16:59:19 [DEBUG   ] summary = ERROR
2018-12-25 16:59:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950228  13 58477 61159073 A  ERRORERROR'
2018-12-25 16:59:19 [DEBUG   ] Got command RPT from MCS: ref #950229
2018-12-25 16:59:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 16:59:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950229  77 58477 61159277 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 16:59:19 [DEBUG   ] Got command RPT from MCS: ref #950230
2018-12-25 16:59:19 [DEBUG   ] summary = ERROR
2018-12-25 16:59:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950230  13 58477 61159469 A  ERRORERROR'
2018-12-25 16:59:19 [DEBUG   ] Got command RPT from MCS: ref #950231
2018-12-25 16:59:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 16:59:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950231  77 58477 61159673 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 16:59:19 [DEBUG   ] Got command RPT from MCS: ref #950232
2018-12-25 16:59:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 16:59:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950232  12 58477 61159877 A  ERRORB™™š'
2018-12-25 16:59:25 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 16:59:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 16:59:39 [WARNING ] (13, 1, 'bot')
2018-12-25 16:59:39 [WARNING ] (13, 1, 'bot')
2018-12-25 16:59:39 [WARNING ] (13, 1, 'bot')
2018-12-25 16:59:39 [WARNING ] (13, 1, 'bot')
2018-12-25 16:59:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 16:59:39 [DEBUG   ] Finished updating board flags in 1.585 seconds
2018-12-25 16:59:45 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-25 17:00:06 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-12-25 17:00:26 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 17:00:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:00:39 [WARNING ] (13, 1, 'bot')
2018-12-25 17:00:39 [WARNING ] (13, 1, 'bot')
2018-12-25 17:00:39 [WARNING ] (13, 1, 'bot')
2018-12-25 17:00:39 [WARNING ] (13, 1, 'bot')
2018-12-25 17:00:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:00:39 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-12-25 17:00:46 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-25 17:00:58 [DEBUG   ] Got command RPT from MCS: ref #950237
2018-12-25 17:00:58 [DEBUG   ] summary = ERROR
2018-12-25 17:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950237  13 58477 61258429 A  ERRORERROR'
2018-12-25 17:00:58 [DEBUG   ] Got command RPT from MCS: ref #950238
2018-12-25 17:00:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 17:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950238  77 58477 61258430 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 17:01:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 17:01:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 17:01:38 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 17:01:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:01:39 [WARNING ] (13, 1, 'bot')
2018-12-25 17:01:39 [WARNING ] (13, 1, 'bot')
2018-12-25 17:01:39 [WARNING ] (13, 1, 'bot')
2018-12-25 17:01:39 [WARNING ] (13, 1, 'bot')
2018-12-25 17:01:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:01:39 [DEBUG   ] Finished updating board flags in 1.407 seconds
2018-12-25 17:01:46 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 17:02:06 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2018-12-25 17:02:26 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-25 17:02:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:02:39 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 17:02:39 [WARNING ] (13, 1, 'bot')
2018-12-25 17:02:39 [WARNING ] (13, 1, 'bot')
2018-12-25 17:02:39 [WARNING ] (13, 1, 'bot')
2018-12-25 17:02:39 [WARNING ] (13, 1, 'bot')
2018-12-25 17:02:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:02:39 [DEBUG   ] Finished updating board flags in 1.388 seconds
2018-12-25 17:02:46 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-25 17:03:06 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 17:03:26 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-25 17:03:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:03:39 [WARNING ] (13, 1, 'bot')
2018-12-25 17:03:39 [WARNING ] (13, 1, 'bot')
2018-12-25 17:03:39 [WARNING ] (13, 1, 'bot')
2018-12-25 17:03:39 [WARNING ] (13, 1, 'bot')
2018-12-25 17:03:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:03:39 [DEBUG   ] Finished updating board flags in 1.359 seconds
2018-12-25 17:03:47 [DEBUG   ] Finished updating ant stats in 1.390 seconds
2018-12-25 17:04:07 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-25 17:04:19 [DEBUG   ] Got command RPT from MCS: ref #950260
2018-12-25 17:04:19 [DEBUG   ] summary = ERROR
2018-12-25 17:04:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950260  13 58477 61459161 A  ERRORERROR'
2018-12-25 17:04:19 [DEBUG   ] Got command RPT from MCS: ref #950261
2018-12-25 17:04:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 17:04:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950261  77 58477 61459353 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 17:04:19 [DEBUG   ] Got command RPT from MCS: ref #950262
2018-12-25 17:04:19 [DEBUG   ] summary = ERROR
2018-12-25 17:04:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950262  13 58477 61459557 A  ERRORERROR'
2018-12-25 17:04:19 [DEBUG   ] Got command RPT from MCS: ref #950264
2018-12-25 17:04:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 17:04:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950264  77 58477 61459761 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 17:04:19 [DEBUG   ] Got command RPT from MCS: ref #950266
2018-12-25 17:04:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 17:04:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950266  12 58477 61459953 A  ERRORB˜™š'
2018-12-25 17:04:27 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-25 17:04:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:04:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 17:04:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 17:04:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:04:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:04:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:04:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:04:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:04:40 [DEBUG   ] Finished updating board flags in 2.061 seconds
2018-12-25 17:04:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 17:05:07 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 17:05:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 17:05:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-25 17:05:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:05:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:05:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:05:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:05:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:05:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:05:40 [DEBUG   ] Finished updating board flags in 1.985 seconds
2018-12-25 17:05:47 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-25 17:05:58 [DEBUG   ] Got command RPT from MCS: ref #950270
2018-12-25 17:05:58 [DEBUG   ] summary = ERROR
2018-12-25 17:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950270  13 58477 61558425 A  ERRORERROR'
2018-12-25 17:05:58 [DEBUG   ] Got command RPT from MCS: ref #950271
2018-12-25 17:05:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 17:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950271  77 58477 61558426 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 17:06:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 17:06:27 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 17:06:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:06:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:06:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:06:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:06:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:06:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:06:40 [DEBUG   ] Finished updating board flags in 1.810 seconds
2018-12-25 17:06:47 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-25 17:07:07 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-25 17:07:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 17:07:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:07:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:07:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:07:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:07:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:07:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:07:40 [DEBUG   ] Finished updating board flags in 1.808 seconds
2018-12-25 17:07:47 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 17:08:07 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 17:08:27 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-25 17:08:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:08:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-12-25 17:08:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:08:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:08:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:08:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:08:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:08:40 [DEBUG   ] Finished updating board flags in 1.848 seconds
2018-12-25 17:08:48 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-25 17:09:08 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-25 17:09:19 [DEBUG   ] Got command RPT from MCS: ref #950291
2018-12-25 17:09:19 [DEBUG   ] summary = ERROR
2018-12-25 17:09:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950291  13 58477 61759237 A  ERRORERROR'
2018-12-25 17:09:19 [DEBUG   ] Got command RPT from MCS: ref #950292
2018-12-25 17:09:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 17:09:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950292  77 58477 61759441 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 17:09:19 [DEBUG   ] Got command RPT from MCS: ref #950293
2018-12-25 17:09:19 [DEBUG   ] summary = ERROR
2018-12-25 17:09:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950293  13 58477 61759633 A  ERRORERROR'
2018-12-25 17:09:19 [DEBUG   ] Got command RPT from MCS: ref #950294
2018-12-25 17:09:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 17:09:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950294  77 58477 61759837 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 17:09:20 [DEBUG   ] Got command RPT from MCS: ref #950295
2018-12-25 17:09:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 17:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950295  12 58477 61760041 A  ERRORB™™š'
2018-12-25 17:09:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 17:09:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:09:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:09:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:09:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:09:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:09:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:09:40 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-12-25 17:09:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 17:10:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 17:10:28 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 17:10:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:10:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-25 17:10:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:10:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:10:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:10:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:10:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:10:40 [DEBUG   ] Finished updating board flags in 1.758 seconds
2018-12-25 17:10:48 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-25 17:10:58 [DEBUG   ] Got command RPT from MCS: ref #950300
2018-12-25 17:10:58 [DEBUG   ] summary = ERROR
2018-12-25 17:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950300  13 58477 61858425 A  ERRORERROR'
2018-12-25 17:10:58 [DEBUG   ] Got command RPT from MCS: ref #950301
2018-12-25 17:10:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 17:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950301  77 58477 61858426 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 17:11:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 17:11:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 17:11:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:11:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-25 17:11:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:11:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:11:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:11:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:11:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:11:40 [DEBUG   ] Finished updating board flags in 1.625 seconds
2018-12-25 17:11:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 17:12:08 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-25 17:12:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 17:12:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:12:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:12:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:12:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:12:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:12:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:12:40 [DEBUG   ] Finished updating board flags in 1.543 seconds
2018-12-25 17:12:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 17:13:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 17:13:28 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-25 17:13:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:13:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:13:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:13:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:13:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:13:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:13:40 [DEBUG   ] Finished updating board flags in 1.436 seconds
2018-12-25 17:13:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 17:14:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 17:14:19 [DEBUG   ] Got command RPT from MCS: ref #950323
2018-12-25 17:14:19 [DEBUG   ] summary = ERROR
2018-12-25 17:14:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950323  13 58477 62059317 A  ERRORERROR'
2018-12-25 17:14:19 [DEBUG   ] Got command RPT from MCS: ref #950324
2018-12-25 17:14:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 17:14:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950324  77 58477 62059521 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 17:14:19 [DEBUG   ] Got command RPT from MCS: ref #950325
2018-12-25 17:14:19 [DEBUG   ] summary = ERROR
2018-12-25 17:14:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950325  13 58477 62059713 A  ERRORERROR'
2018-12-25 17:14:19 [DEBUG   ] Got command RPT from MCS: ref #950327
2018-12-25 17:14:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 17:14:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950327  77 58477 62059932 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 17:14:20 [DEBUG   ] Got command RPT from MCS: ref #950329
2018-12-25 17:14:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 17:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950329  12 58477 62060121 A  ERRORB™™š'
2018-12-25 17:14:28 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 17:14:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:14:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:14:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:14:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:14:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:14:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:14:40 [DEBUG   ] Finished updating board flags in 1.443 seconds
2018-12-25 17:14:48 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-25 17:15:08 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-25 17:15:29 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-25 17:15:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:15:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:15:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:15:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:15:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:15:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:15:40 [DEBUG   ] Finished updating board flags in 1.434 seconds
2018-12-25 17:15:49 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-25 17:15:58 [DEBUG   ] Got command RPT from MCS: ref #950337
2018-12-25 17:15:58 [DEBUG   ] summary = ERROR
2018-12-25 17:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950337  13 58477 62158433 A  ERRORERROR'
2018-12-25 17:15:58 [DEBUG   ] Got command RPT from MCS: ref #950338
2018-12-25 17:15:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 17:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950338  77 58477 62158434 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 17:16:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 17:16:29 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 17:16:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:16:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-25 17:16:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:16:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:16:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:16:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:16:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:16:40 [DEBUG   ] Finished updating board flags in 1.436 seconds
2018-12-25 17:16:49 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-25 17:17:09 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-25 17:17:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 17:17:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:17:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:17:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:17:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:17:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:17:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:17:40 [DEBUG   ] Finished updating board flags in 1.437 seconds
2018-12-25 17:17:49 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-12-25 17:18:09 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-25 17:18:29 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-25 17:18:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:18:40 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 17:18:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:18:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:18:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:18:40 [WARNING ] (13, 1, 'bot')
2018-12-25 17:18:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:18:40 [DEBUG   ] Finished updating board flags in 1.451 seconds
2018-12-25 17:18:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 17:19:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 17:19:19 [DEBUG   ] Got command RPT from MCS: ref #950358
2018-12-25 17:19:19 [DEBUG   ] summary = ERROR
2018-12-25 17:19:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950358  13 58477 62359401 A  ERRORERROR'
2018-12-25 17:19:19 [DEBUG   ] Got command RPT from MCS: ref #950359
2018-12-25 17:19:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 17:19:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950359  77 58477 62359605 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 17:19:19 [DEBUG   ] Got command RPT from MCS: ref #950360
2018-12-25 17:19:19 [DEBUG   ] summary = ERROR
2018-12-25 17:19:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950360  13 58477 62359801 A  ERRORERROR'
2018-12-25 17:19:20 [DEBUG   ] Got command RPT from MCS: ref #950361
2018-12-25 17:19:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 17:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950361  77 58477 62360005 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 17:19:20 [DEBUG   ] Got command RPT from MCS: ref #950362
2018-12-25 17:19:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 17:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950362  12 58477 62360197 A  ERRORB˜™š'
2018-12-25 17:19:29 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-25 17:19:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:19:41 [WARNING ] (13, 1, 'bot')
2018-12-25 17:19:41 [WARNING ] (13, 1, 'bot')
2018-12-25 17:19:41 [WARNING ] (13, 1, 'bot')
2018-12-25 17:19:41 [WARNING ] (13, 1, 'bot')
2018-12-25 17:19:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:19:41 [DEBUG   ] Finished updating board flags in 2.199 seconds
2018-12-25 17:19:49 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2018-12-25 17:20:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 17:20:29 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-12-25 17:20:40 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 17:20:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:20:41 [WARNING ] (13, 1, 'bot')
2018-12-25 17:20:41 [WARNING ] (13, 1, 'bot')
2018-12-25 17:20:41 [WARNING ] (13, 1, 'bot')
2018-12-25 17:20:41 [WARNING ] (13, 1, 'bot')
2018-12-25 17:20:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:20:41 [DEBUG   ] Finished updating board flags in 1.979 seconds
2018-12-25 17:20:49 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2018-12-25 17:20:58 [DEBUG   ] Got command RPT from MCS: ref #950363
2018-12-25 17:20:58 [DEBUG   ] summary = ERROR
2018-12-25 17:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950363  13 58477 62458429 A  ERRORERROR'
2018-12-25 17:20:58 [DEBUG   ] Got command RPT from MCS: ref #950364
2018-12-25 17:20:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 17:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950364  77 58477 62458430 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 17:21:09 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-12-25 17:21:30 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-25 17:21:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:21:41 [WARNING ] (13, 1, 'bot')
2018-12-25 17:21:41 [WARNING ] (13, 1, 'bot')
2018-12-25 17:21:41 [WARNING ] (13, 1, 'bot')
2018-12-25 17:21:41 [WARNING ] (13, 1, 'bot')
2018-12-25 17:21:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:21:41 [DEBUG   ] Finished updating board flags in 1.821 seconds
2018-12-25 17:21:50 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-25 17:22:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 17:22:30 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 17:22:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:22:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 17:22:41 [WARNING ] (13, 1, 'bot')
2018-12-25 17:22:41 [WARNING ] (13, 1, 'bot')
2018-12-25 17:22:41 [WARNING ] (13, 1, 'bot')
2018-12-25 17:22:41 [WARNING ] (13, 1, 'bot')
2018-12-25 17:22:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:22:41 [DEBUG   ] Finished updating board flags in 1.779 seconds
2018-12-25 17:22:50 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 17:23:10 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-25 17:23:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 17:23:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:23:41 [WARNING ] (13, 1, 'bot')
2018-12-25 17:23:41 [WARNING ] (13, 1, 'bot')
2018-12-25 17:23:41 [WARNING ] (13, 1, 'bot')
2018-12-25 17:23:41 [WARNING ] (13, 1, 'bot')
2018-12-25 17:23:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:23:41 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-12-25 17:23:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 17:24:10 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 17:24:19 [DEBUG   ] Got command RPT from MCS: ref #950386
2018-12-25 17:24:19 [DEBUG   ] summary = ERROR
2018-12-25 17:24:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950386  13 58477 62659481 A  ERRORERROR'
2018-12-25 17:24:19 [DEBUG   ] Got command RPT from MCS: ref #950387
2018-12-25 17:24:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 17:24:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950387  77 58477 62659685 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 17:24:19 [DEBUG   ] Got command RPT from MCS: ref #950388
2018-12-25 17:24:19 [DEBUG   ] summary = ERROR
2018-12-25 17:24:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950388  13 58477 62659877 A  ERRORERROR'
2018-12-25 17:24:20 [DEBUG   ] Got command RPT from MCS: ref #950390
2018-12-25 17:24:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 17:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950390  77 58477 62660081 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 17:24:20 [DEBUG   ] Got command RPT from MCS: ref #950391
2018-12-25 17:24:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 17:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950391  12 58477 62660286 A  ERRORB˜™š'
2018-12-25 17:24:30 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-25 17:24:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 17:24:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:24:41 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 17:24:41 [WARNING ] (13, 1, 'bot')
2018-12-25 17:24:41 [WARNING ] (13, 1, 'bot')
2018-12-25 17:24:41 [WARNING ] (13, 1, 'bot')
2018-12-25 17:24:41 [WARNING ] (13, 1, 'bot')
2018-12-25 17:24:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:24:41 [DEBUG   ] Finished updating board flags in 1.598 seconds
2018-12-25 17:24:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 17:25:10 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 17:25:30 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 17:25:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:25:41 [WARNING ] (13, 1, 'bot')
2018-12-25 17:25:41 [WARNING ] (13, 1, 'bot')
2018-12-25 17:25:41 [WARNING ] (13, 1, 'bot')
2018-12-25 17:25:41 [WARNING ] (13, 1, 'bot')
2018-12-25 17:25:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:25:41 [DEBUG   ] Finished updating board flags in 1.420 seconds
2018-12-25 17:25:50 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-25 17:25:58 [DEBUG   ] Got command RPT from MCS: ref #950400
2018-12-25 17:25:58 [DEBUG   ] summary = ERROR
2018-12-25 17:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950400  13 58477 62758437 A  ERRORERROR'
2018-12-25 17:25:58 [DEBUG   ] Got command RPT from MCS: ref #950401
2018-12-25 17:25:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 17:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950401  77 58477 62758438 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 17:26:10 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-25 17:26:30 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-25 17:26:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:26:41 [WARNING ] (13, 1, 'bot')
2018-12-25 17:26:41 [WARNING ] (13, 1, 'bot')
2018-12-25 17:26:41 [WARNING ] (13, 1, 'bot')
2018-12-25 17:26:41 [WARNING ] (13, 1, 'bot')
2018-12-25 17:26:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:26:41 [DEBUG   ] Finished updating board flags in 1.379 seconds
2018-12-25 17:26:51 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-25 17:27:11 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-25 17:27:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 17:27:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 17:27:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:27:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-25 17:27:41 [WARNING ] (13, 1, 'bot')
2018-12-25 17:27:41 [WARNING ] (13, 1, 'bot')
2018-12-25 17:27:41 [WARNING ] (13, 1, 'bot')
2018-12-25 17:27:41 [WARNING ] (13, 1, 'bot')
2018-12-25 17:27:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:27:41 [DEBUG   ] Finished updating board flags in 1.359 seconds
2018-12-25 17:27:51 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 17:28:11 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-25 17:28:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 17:28:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:28:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 17:28:42 [WARNING ] (13, 1, 'bot')
2018-12-25 17:28:42 [WARNING ] (13, 1, 'bot')
2018-12-25 17:28:42 [WARNING ] (13, 1, 'bot')
2018-12-25 17:28:42 [WARNING ] (13, 1, 'bot')
2018-12-25 17:28:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:28:42 [DEBUG   ] Finished updating board flags in 2.064 seconds
2018-12-25 17:28:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 17:29:11 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-25 17:29:19 [DEBUG   ] Got command RPT from MCS: ref #950421
2018-12-25 17:29:19 [DEBUG   ] summary = ERROR
2018-12-25 17:29:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950421  13 58477 62959553 A  ERRORERROR'
2018-12-25 17:29:19 [DEBUG   ] Got command RPT from MCS: ref #950422
2018-12-25 17:29:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 17:29:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950422  77 58477 62959757 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 17:29:19 [DEBUG   ] Got command RPT from MCS: ref #950423
2018-12-25 17:29:19 [DEBUG   ] summary = ERROR
2018-12-25 17:29:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950423  13 58477 62959961 A  ERRORERROR'
2018-12-25 17:29:20 [DEBUG   ] Got command RPT from MCS: ref #950424
2018-12-25 17:29:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 17:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950424  77 58477 62960165 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 17:29:20 [DEBUG   ] Got command RPT from MCS: ref #950425
2018-12-25 17:29:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 17:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950425  12 58477 62960357 A  ERRORB™™š'
2018-12-25 17:29:31 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-25 17:29:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:29:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-25 17:29:42 [WARNING ] (13, 1, 'bot')
2018-12-25 17:29:42 [WARNING ] (13, 1, 'bot')
2018-12-25 17:29:42 [WARNING ] (13, 1, 'bot')
2018-12-25 17:29:42 [WARNING ] (13, 1, 'bot')
2018-12-25 17:29:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:29:42 [DEBUG   ] Finished updating board flags in 1.985 seconds
2018-12-25 17:29:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 17:30:11 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 17:30:31 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-12-25 17:30:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:30:42 [WARNING ] (13, 1, 'bot')
2018-12-25 17:30:42 [WARNING ] (13, 1, 'bot')
2018-12-25 17:30:42 [WARNING ] (13, 1, 'bot')
2018-12-25 17:30:42 [WARNING ] (13, 1, 'bot')
2018-12-25 17:30:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:30:42 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-12-25 17:30:51 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-25 17:30:58 [DEBUG   ] Got command RPT from MCS: ref #950430
2018-12-25 17:30:58 [DEBUG   ] summary = ERROR
2018-12-25 17:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950430  13 58477 63058433 A  ERRORERROR'
2018-12-25 17:30:58 [DEBUG   ] Got command RPT from MCS: ref #950431
2018-12-25 17:30:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 17:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950431  77 58477 63058434 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 17:31:11 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-25 17:31:31 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-25 17:31:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:31:42 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 17:31:42 [WARNING ] (13, 1, 'bot')
2018-12-25 17:31:42 [WARNING ] (13, 1, 'bot')
2018-12-25 17:31:42 [WARNING ] (13, 1, 'bot')
2018-12-25 17:31:42 [WARNING ] (13, 1, 'bot')
2018-12-25 17:31:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:31:42 [DEBUG   ] Finished updating board flags in 1.789 seconds
2018-12-25 17:31:52 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-25 17:32:12 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-25 17:32:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 17:32:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:32:42 [WARNING ] (13, 1, 'bot')
2018-12-25 17:32:42 [WARNING ] (13, 1, 'bot')
2018-12-25 17:32:42 [WARNING ] (13, 1, 'bot')
2018-12-25 17:32:42 [WARNING ] (13, 1, 'bot')
2018-12-25 17:32:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:32:42 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-12-25 17:32:52 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 17:33:12 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-25 17:33:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 17:33:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:33:42 [WARNING ] (13, 1, 'bot')
2018-12-25 17:33:42 [WARNING ] (13, 1, 'bot')
2018-12-25 17:33:42 [WARNING ] (13, 1, 'bot')
2018-12-25 17:33:42 [WARNING ] (13, 1, 'bot')
2018-12-25 17:33:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:33:42 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-12-25 17:33:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 17:34:12 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-12-25 17:34:19 [DEBUG   ] Got command RPT from MCS: ref #950453
2018-12-25 17:34:19 [DEBUG   ] summary = ERROR
2018-12-25 17:34:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950453  13 58477 63259641 A  ERRORERROR'
2018-12-25 17:34:19 [DEBUG   ] Got command RPT from MCS: ref #950454
2018-12-25 17:34:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 17:34:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950454  77 58477 63259833 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 17:34:20 [DEBUG   ] Got command RPT from MCS: ref #950455
2018-12-25 17:34:20 [DEBUG   ] summary = ERROR
2018-12-25 17:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950455  13 58477 63260037 A  ERRORERROR'
2018-12-25 17:34:20 [DEBUG   ] Got command RPT from MCS: ref #950457
2018-12-25 17:34:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 17:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950457  77 58477 63260241 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 17:34:20 [DEBUG   ] Got command RPT from MCS: ref #950458
2018-12-25 17:34:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 17:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950458  12 58477 63260445 A  ERRORB™™š'
2018-12-25 17:34:32 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-25 17:34:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:34:42 [WARNING ] (13, 1, 'bot')
2018-12-25 17:34:42 [WARNING ] (13, 1, 'bot')
2018-12-25 17:34:42 [WARNING ] (13, 1, 'bot')
2018-12-25 17:34:42 [WARNING ] (13, 1, 'bot')
2018-12-25 17:34:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:34:42 [DEBUG   ] Finished updating board flags in 1.577 seconds
2018-12-25 17:34:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 17:35:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 17:35:32 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-12-25 17:35:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:35:42 [WARNING ] (13, 1, 'bot')
2018-12-25 17:35:42 [WARNING ] (13, 1, 'bot')
2018-12-25 17:35:42 [WARNING ] (13, 1, 'bot')
2018-12-25 17:35:42 [WARNING ] (13, 1, 'bot')
2018-12-25 17:35:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:35:42 [DEBUG   ] Finished updating board flags in 1.435 seconds
2018-12-25 17:35:52 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-25 17:35:58 [DEBUG   ] Got command RPT from MCS: ref #950463
2018-12-25 17:35:58 [DEBUG   ] summary = ERROR
2018-12-25 17:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950463  13 58477 63358429 A  ERRORERROR'
2018-12-25 17:35:58 [DEBUG   ] Got command RPT from MCS: ref #950464
2018-12-25 17:35:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 17:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950464  77 58477 63358430 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 17:36:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 17:36:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 17:36:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:36:42 [WARNING ] (13, 1, 'bot')
2018-12-25 17:36:42 [WARNING ] (13, 1, 'bot')
2018-12-25 17:36:42 [WARNING ] (13, 1, 'bot')
2018-12-25 17:36:42 [WARNING ] (13, 1, 'bot')
2018-12-25 17:36:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:36:42 [DEBUG   ] Finished updating board flags in 1.376 seconds
2018-12-25 17:36:52 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 17:37:12 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-25 17:37:32 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-25 17:37:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:37:43 [WARNING ] (13, 1, 'bot')
2018-12-25 17:37:43 [WARNING ] (13, 1, 'bot')
2018-12-25 17:37:43 [WARNING ] (13, 1, 'bot')
2018-12-25 17:37:43 [WARNING ] (13, 1, 'bot')
2018-12-25 17:37:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:37:43 [DEBUG   ] Finished updating board flags in 2.211 seconds
2018-12-25 17:37:52 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-25 17:38:13 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-25 17:38:33 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-25 17:38:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:38:43 [WARNING ] (13, 1, 'bot')
2018-12-25 17:38:43 [WARNING ] (13, 1, 'bot')
2018-12-25 17:38:43 [WARNING ] (13, 1, 'bot')
2018-12-25 17:38:43 [WARNING ] (13, 1, 'bot')
2018-12-25 17:38:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:38:43 [DEBUG   ] Finished updating board flags in 2.186 seconds
2018-12-25 17:38:53 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 17:39:13 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-25 17:39:19 [DEBUG   ] Got command RPT from MCS: ref #950484
2018-12-25 17:39:19 [DEBUG   ] summary = ERROR
2018-12-25 17:39:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950484  13 58477 63559713 A  ERRORERROR'
2018-12-25 17:39:19 [DEBUG   ] Got command RPT from MCS: ref #950485
2018-12-25 17:39:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 17:39:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950485  77 58477 63559924 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 17:39:20 [DEBUG   ] Got command RPT from MCS: ref #950486
2018-12-25 17:39:20 [DEBUG   ] summary = ERROR
2018-12-25 17:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950486  13 58477 63560113 A  ERRORERROR'
2018-12-25 17:39:20 [DEBUG   ] Got command RPT from MCS: ref #950487
2018-12-25 17:39:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 17:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950487  77 58477 63560317 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 17:39:20 [DEBUG   ] Got command RPT from MCS: ref #950488
2018-12-25 17:39:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 17:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950488  12 58477 63560521 A  ERRORB˜™š'
2018-12-25 17:39:33 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-12-25 17:39:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:39:43 [WARNING ] (13, 1, 'bot')
2018-12-25 17:39:43 [WARNING ] (13, 1, 'bot')
2018-12-25 17:39:43 [WARNING ] (13, 1, 'bot')
2018-12-25 17:39:43 [WARNING ] (13, 1, 'bot')
2018-12-25 17:39:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:39:43 [DEBUG   ] Finished updating board flags in 2.019 seconds
2018-12-25 17:39:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 17:40:13 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 17:40:33 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-25 17:40:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:40:43 [WARNING ] (13, 1, 'bot')
2018-12-25 17:40:43 [WARNING ] (13, 1, 'bot')
2018-12-25 17:40:43 [WARNING ] (13, 1, 'bot')
2018-12-25 17:40:43 [WARNING ] (13, 1, 'bot')
2018-12-25 17:40:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:40:43 [DEBUG   ] Finished updating board flags in 1.980 seconds
2018-12-25 17:40:53 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-25 17:40:58 [DEBUG   ] Got command RPT from MCS: ref #950493
2018-12-25 17:40:58 [DEBUG   ] summary = ERROR
2018-12-25 17:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950493  13 58477 63658437 A  ERRORERROR'
2018-12-25 17:40:58 [DEBUG   ] Got command RPT from MCS: ref #950494
2018-12-25 17:40:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 17:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950494  77 58477 63658438 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 17:41:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 17:41:33 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 17:41:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:41:43 [WARNING ] (13, 1, 'bot')
2018-12-25 17:41:43 [WARNING ] (13, 1, 'bot')
2018-12-25 17:41:43 [WARNING ] (13, 1, 'bot')
2018-12-25 17:41:43 [WARNING ] (13, 1, 'bot')
2018-12-25 17:41:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:41:43 [DEBUG   ] Finished updating board flags in 1.822 seconds
2018-12-25 17:41:53 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 17:42:13 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-25 17:42:34 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-25 17:42:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:42:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-25 17:42:43 [WARNING ] (13, 1, 'bot')
2018-12-25 17:42:43 [WARNING ] (13, 1, 'bot')
2018-12-25 17:42:43 [WARNING ] (13, 1, 'bot')
2018-12-25 17:42:43 [WARNING ] (13, 1, 'bot')
2018-12-25 17:42:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:42:43 [DEBUG   ] Finished updating board flags in 1.782 seconds
2018-12-25 17:42:54 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-25 17:43:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 17:43:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 17:43:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:43:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-12-25 17:43:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-25 17:43:43 [WARNING ] (13, 1, 'bot')
2018-12-25 17:43:43 [WARNING ] (13, 1, 'bot')
2018-12-25 17:43:43 [WARNING ] (13, 1, 'bot')
2018-12-25 17:43:43 [WARNING ] (13, 1, 'bot')
2018-12-25 17:43:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:43:43 [DEBUG   ] Finished updating board flags in 1.619 seconds
2018-12-25 17:43:54 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 17:44:14 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-25 17:44:19 [DEBUG   ] Got command RPT from MCS: ref #950516
2018-12-25 17:44:19 [DEBUG   ] summary = ERROR
2018-12-25 17:44:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950516  13 58477 63859801 A  ERRORERROR'
2018-12-25 17:44:19 [DEBUG   ] Got command RPT from MCS: ref #950517
2018-12-25 17:44:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 17:44:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950517  77 58477 63859993 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 17:44:20 [DEBUG   ] Got command RPT from MCS: ref #950518
2018-12-25 17:44:20 [DEBUG   ] summary = ERROR
2018-12-25 17:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950518  13 58477 63860197 A  ERRORERROR'
2018-12-25 17:44:20 [DEBUG   ] Got command RPT from MCS: ref #950520
2018-12-25 17:44:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 17:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950520  77 58477 63860401 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 17:44:20 [DEBUG   ] Got command RPT from MCS: ref #950521
2018-12-25 17:44:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 17:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950521  12 58477 63860605 A  ERRORBš™š'
2018-12-25 17:44:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 17:44:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:44:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-12-25 17:44:43 [WARNING ] (13, 1, 'bot')
2018-12-25 17:44:43 [WARNING ] (13, 1, 'bot')
2018-12-25 17:44:43 [WARNING ] (13, 1, 'bot')
2018-12-25 17:44:43 [WARNING ] (13, 1, 'bot')
2018-12-25 17:44:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:44:43 [DEBUG   ] Finished updating board flags in 1.586 seconds
2018-12-25 17:44:54 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 17:45:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 17:45:34 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-25 17:45:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:45:43 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 17:45:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 17:45:43 [WARNING ] (13, 1, 'bot')
2018-12-25 17:45:43 [WARNING ] (13, 1, 'bot')
2018-12-25 17:45:43 [WARNING ] (13, 1, 'bot')
2018-12-25 17:45:43 [WARNING ] (13, 1, 'bot')
2018-12-25 17:45:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:45:43 [DEBUG   ] Finished updating board flags in 1.503 seconds
2018-12-25 17:45:54 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-25 17:45:58 [DEBUG   ] Got command RPT from MCS: ref #950530
2018-12-25 17:45:58 [DEBUG   ] summary = ERROR
2018-12-25 17:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950530  13 58477 63958437 A  ERRORERROR'
2018-12-25 17:45:58 [DEBUG   ] Got command RPT from MCS: ref #950531
2018-12-25 17:45:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 17:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950531  77 58477 63958438 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 17:46:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 17:46:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 17:46:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 17:46:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:46:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 17:46:43 [WARNING ] (13, 1, 'bot')
2018-12-25 17:46:43 [WARNING ] (13, 1, 'bot')
2018-12-25 17:46:43 [WARNING ] (13, 1, 'bot')
2018-12-25 17:46:43 [WARNING ] (13, 1, 'bot')
2018-12-25 17:46:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:46:43 [DEBUG   ] Finished updating board flags in 1.482 seconds
2018-12-25 17:46:54 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-25 17:47:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 17:47:34 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 17:47:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:47:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 17:47:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-25 17:47:43 [WARNING ] (13, 1, 'bot')
2018-12-25 17:47:43 [WARNING ] (13, 1, 'bot')
2018-12-25 17:47:43 [WARNING ] (13, 1, 'bot')
2018-12-25 17:47:43 [WARNING ] (13, 1, 'bot')
2018-12-25 17:47:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:47:43 [DEBUG   ] Finished updating board flags in 1.484 seconds
2018-12-25 17:47:54 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-25 17:48:15 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-12-25 17:48:35 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-25 17:48:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:48:44 [WARNING ] (13, 1, 'bot')
2018-12-25 17:48:44 [WARNING ] (13, 1, 'bot')
2018-12-25 17:48:44 [WARNING ] (13, 1, 'bot')
2018-12-25 17:48:44 [WARNING ] (13, 1, 'bot')
2018-12-25 17:48:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:48:44 [DEBUG   ] Finished updating board flags in 2.231 seconds
2018-12-25 17:48:55 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 17:49:15 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-25 17:49:19 [DEBUG   ] Got command RPT from MCS: ref #950551
2018-12-25 17:49:19 [DEBUG   ] summary = ERROR
2018-12-25 17:49:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950551  13 58477 64159881 A  ERRORERROR'
2018-12-25 17:49:20 [DEBUG   ] Got command RPT from MCS: ref #950552
2018-12-25 17:49:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 17:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950552  77 58477 64160073 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 17:49:20 [DEBUG   ] Got command RPT from MCS: ref #950553
2018-12-25 17:49:20 [DEBUG   ] summary = ERROR
2018-12-25 17:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950553  13 58477 64160277 A  ERRORERROR'
2018-12-25 17:49:20 [DEBUG   ] Got command RPT from MCS: ref #950554
2018-12-25 17:49:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 17:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950554  77 58477 64160481 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 17:49:20 [DEBUG   ] Got command RPT from MCS: ref #950555
2018-12-25 17:49:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 17:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950555  12 58477 64160685 A  ERRORBš™š'
2018-12-25 17:49:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 17:49:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:49:44 [WARNING ] (13, 1, 'bot')
2018-12-25 17:49:44 [WARNING ] (13, 1, 'bot')
2018-12-25 17:49:44 [WARNING ] (13, 1, 'bot')
2018-12-25 17:49:44 [WARNING ] (13, 1, 'bot')
2018-12-25 17:49:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:49:44 [DEBUG   ] Finished updating board flags in 2.214 seconds
2018-12-25 17:49:55 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 17:50:15 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-25 17:50:35 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-25 17:50:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 17:50:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:50:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 17:50:44 [WARNING ] (13, 1, 'bot')
2018-12-25 17:50:44 [WARNING ] (13, 1, 'bot')
2018-12-25 17:50:44 [WARNING ] (13, 1, 'bot')
2018-12-25 17:50:44 [WARNING ] (13, 1, 'bot')
2018-12-25 17:50:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:50:44 [DEBUG   ] Finished updating board flags in 2.109 seconds
2018-12-25 17:50:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 17:50:58 [DEBUG   ] Got command RPT from MCS: ref #950556
2018-12-25 17:50:58 [DEBUG   ] summary = ERROR
2018-12-25 17:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950556  13 58477 64258437 A  ERRORERROR'
2018-12-25 17:50:58 [DEBUG   ] Got command RPT from MCS: ref #950557
2018-12-25 17:50:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 17:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950557  77 58477 64258438 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 17:51:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 17:51:35 [DEBUG   ] Finished updating ant stats in 0.548 seconds
2018-12-25 17:51:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:51:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-12-25 17:51:44 [WARNING ] (13, 1, 'bot')
2018-12-25 17:51:44 [WARNING ] (13, 1, 'bot')
2018-12-25 17:51:44 [WARNING ] (13, 1, 'bot')
2018-12-25 17:51:44 [WARNING ] (13, 1, 'bot')
2018-12-25 17:51:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:51:44 [DEBUG   ] Finished updating board flags in 2.009 seconds
2018-12-25 17:51:56 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2018-12-25 17:52:16 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-25 17:52:36 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 17:52:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:52:44 [WARNING ] (13, 1, 'bot')
2018-12-25 17:52:44 [WARNING ] (13, 1, 'bot')
2018-12-25 17:52:44 [WARNING ] (13, 1, 'bot')
2018-12-25 17:52:44 [WARNING ] (13, 1, 'bot')
2018-12-25 17:52:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:52:44 [DEBUG   ] Finished updating board flags in 1.988 seconds
2018-12-25 17:52:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 17:53:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 17:53:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 17:53:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:53:44 [WARNING ] (13, 1, 'bot')
2018-12-25 17:53:44 [WARNING ] (13, 1, 'bot')
2018-12-25 17:53:44 [WARNING ] (13, 1, 'bot')
2018-12-25 17:53:44 [WARNING ] (13, 1, 'bot')
2018-12-25 17:53:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:53:44 [DEBUG   ] Finished updating board flags in 1.832 seconds
2018-12-25 17:53:56 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 17:54:16 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 17:54:19 [DEBUG   ] Got command RPT from MCS: ref #950579
2018-12-25 17:54:19 [DEBUG   ] summary = ERROR
2018-12-25 17:54:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950579  13 58477 64459953 A  ERRORERROR'
2018-12-25 17:54:20 [DEBUG   ] Got command RPT from MCS: ref #950580
2018-12-25 17:54:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 17:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950580  77 58477 64460157 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 17:54:20 [DEBUG   ] Got command RPT from MCS: ref #950581
2018-12-25 17:54:20 [DEBUG   ] summary = ERROR
2018-12-25 17:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950581  13 58477 64460361 A  ERRORERROR'
2018-12-25 17:54:20 [DEBUG   ] Got command RPT from MCS: ref #950582
2018-12-25 17:54:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 17:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950582  77 58477 64460553 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 17:54:20 [DEBUG   ] Got command RPT from MCS: ref #950584
2018-12-25 17:54:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 17:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950584  12 58477 64460757 A  ERRORB™™š'
2018-12-25 17:54:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 17:54:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:54:44 [WARNING ] (13, 1, 'bot')
2018-12-25 17:54:44 [WARNING ] (13, 1, 'bot')
2018-12-25 17:54:44 [WARNING ] (13, 1, 'bot')
2018-12-25 17:54:44 [WARNING ] (13, 1, 'bot')
2018-12-25 17:54:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:54:44 [DEBUG   ] Finished updating board flags in 1.789 seconds
2018-12-25 17:54:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 17:55:16 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 17:55:36 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-25 17:55:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:55:44 [WARNING ] (13, 1, 'bot')
2018-12-25 17:55:44 [WARNING ] (13, 1, 'bot')
2018-12-25 17:55:44 [WARNING ] (13, 1, 'bot')
2018-12-25 17:55:44 [WARNING ] (13, 1, 'bot')
2018-12-25 17:55:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:55:44 [DEBUG   ] Finished updating board flags in 1.620 seconds
2018-12-25 17:55:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 17:55:58 [DEBUG   ] Got command RPT from MCS: ref #950593
2018-12-25 17:55:58 [DEBUG   ] summary = ERROR
2018-12-25 17:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950593  13 58477 64558433 A  ERRORERROR'
2018-12-25 17:55:58 [DEBUG   ] Got command RPT from MCS: ref #950594
2018-12-25 17:55:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 17:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950594  77 58477 64558434 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 17:56:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 17:56:36 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 17:56:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:56:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 17:56:44 [WARNING ] (13, 1, 'bot')
2018-12-25 17:56:44 [WARNING ] (13, 1, 'bot')
2018-12-25 17:56:44 [WARNING ] (13, 1, 'bot')
2018-12-25 17:56:44 [WARNING ] (13, 1, 'bot')
2018-12-25 17:56:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:56:44 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-12-25 17:56:56 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-25 17:57:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 17:57:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 17:57:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:57:44 [WARNING ] (13, 1, 'bot')
2018-12-25 17:57:44 [WARNING ] (13, 1, 'bot')
2018-12-25 17:57:44 [WARNING ] (13, 1, 'bot')
2018-12-25 17:57:44 [WARNING ] (13, 1, 'bot')
2018-12-25 17:57:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:57:44 [DEBUG   ] Finished updating board flags in 1.567 seconds
2018-12-25 17:57:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 17:58:16 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-25 17:58:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 17:58:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:58:44 [WARNING ] (13, 1, 'bot')
2018-12-25 17:58:44 [WARNING ] (13, 1, 'bot')
2018-12-25 17:58:44 [WARNING ] (13, 1, 'bot')
2018-12-25 17:58:44 [WARNING ] (13, 1, 'bot')
2018-12-25 17:58:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:58:44 [DEBUG   ] Finished updating board flags in 1.426 seconds
2018-12-25 17:58:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 17:59:16 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 17:59:20 [DEBUG   ] Got command RPT from MCS: ref #950614
2018-12-25 17:59:20 [DEBUG   ] summary = ERROR
2018-12-25 17:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950614  13 58477 64760041 A  ERRORERROR'
2018-12-25 17:59:20 [DEBUG   ] Got command RPT from MCS: ref #950615
2018-12-25 17:59:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 17:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950615  77 58477 64760233 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 17:59:20 [DEBUG   ] Got command RPT from MCS: ref #950616
2018-12-25 17:59:20 [DEBUG   ] summary = ERROR
2018-12-25 17:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950616  13 58477 64760437 A  ERRORERROR'
2018-12-25 17:59:20 [DEBUG   ] Got command RPT from MCS: ref #950617
2018-12-25 17:59:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 17:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950617  77 58477 64760641 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 17:59:20 [DEBUG   ] Got command RPT from MCS: ref #950618
2018-12-25 17:59:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 17:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950618  12 58477 64760833 A  ERRORB™™š'
2018-12-25 17:59:36 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-25 17:59:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 17:59:44 [WARNING ] (13, 1, 'bot')
2018-12-25 17:59:44 [WARNING ] (13, 1, 'bot')
2018-12-25 17:59:44 [WARNING ] (13, 1, 'bot')
2018-12-25 17:59:44 [WARNING ] (13, 1, 'bot')
2018-12-25 17:59:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 17:59:44 [DEBUG   ] Finished updating board flags in 1.461 seconds
2018-12-25 17:59:57 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-12-25 18:00:17 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-25 18:00:37 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2018-12-25 18:00:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:00:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 18:00:44 [WARNING ] (13, 1, 'bot')
2018-12-25 18:00:44 [WARNING ] (13, 1, 'bot')
2018-12-25 18:00:44 [WARNING ] (13, 1, 'bot')
2018-12-25 18:00:44 [WARNING ] (13, 1, 'bot')
2018-12-25 18:00:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:00:44 [DEBUG   ] Finished updating board flags in 1.456 seconds
2018-12-25 18:00:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 18:00:58 [DEBUG   ] Got command RPT from MCS: ref #950623
2018-12-25 18:00:58 [DEBUG   ] summary = ERROR
2018-12-25 18:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950623  13 58477 64858441 A  ERRORERROR'
2018-12-25 18:00:58 [DEBUG   ] Got command RPT from MCS: ref #950624
2018-12-25 18:00:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 18:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950624  77 58477 64858442 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 18:01:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 18:01:37 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 18:01:43 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 18:01:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:01:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 18:01:44 [WARNING ] (13, 1, 'bot')
2018-12-25 18:01:44 [WARNING ] (13, 1, 'bot')
2018-12-25 18:01:44 [WARNING ] (13, 1, 'bot')
2018-12-25 18:01:44 [WARNING ] (13, 1, 'bot')
2018-12-25 18:01:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:01:44 [DEBUG   ] Finished updating board flags in 1.445 seconds
2018-12-25 18:01:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 18:02:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 18:02:37 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 18:02:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:02:44 [WARNING ] (13, 1, 'bot')
2018-12-25 18:02:44 [WARNING ] (13, 1, 'bot')
2018-12-25 18:02:44 [WARNING ] (13, 1, 'bot')
2018-12-25 18:02:44 [WARNING ] (13, 1, 'bot')
2018-12-25 18:02:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:02:44 [DEBUG   ] Finished updating board flags in 1.495 seconds
2018-12-25 18:02:57 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-25 18:03:17 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-25 18:03:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 18:03:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:03:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:03:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:03:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:03:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:03:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:03:45 [DEBUG   ] Finished updating board flags in 2.212 seconds
2018-12-25 18:03:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 18:04:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 18:04:20 [DEBUG   ] Got command RPT from MCS: ref #950646
2018-12-25 18:04:20 [DEBUG   ] summary = ERROR
2018-12-25 18:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950646  13 58477 65060117 A  ERRORERROR'
2018-12-25 18:04:20 [DEBUG   ] Got command RPT from MCS: ref #950647
2018-12-25 18:04:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 18:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950647  77 58477 65060321 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 18:04:20 [DEBUG   ] Got command RPT from MCS: ref #950648
2018-12-25 18:04:20 [DEBUG   ] summary = ERROR
2018-12-25 18:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950648  13 58477 65060513 A  ERRORERROR'
2018-12-25 18:04:20 [DEBUG   ] Got command RPT from MCS: ref #950650
2018-12-25 18:04:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 18:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950650  77 58477 65060717 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 18:04:20 [DEBUG   ] Got command RPT from MCS: ref #950651
2018-12-25 18:04:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 18:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950651  12 58477 65060921 A  ERRORB˜™š'
2018-12-25 18:04:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 18:04:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:04:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 18:04:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:04:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:04:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:04:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:04:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:04:45 [DEBUG   ] Finished updating board flags in 2.135 seconds
2018-12-25 18:04:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 18:05:17 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-25 18:05:37 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 18:05:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:05:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:05:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:05:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:05:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:05:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:05:45 [DEBUG   ] Finished updating board flags in 2.022 seconds
2018-12-25 18:05:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 18:05:58 [DEBUG   ] Got command RPT from MCS: ref #950656
2018-12-25 18:05:58 [DEBUG   ] summary = ERROR
2018-12-25 18:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950656  13 58477 65158437 A  ERRORERROR'
2018-12-25 18:05:58 [DEBUG   ] Got command RPT from MCS: ref #950657
2018-12-25 18:05:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 18:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950657  77 58477 65158438 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 18:06:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 18:06:37 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 18:06:44 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 18:06:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:06:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 18:06:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:06:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:06:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:06:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:06:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:06:45 [DEBUG   ] Finished updating board flags in 1.964 seconds
2018-12-25 18:06:57 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-25 18:07:18 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-12-25 18:07:38 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-25 18:07:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:07:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:07:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:07:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:07:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:07:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:07:45 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-12-25 18:07:58 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-25 18:08:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 18:08:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 18:08:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:08:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:08:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:08:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:08:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:08:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:08:45 [DEBUG   ] Finished updating board flags in 1.779 seconds
2018-12-25 18:08:58 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 18:09:18 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-25 18:09:20 [DEBUG   ] Got command RPT from MCS: ref #950677
2018-12-25 18:09:20 [DEBUG   ] summary = ERROR
2018-12-25 18:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950677  13 58477 65360201 A  ERRORERROR'
2018-12-25 18:09:20 [DEBUG   ] Got command RPT from MCS: ref #950678
2018-12-25 18:09:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 18:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950678  77 58477 65360393 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 18:09:20 [DEBUG   ] Got command RPT from MCS: ref #950679
2018-12-25 18:09:20 [DEBUG   ] summary = ERROR
2018-12-25 18:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950679  13 58477 65360597 A  ERRORERROR'
2018-12-25 18:09:20 [DEBUG   ] Got command RPT from MCS: ref #950680
2018-12-25 18:09:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 18:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950680  77 58477 65360801 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 18:09:21 [DEBUG   ] Got command RPT from MCS: ref #950681
2018-12-25 18:09:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 18:09:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950681  12 58477 65361005 A  ERRORB˜™š'
2018-12-25 18:09:38 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-25 18:09:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:09:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-25 18:09:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:09:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:09:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:09:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:09:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:09:45 [DEBUG   ] Finished updating board flags in 1.627 seconds
2018-12-25 18:09:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 18:10:18 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 18:10:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 18:10:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:10:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-12-25 18:10:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:10:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:10:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:10:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:10:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:10:45 [DEBUG   ] Finished updating board flags in 1.604 seconds
2018-12-25 18:10:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 18:10:58 [DEBUG   ] Got command RPT from MCS: ref #950686
2018-12-25 18:10:58 [DEBUG   ] summary = ERROR
2018-12-25 18:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950686  13 58477 65458437 A  ERRORERROR'
2018-12-25 18:10:58 [DEBUG   ] Got command RPT from MCS: ref #950687
2018-12-25 18:10:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 18:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950687  77 58477 65458438 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 18:11:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 18:11:38 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 18:11:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:11:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 18:11:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:11:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:11:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:11:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:11:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:11:45 [DEBUG   ] Finished updating board flags in 1.622 seconds
2018-12-25 18:11:58 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-25 18:12:18 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-25 18:12:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 18:12:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 18:12:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:12:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:12:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:12:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:12:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:12:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:12:45 [DEBUG   ] Finished updating board flags in 1.565 seconds
2018-12-25 18:12:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 18:13:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 18:13:38 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-25 18:13:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:13:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 18:13:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:13:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:13:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:13:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:13:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:13:45 [DEBUG   ] Finished updating board flags in 1.424 seconds
2018-12-25 18:13:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 18:14:18 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-12-25 18:14:20 [DEBUG   ] Got command RPT from MCS: ref #950709
2018-12-25 18:14:20 [DEBUG   ] summary = ERROR
2018-12-25 18:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950709  13 58477 65660277 A  ERRORERROR'
2018-12-25 18:14:20 [DEBUG   ] Got command RPT from MCS: ref #950710
2018-12-25 18:14:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 18:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950710  77 58477 65660481 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 18:14:20 [DEBUG   ] Got command RPT from MCS: ref #950711
2018-12-25 18:14:20 [DEBUG   ] summary = ERROR
2018-12-25 18:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950711  13 58477 65660685 A  ERRORERROR'
2018-12-25 18:14:20 [DEBUG   ] Got command RPT from MCS: ref #950713
2018-12-25 18:14:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 18:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950713  77 58477 65660877 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 18:14:21 [DEBUG   ] Got command RPT from MCS: ref #950715
2018-12-25 18:14:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 18:14:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950715  12 58477 65661081 A  ERRORBš™š'
2018-12-25 18:14:38 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-25 18:14:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:14:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:14:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:14:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:14:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:14:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:14:45 [DEBUG   ] Finished updating board flags in 1.428 seconds
2018-12-25 18:14:58 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-25 18:15:18 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-12-25 18:15:39 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 18:15:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:15:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-25 18:15:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:15:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:15:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:15:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:15:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:15:45 [DEBUG   ] Finished updating board flags in 1.407 seconds
2018-12-25 18:15:58 [DEBUG   ] Got command RPT from MCS: ref #950723
2018-12-25 18:15:58 [DEBUG   ] summary = ERROR
2018-12-25 18:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950723  13 58477 65758437 A  ERRORERROR'
2018-12-25 18:15:58 [DEBUG   ] Got command RPT from MCS: ref #950724
2018-12-25 18:15:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 18:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950724  77 58477 65758438 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 18:15:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 18:16:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 18:16:39 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-25 18:16:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:16:45 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 18:16:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:16:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:16:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:16:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:16:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:16:45 [DEBUG   ] Finished updating board flags in 1.499 seconds
2018-12-25 18:16:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 18:17:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 18:17:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 18:17:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:17:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:17:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:17:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:17:45 [WARNING ] (13, 1, 'bot')
2018-12-25 18:17:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:17:45 [DEBUG   ] Finished updating board flags in 1.509 seconds
2018-12-25 18:17:59 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 18:18:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 18:18:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 18:18:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:18:46 [WARNING ] (13, 1, 'bot')
2018-12-25 18:18:46 [WARNING ] (13, 1, 'bot')
2018-12-25 18:18:46 [WARNING ] (13, 1, 'bot')
2018-12-25 18:18:46 [WARNING ] (13, 1, 'bot')
2018-12-25 18:18:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:18:46 [DEBUG   ] Finished updating board flags in 2.254 seconds
2018-12-25 18:18:59 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 18:19:19 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 18:19:20 [DEBUG   ] Got command RPT from MCS: ref #950744
2018-12-25 18:19:20 [DEBUG   ] summary = ERROR
2018-12-25 18:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950744  13 58477 65960357 A  ERRORERROR'
2018-12-25 18:19:20 [DEBUG   ] Got command RPT from MCS: ref #950745
2018-12-25 18:19:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 18:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950745  77 58477 65960561 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 18:19:20 [DEBUG   ] Got command RPT from MCS: ref #950746
2018-12-25 18:19:20 [DEBUG   ] summary = ERROR
2018-12-25 18:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950746  13 58477 65960765 A  ERRORERROR'
2018-12-25 18:19:20 [DEBUG   ] Got command RPT from MCS: ref #950747
2018-12-25 18:19:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 18:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950747  77 58477 65960957 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 18:19:21 [DEBUG   ] Got command RPT from MCS: ref #950748
2018-12-25 18:19:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 18:19:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950748  12 58477 65961161 A  ERRORB™™š'
2018-12-25 18:19:39 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-25 18:19:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:19:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 18:19:46 [WARNING ] (13, 1, 'bot')
2018-12-25 18:19:46 [WARNING ] (13, 1, 'bot')
2018-12-25 18:19:46 [WARNING ] (13, 1, 'bot')
2018-12-25 18:19:46 [WARNING ] (13, 1, 'bot')
2018-12-25 18:19:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:19:46 [DEBUG   ] Finished updating board flags in 2.099 seconds
2018-12-25 18:19:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 18:20:19 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 18:20:39 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-25 18:20:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:20:46 [WARNING ] (13, 1, 'bot')
2018-12-25 18:20:46 [WARNING ] (13, 1, 'bot')
2018-12-25 18:20:46 [WARNING ] (13, 1, 'bot')
2018-12-25 18:20:46 [WARNING ] (13, 1, 'bot')
2018-12-25 18:20:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:20:46 [DEBUG   ] Finished updating board flags in 2.016 seconds
2018-12-25 18:20:58 [DEBUG   ] Got command RPT from MCS: ref #950749
2018-12-25 18:20:58 [DEBUG   ] summary = ERROR
2018-12-25 18:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950749  13 58477 66058441 A  ERRORERROR'
2018-12-25 18:20:58 [DEBUG   ] Got command RPT from MCS: ref #950750
2018-12-25 18:20:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 18:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950750  77 58477 66058442 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 18:20:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 18:21:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 18:21:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 18:21:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:21:46 [WARNING ] (13, 1, 'bot')
2018-12-25 18:21:46 [WARNING ] (13, 1, 'bot')
2018-12-25 18:21:46 [WARNING ] (13, 1, 'bot')
2018-12-25 18:21:46 [WARNING ] (13, 1, 'bot')
2018-12-25 18:21:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:21:46 [DEBUG   ] Finished updating board flags in 2.010 seconds
2018-12-25 18:21:59 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 18:22:19 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-25 18:22:40 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-12-25 18:22:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:22:46 [WARNING ] (13, 1, 'bot')
2018-12-25 18:22:46 [WARNING ] (13, 1, 'bot')
2018-12-25 18:22:46 [WARNING ] (13, 1, 'bot')
2018-12-25 18:22:46 [WARNING ] (13, 1, 'bot')
2018-12-25 18:22:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:22:46 [DEBUG   ] Finished updating board flags in 1.984 seconds
2018-12-25 18:23:00 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-25 18:23:20 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-25 18:23:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 18:23:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 18:23:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:23:46 [WARNING ] (13, 1, 'bot')
2018-12-25 18:23:46 [WARNING ] (13, 1, 'bot')
2018-12-25 18:23:46 [WARNING ] (13, 1, 'bot')
2018-12-25 18:23:46 [WARNING ] (13, 1, 'bot')
2018-12-25 18:23:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:23:46 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-12-25 18:24:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 18:24:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 18:24:20 [DEBUG   ] Got command RPT from MCS: ref #950772
2018-12-25 18:24:20 [DEBUG   ] summary = ERROR
2018-12-25 18:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950772  13 58477 66260441 A  ERRORERROR'
2018-12-25 18:24:20 [DEBUG   ] Got command RPT from MCS: ref #950773
2018-12-25 18:24:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 18:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950773  77 58477 66260645 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 18:24:20 [DEBUG   ] Got command RPT from MCS: ref #950774
2018-12-25 18:24:20 [DEBUG   ] summary = ERROR
2018-12-25 18:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950774  13 58477 66260849 A  ERRORERROR'
2018-12-25 18:24:21 [DEBUG   ] Got command RPT from MCS: ref #950776
2018-12-25 18:24:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 18:24:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950776  77 58477 66261041 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 18:24:21 [DEBUG   ] Got command RPT from MCS: ref #950777
2018-12-25 18:24:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 18:24:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950777  12 58477 66261245 A  ERRORB™™š'
2018-12-25 18:24:40 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-25 18:24:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:24:46 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 18:24:46 [WARNING ] (13, 1, 'bot')
2018-12-25 18:24:46 [WARNING ] (13, 1, 'bot')
2018-12-25 18:24:46 [WARNING ] (13, 1, 'bot')
2018-12-25 18:24:46 [WARNING ] (13, 1, 'bot')
2018-12-25 18:24:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:24:46 [DEBUG   ] Finished updating board flags in 1.799 seconds
2018-12-25 18:25:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 18:25:20 [DEBUG   ] Finished updating ant stats in 0.746 seconds
2018-12-25 18:25:40 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 18:25:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:25:46 [WARNING ] (13, 1, 'bot')
2018-12-25 18:25:46 [WARNING ] (13, 1, 'bot')
2018-12-25 18:25:46 [WARNING ] (13, 1, 'bot')
2018-12-25 18:25:46 [WARNING ] (13, 1, 'bot')
2018-12-25 18:25:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:25:46 [DEBUG   ] Finished updating board flags in 1.595 seconds
2018-12-25 18:25:58 [DEBUG   ] Got command RPT from MCS: ref #950786
2018-12-25 18:25:58 [DEBUG   ] summary = ERROR
2018-12-25 18:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950786  13 58477 66358449 A  ERRORERROR'
2018-12-25 18:25:58 [DEBUG   ] Got command RPT from MCS: ref #950787
2018-12-25 18:25:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 18:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950787  77 58477 66358450 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 18:26:00 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-25 18:26:21 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-25 18:26:41 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-25 18:26:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:26:46 [WARNING ] (13, 1, 'bot')
2018-12-25 18:26:46 [WARNING ] (13, 1, 'bot')
2018-12-25 18:26:46 [WARNING ] (13, 1, 'bot')
2018-12-25 18:26:46 [WARNING ] (13, 1, 'bot')
2018-12-25 18:26:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:26:46 [DEBUG   ] Finished updating board flags in 1.406 seconds
2018-12-25 18:27:01 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-25 18:27:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 18:27:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 18:27:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 18:27:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:27:46 [WARNING ] (13, 1, 'bot')
2018-12-25 18:27:46 [WARNING ] (13, 1, 'bot')
2018-12-25 18:27:46 [WARNING ] (13, 1, 'bot')
2018-12-25 18:27:46 [WARNING ] (13, 1, 'bot')
2018-12-25 18:27:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:27:46 [DEBUG   ] Finished updating board flags in 1.395 seconds
2018-12-25 18:28:01 [DEBUG   ] Finished updating ant stats in 1.007 seconds
2018-12-25 18:28:21 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-25 18:28:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 18:28:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:28:46 [WARNING ] (13, 1, 'bot')
2018-12-25 18:28:46 [WARNING ] (13, 1, 'bot')
2018-12-25 18:28:46 [WARNING ] (13, 1, 'bot')
2018-12-25 18:28:46 [WARNING ] (13, 1, 'bot')
2018-12-25 18:28:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:28:46 [DEBUG   ] Finished updating board flags in 1.360 seconds
2018-12-25 18:29:01 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-12-25 18:29:20 [DEBUG   ] Got command RPT from MCS: ref #950807
2018-12-25 18:29:20 [DEBUG   ] summary = ERROR
2018-12-25 18:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950807  13 58477 66560522 A  ERRORERROR'
2018-12-25 18:29:20 [DEBUG   ] Got command RPT from MCS: ref #950808
2018-12-25 18:29:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 18:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950808  77 58477 66560725 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 18:29:20 [DEBUG   ] Got command RPT from MCS: ref #950809
2018-12-25 18:29:20 [DEBUG   ] summary = ERROR
2018-12-25 18:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950809  13 58477 66560921 A  ERRORERROR'
2018-12-25 18:29:21 [DEBUG   ] Got command RPT from MCS: ref #950810
2018-12-25 18:29:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 18:29:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950810  77 58477 66561125 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 18:29:21 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-25 18:29:21 [DEBUG   ] Got command RPT from MCS: ref #950811
2018-12-25 18:29:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 18:29:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950811  12 58477 66561329 A  ERRORB™™š'
2018-12-25 18:29:41 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-25 18:29:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:29:47 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 18:29:47 [WARNING ] (13, 1, 'bot')
2018-12-25 18:29:47 [WARNING ] (13, 1, 'bot')
2018-12-25 18:29:47 [WARNING ] (13, 1, 'bot')
2018-12-25 18:29:47 [WARNING ] (13, 1, 'bot')
2018-12-25 18:29:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:29:47 [DEBUG   ] Finished updating board flags in 2.047 seconds
2018-12-25 18:30:02 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-12-25 18:30:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 18:30:42 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-25 18:30:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 18:30:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:30:47 [WARNING ] (13, 1, 'bot')
2018-12-25 18:30:47 [WARNING ] (13, 1, 'bot')
2018-12-25 18:30:47 [WARNING ] (13, 1, 'bot')
2018-12-25 18:30:47 [WARNING ] (13, 1, 'bot')
2018-12-25 18:30:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:30:47 [DEBUG   ] Finished updating board flags in 2.009 seconds
2018-12-25 18:30:58 [DEBUG   ] Got command RPT from MCS: ref #950816
2018-12-25 18:30:58 [DEBUG   ] summary = ERROR
2018-12-25 18:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950816  13 58477 66658441 A  ERRORERROR'
2018-12-25 18:30:58 [DEBUG   ] Got command RPT from MCS: ref #950817
2018-12-25 18:30:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 18:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950817  77 58477 66658442 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 18:31:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 18:31:22 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 18:31:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 18:31:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:31:47 [WARNING ] (13, 1, 'bot')
2018-12-25 18:31:47 [WARNING ] (13, 1, 'bot')
2018-12-25 18:31:47 [WARNING ] (13, 1, 'bot')
2018-12-25 18:31:47 [WARNING ] (13, 1, 'bot')
2018-12-25 18:31:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:31:47 [DEBUG   ] Finished updating board flags in 2.108 seconds
2018-12-25 18:32:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 18:32:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 18:32:42 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 18:32:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:32:47 [WARNING ] (13, 1, 'bot')
2018-12-25 18:32:47 [WARNING ] (13, 1, 'bot')
2018-12-25 18:32:47 [WARNING ] (13, 1, 'bot')
2018-12-25 18:32:47 [WARNING ] (13, 1, 'bot')
2018-12-25 18:32:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:32:47 [DEBUG   ] Finished updating board flags in 1.909 seconds
2018-12-25 18:33:02 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-25 18:33:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 18:33:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 18:33:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:33:47 [WARNING ] (13, 1, 'bot')
2018-12-25 18:33:47 [WARNING ] (13, 1, 'bot')
2018-12-25 18:33:47 [WARNING ] (13, 1, 'bot')
2018-12-25 18:33:47 [WARNING ] (13, 1, 'bot')
2018-12-25 18:33:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:33:47 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-12-25 18:34:02 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 18:34:20 [DEBUG   ] Got command RPT from MCS: ref #950839
2018-12-25 18:34:20 [DEBUG   ] summary = ERROR
2018-12-25 18:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950839  13 58477 66860597 A  ERRORERROR'
2018-12-25 18:34:20 [DEBUG   ] Got command RPT from MCS: ref #950840
2018-12-25 18:34:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 18:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950840  77 58477 66860801 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 18:34:21 [DEBUG   ] Got command RPT from MCS: ref #950841
2018-12-25 18:34:21 [DEBUG   ] summary = ERROR
2018-12-25 18:34:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950841  13 58477 66861005 A  ERRORERROR'
2018-12-25 18:34:21 [DEBUG   ] Got command RPT from MCS: ref #950843
2018-12-25 18:34:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 18:34:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950843  77 58477 66861209 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 18:34:21 [DEBUG   ] Got command RPT from MCS: ref #950844
2018-12-25 18:34:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 18:34:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950844  12 58477 66861401 A  ERRORB™™š'
2018-12-25 18:34:22 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-25 18:34:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 18:34:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:34:47 [WARNING ] (13, 1, 'bot')
2018-12-25 18:34:47 [WARNING ] (13, 1, 'bot')
2018-12-25 18:34:47 [WARNING ] (13, 1, 'bot')
2018-12-25 18:34:47 [WARNING ] (13, 1, 'bot')
2018-12-25 18:34:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:34:47 [DEBUG   ] Finished updating board flags in 1.767 seconds
2018-12-25 18:35:02 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-25 18:35:22 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 18:35:42 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2018-12-25 18:35:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:35:47 [WARNING ] (13, 1, 'bot')
2018-12-25 18:35:47 [WARNING ] (13, 1, 'bot')
2018-12-25 18:35:47 [WARNING ] (13, 1, 'bot')
2018-12-25 18:35:47 [WARNING ] (13, 1, 'bot')
2018-12-25 18:35:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:35:47 [DEBUG   ] Finished updating board flags in 1.609 seconds
2018-12-25 18:35:58 [DEBUG   ] Got command RPT from MCS: ref #950849
2018-12-25 18:35:58 [DEBUG   ] summary = ERROR
2018-12-25 18:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950849  13 58477 66958445 A  ERRORERROR'
2018-12-25 18:35:58 [DEBUG   ] Got command RPT from MCS: ref #950850
2018-12-25 18:35:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 18:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950850  77 58477 66958446 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 18:36:03 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-25 18:36:23 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-25 18:36:43 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-25 18:36:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:36:47 [WARNING ] (13, 1, 'bot')
2018-12-25 18:36:47 [WARNING ] (13, 1, 'bot')
2018-12-25 18:36:47 [WARNING ] (13, 1, 'bot')
2018-12-25 18:36:47 [WARNING ] (13, 1, 'bot')
2018-12-25 18:36:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:36:47 [DEBUG   ] Finished updating board flags in 1.596 seconds
2018-12-25 18:37:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 18:37:23 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 18:37:43 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-25 18:37:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:37:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 18:37:47 [WARNING ] (13, 1, 'bot')
2018-12-25 18:37:47 [WARNING ] (13, 1, 'bot')
2018-12-25 18:37:47 [WARNING ] (13, 1, 'bot')
2018-12-25 18:37:47 [WARNING ] (13, 1, 'bot')
2018-12-25 18:37:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:37:47 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-12-25 18:38:03 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-25 18:38:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 18:38:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 18:38:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 18:38:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:38:47 [WARNING ] (13, 1, 'bot')
2018-12-25 18:38:47 [WARNING ] (13, 1, 'bot')
2018-12-25 18:38:47 [WARNING ] (13, 1, 'bot')
2018-12-25 18:38:47 [WARNING ] (13, 1, 'bot')
2018-12-25 18:38:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:38:47 [DEBUG   ] Finished updating board flags in 1.379 seconds
2018-12-25 18:39:03 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 18:39:11 [DEBUG   ] Got command TBW from MCS: ref #950871
2018-12-25 18:39:11 [DEBUG   ] tbw = exited with status True, code 0x00
2018-12-25 18:39:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW   950871   8 58477 67151274 A  ERROR'
2018-12-25 18:39:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2018-12-25 18:39:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2018-12-25 18:39:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2018-12-25 18:39:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2018-12-25 18:39:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2018-12-25 18:39:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2018-12-25 18:39:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2018-12-25 18:39:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2018-12-25 18:39:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2018-12-25 18:39:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2018-12-25 18:39:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2018-12-25 18:39:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2018-12-25 18:39:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2018-12-25 18:39:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2018-12-25 18:39:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2018-12-25 18:39:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2018-12-25 18:39:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2018-12-25 18:39:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2018-12-25 18:39:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2018-12-25 18:39:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2018-12-25 18:39:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2018-12-25 18:39:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2018-12-25 18:39:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2018-12-25 18:39:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2018-12-25 18:39:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2018-12-25 18:39:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2018-12-25 18:39:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2018-12-25 18:39:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2018-12-25 18:39:14 [DEBUG   ] spawn_process: at 2018-12-25 18:39:14 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2018-12-25 18:39:14 [DEBUG   ] spawn_process: at 2018-12-25 18:39:14 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2018-12-25 18:39:14 [DEBUG   ] spawn_process: at 2018-12-25 18:39:14 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2018-12-25 18:39:14 [DEBUG   ] spawn_process: at 2018-12-25 18:39:14 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2018-12-25 18:39:14 [DEBUG   ] spawn_process: at 2018-12-25 18:39:14 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2018-12-25 18:39:14 [DEBUG   ] spawn_process: at 2018-12-25 18:39:14 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2018-12-25 18:39:14 [DEBUG   ] spawn_process: at 2018-12-25 18:39:14 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2018-12-25 18:39:14 [DEBUG   ] spawn_process: at 2018-12-25 18:39:14 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2018-12-25 18:39:14 [DEBUG   ] spawn_process: at 2018-12-25 18:39:14 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2018-12-25 18:39:14 [DEBUG   ] spawn_process: at 2018-12-25 18:39:14 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2018-12-25 18:39:14 [DEBUG   ] spawn_process: at 2018-12-25 18:39:14 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2018-12-25 18:39:14 [DEBUG   ] spawn_process: at 2018-12-25 18:39:14 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2018-12-25 18:39:14 [DEBUG   ] spawn_process: at 2018-12-25 18:39:14 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2018-12-25 18:39:14 [DEBUG   ] spawn_process: at 2018-12-25 18:39:14 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2018-12-25 18:39:14 [DEBUG   ] spawn_process: at 2018-12-25 18:39:14 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2018-12-25 18:39:14 [DEBUG   ] spawn_process: at 2018-12-25 18:39:14 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2018-12-25 18:39:14 [DEBUG   ] spawn_process: at 2018-12-25 18:39:14 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2018-12-25 18:39:14 [DEBUG   ] spawn_process: at 2018-12-25 18:39:14 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2018-12-25 18:39:14 [DEBUG   ] spawn_process: at 2018-12-25 18:39:14 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2018-12-25 18:39:14 [DEBUG   ] spawn_process: at 2018-12-25 18:39:14 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2018-12-25 18:39:14 [DEBUG   ] spawn_process: at 2018-12-25 18:39:14 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2018-12-25 18:39:14 [DEBUG   ] spawn_process: at 2018-12-25 18:39:14 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2018-12-25 18:39:14 [DEBUG   ] spawn_process: at 2018-12-25 18:39:14 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2018-12-25 18:39:14 [DEBUG   ] spawn_process: at 2018-12-25 18:39:14 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2018-12-25 18:39:14 [DEBUG   ] spawn_process: at 2018-12-25 18:39:14 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2018-12-25 18:39:14 [DEBUG   ] spawn_process: at 2018-12-25 18:39:14 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2018-12-25 18:39:14 [INFO    ] Finished spawning TBW
2018-12-25 18:39:20 [DEBUG   ] Got command RPT from MCS: ref #950873
2018-12-25 18:39:20 [DEBUG   ] summary = ERROR
2018-12-25 18:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950873  13 58477 67160677 A  ERRORERROR'
2018-12-25 18:39:20 [DEBUG   ] Got command RPT from MCS: ref #950874
2018-12-25 18:39:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 18:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950874  77 58477 67160881 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 18:39:21 [DEBUG   ] Got command RPT from MCS: ref #950875
2018-12-25 18:39:21 [DEBUG   ] summary = ERROR
2018-12-25 18:39:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950875  13 58477 67161085 A  ERRORERROR'
2018-12-25 18:39:21 [DEBUG   ] Got command RPT from MCS: ref #950876
2018-12-25 18:39:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 18:39:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950876  77 58477 67161289 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 18:39:21 [DEBUG   ] Got command RPT from MCS: ref #950877
2018-12-25 18:39:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 18:39:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950877  12 58477 67161481 A  ERRORB˜™š'
2018-12-25 18:39:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:39:47 [WARNING ] (13, 1, 'bot')
2018-12-25 18:39:47 [WARNING ] (13, 1, 'bot')
2018-12-25 18:39:47 [WARNING ] (13, 1, 'bot')
2018-12-25 18:39:47 [WARNING ] (13, 1, 'bot')
2018-12-25 18:39:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:39:47 [DEBUG   ] Finished updating board flags in 1.048 seconds
2018-12-25 18:40:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 18:40:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:40:48 [WARNING ] (13, 1, 'bot')
2018-12-25 18:40:48 [WARNING ] (13, 1, 'bot')
2018-12-25 18:40:48 [WARNING ] (13, 1, 'bot')
2018-12-25 18:40:48 [WARNING ] (13, 1, 'bot')
2018-12-25 18:40:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:40:48 [DEBUG   ] Finished updating board flags in 2.138 seconds
2018-12-25 18:40:58 [DEBUG   ] Got command RPT from MCS: ref #950885
2018-12-25 18:40:58 [DEBUG   ] summary = ERROR
2018-12-25 18:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950885  13 58477 67258449 A  ERRORERROR'
2018-12-25 18:40:58 [DEBUG   ] Got command RPT from MCS: ref #950886
2018-12-25 18:40:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 18:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950886  77 58477 67258450 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 18:41:02 [INFO    ] __waitForTBW - TBW finished in 108.012 s
2018-12-25 18:41:03 [DEBUG   ] Finished updating ant stats in 0.455 seconds
2018-12-25 18:41:03 [INFO    ] Started antennas statistics background thread
2018-12-25 18:41:03 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2018-12-25 18:41:03 [DEBUG   ] spawn_process: at 2018-12-25 18:41:03 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1545763265']
2018-12-25 18:41:03 [DEBUG   ] spawn_process: at 2018-12-25 18:41:03 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1545763265']
2018-12-25 18:41:03 [DEBUG   ] spawn_process: at 2018-12-25 18:41:03 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1545763265']
2018-12-25 18:41:03 [DEBUG   ] spawn_process: at 2018-12-25 18:41:03 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1545763265']
2018-12-25 18:41:03 [DEBUG   ] spawn_process: at 2018-12-25 18:41:03 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1545763265']
2018-12-25 18:41:03 [DEBUG   ] spawn_process: at 2018-12-25 18:41:03 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1545763265']
2018-12-25 18:41:03 [DEBUG   ] spawn_process: at 2018-12-25 18:41:03 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1545763265']
2018-12-25 18:41:03 [DEBUG   ] spawn_process: at 2018-12-25 18:41:03 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1545763265']
2018-12-25 18:41:03 [DEBUG   ] spawn_process: at 2018-12-25 18:41:03 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1545763265']
2018-12-25 18:41:03 [DEBUG   ] spawn_process: at 2018-12-25 18:41:03 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1545763265']
2018-12-25 18:41:03 [DEBUG   ] spawn_process: at 2018-12-25 18:41:03 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1545763265']
2018-12-25 18:41:03 [DEBUG   ] spawn_process: at 2018-12-25 18:41:03 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1545763265']
2018-12-25 18:41:03 [DEBUG   ] spawn_process: at 2018-12-25 18:41:03 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1545763265']
2018-12-25 18:41:03 [DEBUG   ] spawn_process: at 2018-12-25 18:41:03 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1545763265']
2018-12-25 18:41:03 [DEBUG   ] spawn_process: at 2018-12-25 18:41:03 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1545763265']
2018-12-25 18:41:03 [DEBUG   ] spawn_process: at 2018-12-25 18:41:03 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1545763265']
2018-12-25 18:41:03 [DEBUG   ] spawn_process: at 2018-12-25 18:41:03 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1545763265']
2018-12-25 18:41:03 [DEBUG   ] spawn_process: at 2018-12-25 18:41:03 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1545763265']
2018-12-25 18:41:03 [DEBUG   ] spawn_process: at 2018-12-25 18:41:03 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1545763265']
2018-12-25 18:41:03 [DEBUG   ] spawn_process: at 2018-12-25 18:41:03 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1545763265']
2018-12-25 18:41:03 [DEBUG   ] spawn_process: at 2018-12-25 18:41:03 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1545763265']
2018-12-25 18:41:03 [DEBUG   ] spawn_process: at 2018-12-25 18:41:03 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1545763265']
2018-12-25 18:41:03 [DEBUG   ] spawn_process: at 2018-12-25 18:41:03 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1545763265']
2018-12-25 18:41:03 [DEBUG   ] spawn_process: at 2018-12-25 18:41:03 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1545763265']
2018-12-25 18:41:03 [DEBUG   ] spawn_process: at 2018-12-25 18:41:03 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1545763265']
2018-12-25 18:41:03 [DEBUG   ] spawn_process: at 2018-12-25 18:41:03 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1545763265']
2018-12-25 18:41:03 [INFO    ] Finished spawning TBN in 0.049 s
2018-12-25 18:41:23 [DEBUG   ] Finished updating ant stats in 0.466 seconds
2018-12-25 18:41:43 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-25 18:41:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:41:48 [WARNING ] (13, 1, 'bot')
2018-12-25 18:41:48 [WARNING ] (13, 1, 'bot')
2018-12-25 18:41:48 [WARNING ] (13, 1, 'bot')
2018-12-25 18:41:48 [WARNING ] (13, 1, 'bot')
2018-12-25 18:41:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:41:48 [DEBUG   ] Finished updating board flags in 2.175 seconds
2018-12-25 18:42:03 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-25 18:42:23 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-25 18:42:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-25 18:42:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:42:48 [WARNING ] (13, 1, 'bot')
2018-12-25 18:42:48 [WARNING ] (13, 1, 'bot')
2018-12-25 18:42:48 [WARNING ] (13, 1, 'bot')
2018-12-25 18:42:48 [WARNING ] (13, 1, 'bot')
2018-12-25 18:42:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:42:48 [DEBUG   ] Finished updating board flags in 1.861 seconds
2018-12-25 18:43:04 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-25 18:43:24 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 18:43:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 18:43:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:43:48 [WARNING ] (13, 1, 'bot')
2018-12-25 18:43:48 [WARNING ] (13, 1, 'bot')
2018-12-25 18:43:48 [WARNING ] (13, 1, 'bot')
2018-12-25 18:43:48 [WARNING ] (13, 1, 'bot')
2018-12-25 18:43:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:43:48 [DEBUG   ] Finished updating board flags in 1.797 seconds
2018-12-25 18:44:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 18:44:20 [DEBUG   ] Got command RPT from MCS: ref #950911
2018-12-25 18:44:20 [DEBUG   ] summary = ERROR
2018-12-25 18:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950911  13 58477 67460765 A  ERRORERROR'
2018-12-25 18:44:20 [DEBUG   ] Got command RPT from MCS: ref #950912
2018-12-25 18:44:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 18:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950912  77 58477 67460969 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 18:44:21 [DEBUG   ] Got command RPT from MCS: ref #950913
2018-12-25 18:44:21 [DEBUG   ] summary = ERROR
2018-12-25 18:44:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950913  13 58477 67461161 A  ERRORERROR'
2018-12-25 18:44:21 [DEBUG   ] Got command RPT from MCS: ref #950915
2018-12-25 18:44:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 18:44:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950915  77 58477 67461365 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 18:44:21 [DEBUG   ] Got command RPT from MCS: ref #950917
2018-12-25 18:44:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 18:44:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950917  12 58477 67461569 A  ERRORB˜™š'
2018-12-25 18:44:24 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 18:44:44 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-25 18:44:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:44:48 [WARNING ] (13, 1, 'bot')
2018-12-25 18:44:48 [WARNING ] (13, 1, 'bot')
2018-12-25 18:44:48 [WARNING ] (13, 1, 'bot')
2018-12-25 18:44:48 [WARNING ] (13, 1, 'bot')
2018-12-25 18:44:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:44:48 [DEBUG   ] Finished updating board flags in 1.592 seconds
2018-12-25 18:45:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 18:45:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 18:45:44 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 18:45:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:45:48 [WARNING ] (13, 1, 'bot')
2018-12-25 18:45:48 [WARNING ] (13, 1, 'bot')
2018-12-25 18:45:48 [WARNING ] (13, 1, 'bot')
2018-12-25 18:45:48 [WARNING ] (13, 1, 'bot')
2018-12-25 18:45:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:45:48 [DEBUG   ] Finished updating board flags in 1.427 seconds
2018-12-25 18:45:58 [DEBUG   ] Got command RPT from MCS: ref #950925
2018-12-25 18:45:58 [DEBUG   ] summary = ERROR
2018-12-25 18:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950925  13 58477 67558449 A  ERRORERROR'
2018-12-25 18:45:58 [DEBUG   ] Got command RPT from MCS: ref #950926
2018-12-25 18:45:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 18:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950926  77 58477 67558450 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 18:46:04 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-25 18:46:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 18:46:44 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 18:46:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:46:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 18:46:48 [WARNING ] (13, 1, 'bot')
2018-12-25 18:46:48 [WARNING ] (13, 1, 'bot')
2018-12-25 18:46:48 [WARNING ] (13, 1, 'bot')
2018-12-25 18:46:48 [WARNING ] (13, 1, 'bot')
2018-12-25 18:46:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:46:48 [DEBUG   ] Finished updating board flags in 1.380 seconds
2018-12-25 18:47:04 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-25 18:47:24 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-25 18:47:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-25 18:47:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:47:48 [WARNING ] (13, 1, 'bot')
2018-12-25 18:47:48 [WARNING ] (13, 1, 'bot')
2018-12-25 18:47:48 [WARNING ] (13, 1, 'bot')
2018-12-25 18:47:48 [WARNING ] (13, 1, 'bot')
2018-12-25 18:47:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:47:48 [DEBUG   ] Finished updating board flags in 1.355 seconds
2018-12-25 18:48:04 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-25 18:48:24 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-25 18:48:44 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-12-25 18:48:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:48:49 [WARNING ] (13, 1, 'bot')
2018-12-25 18:48:49 [WARNING ] (13, 1, 'bot')
2018-12-25 18:48:49 [WARNING ] (13, 1, 'bot')
2018-12-25 18:48:49 [WARNING ] (13, 1, 'bot')
2018-12-25 18:48:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:48:49 [DEBUG   ] Finished updating board flags in 2.063 seconds
2018-12-25 18:49:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 18:49:20 [DEBUG   ] Got command RPT from MCS: ref #950946
2018-12-25 18:49:20 [DEBUG   ] summary = ERROR
2018-12-25 18:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950946  13 58477 67760849 A  ERRORERROR'
2018-12-25 18:49:21 [DEBUG   ] Got command RPT from MCS: ref #950947
2018-12-25 18:49:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 18:49:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950947  77 58477 67761041 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 18:49:21 [DEBUG   ] Got command RPT from MCS: ref #950948
2018-12-25 18:49:21 [DEBUG   ] summary = ERROR
2018-12-25 18:49:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950948  13 58477 67761245 A  ERRORERROR'
2018-12-25 18:49:21 [DEBUG   ] Got command RPT from MCS: ref #950949
2018-12-25 18:49:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 18:49:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950949  77 58477 67761449 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 18:49:21 [DEBUG   ] Got command RPT from MCS: ref #950950
2018-12-25 18:49:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 18:49:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950950  12 58477 67761641 A  ERRORB™™š'
2018-12-25 18:49:25 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 18:49:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 18:49:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:49:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-12-25 18:49:49 [WARNING ] (13, 1, 'bot')
2018-12-25 18:49:49 [WARNING ] (13, 1, 'bot')
2018-12-25 18:49:49 [WARNING ] (13, 1, 'bot')
2018-12-25 18:49:49 [WARNING ] (13, 1, 'bot')
2018-12-25 18:49:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:49:49 [DEBUG   ] Finished updating board flags in 1.987 seconds
2018-12-25 18:50:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 18:50:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 18:50:45 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 18:50:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:50:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-25 18:50:49 [WARNING ] (13, 1, 'bot')
2018-12-25 18:50:49 [WARNING ] (13, 1, 'bot')
2018-12-25 18:50:49 [WARNING ] (13, 1, 'bot')
2018-12-25 18:50:49 [WARNING ] (13, 1, 'bot')
2018-12-25 18:50:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:50:49 [DEBUG   ] Finished updating board flags in 1.816 seconds
2018-12-25 18:50:58 [DEBUG   ] Got command RPT from MCS: ref #950951
2018-12-25 18:50:58 [DEBUG   ] summary = ERROR
2018-12-25 18:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950951  13 58477 67858449 A  ERRORERROR'
2018-12-25 18:50:58 [DEBUG   ] Got command RPT from MCS: ref #950952
2018-12-25 18:50:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 18:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950952  77 58477 67858450 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 18:51:05 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-25 18:51:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 18:51:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 18:51:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:51:49 [WARNING ] (13, 1, 'bot')
2018-12-25 18:51:49 [WARNING ] (13, 1, 'bot')
2018-12-25 18:51:49 [WARNING ] (13, 1, 'bot')
2018-12-25 18:51:49 [WARNING ] (13, 1, 'bot')
2018-12-25 18:51:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:51:49 [DEBUG   ] Finished updating board flags in 1.794 seconds
2018-12-25 18:52:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 18:52:25 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-25 18:52:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 18:52:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-25 18:52:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:52:49 [WARNING ] (13, 1, 'bot')
2018-12-25 18:52:49 [WARNING ] (13, 1, 'bot')
2018-12-25 18:52:49 [WARNING ] (13, 1, 'bot')
2018-12-25 18:52:49 [WARNING ] (13, 1, 'bot')
2018-12-25 18:52:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:52:49 [DEBUG   ] Finished updating board flags in 1.609 seconds
2018-12-25 18:53:05 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 18:53:25 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 18:53:45 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-25 18:53:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:53:49 [WARNING ] (13, 1, 'bot')
2018-12-25 18:53:49 [WARNING ] (13, 1, 'bot')
2018-12-25 18:53:49 [WARNING ] (13, 1, 'bot')
2018-12-25 18:53:49 [WARNING ] (13, 1, 'bot')
2018-12-25 18:53:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:53:49 [DEBUG   ] Finished updating board flags in 1.689 seconds
2018-12-25 18:54:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 18:54:20 [DEBUG   ] Got command RPT from MCS: ref #950974
2018-12-25 18:54:20 [DEBUG   ] summary = ERROR
2018-12-25 18:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950974  13 58477 68060929 A  ERRORERROR'
2018-12-25 18:54:21 [DEBUG   ] Got command RPT from MCS: ref #950975
2018-12-25 18:54:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 18:54:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950975  77 58477 68061121 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 18:54:21 [DEBUG   ] Got command RPT from MCS: ref #950976
2018-12-25 18:54:21 [DEBUG   ] summary = ERROR
2018-12-25 18:54:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950976  13 58477 68061325 A  ERRORERROR'
2018-12-25 18:54:21 [DEBUG   ] Got command RPT from MCS: ref #950978
2018-12-25 18:54:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 18:54:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950978  77 58477 68061529 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 18:54:21 [DEBUG   ] Got command RPT from MCS: ref #950979
2018-12-25 18:54:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 18:54:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950979  12 58477 68061721 A  ERRORBš™š'
2018-12-25 18:54:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 18:54:45 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 18:54:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:54:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-25 18:54:49 [WARNING ] (13, 1, 'bot')
2018-12-25 18:54:49 [WARNING ] (13, 1, 'bot')
2018-12-25 18:54:49 [WARNING ] (13, 1, 'bot')
2018-12-25 18:54:49 [WARNING ] (13, 1, 'bot')
2018-12-25 18:54:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:54:49 [DEBUG   ] Finished updating board flags in 1.500 seconds
2018-12-25 18:55:05 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-25 18:55:25 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-25 18:55:45 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-25 18:55:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:55:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 18:55:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 18:55:49 [WARNING ] (13, 1, 'bot')
2018-12-25 18:55:49 [WARNING ] (13, 1, 'bot')
2018-12-25 18:55:49 [WARNING ] (13, 1, 'bot')
2018-12-25 18:55:49 [WARNING ] (13, 1, 'bot')
2018-12-25 18:55:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:55:49 [DEBUG   ] Finished updating board flags in 1.417 seconds
2018-12-25 18:55:58 [DEBUG   ] Got command RPT from MCS: ref #950988
2018-12-25 18:55:58 [DEBUG   ] summary = ERROR
2018-12-25 18:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950988  13 58477 68158445 A  ERRORERROR'
2018-12-25 18:55:58 [DEBUG   ] Got command RPT from MCS: ref #950989
2018-12-25 18:55:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 18:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   950989  77 58477 68158446 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 18:56:06 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-12-25 18:56:26 [DEBUG   ] Finished updating ant stats in 1.211 seconds
2018-12-25 18:56:46 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 18:56:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:56:49 [WARNING ] (13, 1, 'bot')
2018-12-25 18:56:49 [WARNING ] (13, 1, 'bot')
2018-12-25 18:56:49 [WARNING ] (13, 1, 'bot')
2018-12-25 18:56:49 [WARNING ] (13, 1, 'bot')
2018-12-25 18:56:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:56:49 [DEBUG   ] Finished updating board flags in 1.382 seconds
2018-12-25 18:57:06 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-25 18:57:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 18:57:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 18:57:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-25 18:57:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:57:49 [WARNING ] (13, 1, 'bot')
2018-12-25 18:57:49 [WARNING ] (13, 1, 'bot')
2018-12-25 18:57:49 [WARNING ] (13, 1, 'bot')
2018-12-25 18:57:49 [WARNING ] (13, 1, 'bot')
2018-12-25 18:57:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:57:49 [DEBUG   ] Finished updating board flags in 1.385 seconds
2018-12-25 18:58:06 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 18:58:26 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-25 18:58:46 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-25 18:58:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:58:50 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 18:58:50 [WARNING ] (13, 1, 'bot')
2018-12-25 18:58:50 [WARNING ] (13, 1, 'bot')
2018-12-25 18:58:50 [WARNING ] (13, 1, 'bot')
2018-12-25 18:58:50 [WARNING ] (13, 1, 'bot')
2018-12-25 18:58:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:58:50 [DEBUG   ] Finished updating board flags in 2.052 seconds
2018-12-25 18:59:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 18:59:21 [DEBUG   ] Got command RPT from MCS: ref #951009
2018-12-25 18:59:21 [DEBUG   ] summary = ERROR
2018-12-25 18:59:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951009  13 58477 68361009 A  ERRORERROR'
2018-12-25 18:59:21 [DEBUG   ] Got command RPT from MCS: ref #951010
2018-12-25 18:59:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 18:59:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951010  77 58477 68361201 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 18:59:21 [DEBUG   ] Got command RPT from MCS: ref #951011
2018-12-25 18:59:21 [DEBUG   ] summary = ERROR
2018-12-25 18:59:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951011  13 58477 68361405 A  ERRORERROR'
2018-12-25 18:59:21 [DEBUG   ] Got command RPT from MCS: ref #951012
2018-12-25 18:59:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 18:59:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951012  77 58477 68361609 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 18:59:21 [DEBUG   ] Got command RPT from MCS: ref #951013
2018-12-25 18:59:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 18:59:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951013  12 58477 68361813 A  ERRORBš™š'
2018-12-25 18:59:26 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 18:59:46 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-25 18:59:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 18:59:50 [WARNING ] (13, 1, 'bot')
2018-12-25 18:59:50 [WARNING ] (13, 1, 'bot')
2018-12-25 18:59:50 [WARNING ] (13, 1, 'bot')
2018-12-25 18:59:50 [WARNING ] (13, 1, 'bot')
2018-12-25 18:59:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 18:59:50 [DEBUG   ] Finished updating board flags in 1.976 seconds
2018-12-25 19:00:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 19:00:26 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 19:00:46 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-25 19:00:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:00:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-12-25 19:00:50 [WARNING ] (13, 1, 'bot')
2018-12-25 19:00:50 [WARNING ] (13, 1, 'bot')
2018-12-25 19:00:50 [WARNING ] (13, 1, 'bot')
2018-12-25 19:00:50 [WARNING ] (13, 1, 'bot')
2018-12-25 19:00:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:00:50 [DEBUG   ] Finished updating board flags in 1.820 seconds
2018-12-25 19:00:58 [DEBUG   ] Got command RPT from MCS: ref #951018
2018-12-25 19:00:58 [DEBUG   ] summary = ERROR
2018-12-25 19:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951018  13 58477 68458453 A  ERRORERROR'
2018-12-25 19:00:58 [DEBUG   ] Got command RPT from MCS: ref #951019
2018-12-25 19:00:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 19:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951019  77 58477 68458454 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 19:01:07 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-25 19:01:27 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-25 19:01:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 19:01:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:01:50 [WARNING ] (13, 1, 'bot')
2018-12-25 19:01:50 [WARNING ] (13, 1, 'bot')
2018-12-25 19:01:50 [WARNING ] (13, 1, 'bot')
2018-12-25 19:01:50 [WARNING ] (13, 1, 'bot')
2018-12-25 19:01:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:01:50 [DEBUG   ] Finished updating board flags in 1.787 seconds
2018-12-25 19:02:07 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-25 19:02:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 19:02:47 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 19:02:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:02:50 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 19:02:50 [WARNING ] (13, 1, 'bot')
2018-12-25 19:02:50 [WARNING ] (13, 1, 'bot')
2018-12-25 19:02:50 [WARNING ] (13, 1, 'bot')
2018-12-25 19:02:50 [WARNING ] (13, 1, 'bot')
2018-12-25 19:02:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:02:50 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-12-25 19:03:07 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2018-12-25 19:03:27 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-25 19:03:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 19:03:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 19:03:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:03:50 [WARNING ] (13, 1, 'bot')
2018-12-25 19:03:50 [WARNING ] (13, 1, 'bot')
2018-12-25 19:03:50 [WARNING ] (13, 1, 'bot')
2018-12-25 19:03:50 [WARNING ] (13, 1, 'bot')
2018-12-25 19:03:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:03:50 [DEBUG   ] Finished updating board flags in 1.581 seconds
2018-12-25 19:04:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 19:04:21 [DEBUG   ] Got command RPT from MCS: ref #951041
2018-12-25 19:04:21 [DEBUG   ] summary = ERROR
2018-12-25 19:04:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951041  13 58477 68661085 A  ERRORERROR'
2018-12-25 19:04:21 [DEBUG   ] Got command RPT from MCS: ref #951042
2018-12-25 19:04:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 19:04:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951042  77 58477 68661289 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 19:04:21 [DEBUG   ] Got command RPT from MCS: ref #951043
2018-12-25 19:04:21 [DEBUG   ] summary = ERROR
2018-12-25 19:04:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951043  13 58477 68661493 A  ERRORERROR'
2018-12-25 19:04:21 [DEBUG   ] Got command RPT from MCS: ref #951045
2018-12-25 19:04:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 19:04:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951045  77 58477 68661685 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 19:04:21 [DEBUG   ] Got command RPT from MCS: ref #951046
2018-12-25 19:04:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 19:04:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951046  12 58477 68661889 A  ERRORBš™š'
2018-12-25 19:04:27 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 19:04:47 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-25 19:04:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:04:50 [WARNING ] (13, 1, 'bot')
2018-12-25 19:04:50 [WARNING ] (13, 1, 'bot')
2018-12-25 19:04:50 [WARNING ] (13, 1, 'bot')
2018-12-25 19:04:50 [WARNING ] (13, 1, 'bot')
2018-12-25 19:04:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:04:50 [DEBUG   ] Finished updating board flags in 1.422 seconds
2018-12-25 19:05:08 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-25 19:05:28 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-25 19:05:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 19:05:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:05:50 [WARNING ] (13, 1, 'bot')
2018-12-25 19:05:50 [WARNING ] (13, 1, 'bot')
2018-12-25 19:05:50 [WARNING ] (13, 1, 'bot')
2018-12-25 19:05:50 [WARNING ] (13, 1, 'bot')
2018-12-25 19:05:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:05:50 [DEBUG   ] Finished updating board flags in 1.407 seconds
2018-12-25 19:05:58 [DEBUG   ] Got command RPT from MCS: ref #951051
2018-12-25 19:05:58 [DEBUG   ] summary = ERROR
2018-12-25 19:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951051  13 58477 68758457 A  ERRORERROR'
2018-12-25 19:05:58 [DEBUG   ] Got command RPT from MCS: ref #951052
2018-12-25 19:05:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 19:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951052  77 58477 68758458 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 19:06:08 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-25 19:06:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 19:06:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 19:06:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:06:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-25 19:06:50 [WARNING ] (13, 1, 'bot')
2018-12-25 19:06:50 [WARNING ] (13, 1, 'bot')
2018-12-25 19:06:50 [WARNING ] (13, 1, 'bot')
2018-12-25 19:06:50 [WARNING ] (13, 1, 'bot')
2018-12-25 19:06:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:06:50 [DEBUG   ] Finished updating board flags in 1.389 seconds
2018-12-25 19:07:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 19:07:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 19:07:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 19:07:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:07:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:07:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:07:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:07:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:07:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:07:51 [DEBUG   ] Finished updating board flags in 2.209 seconds
2018-12-25 19:08:08 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 19:08:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 19:08:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 19:08:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:08:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 19:08:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 19:08:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:08:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:08:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:08:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:08:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:08:51 [DEBUG   ] Finished updating board flags in 2.223 seconds
2018-12-25 19:09:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 19:09:21 [DEBUG   ] Got command RPT from MCS: ref #951072
2018-12-25 19:09:21 [DEBUG   ] summary = ERROR
2018-12-25 19:09:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951072  13 58477 68961173 A  ERRORERROR'
2018-12-25 19:09:21 [DEBUG   ] Got command RPT from MCS: ref #951073
2018-12-25 19:09:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 19:09:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951073  77 58477 68961365 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 19:09:21 [DEBUG   ] Got command RPT from MCS: ref #951074
2018-12-25 19:09:21 [DEBUG   ] summary = ERROR
2018-12-25 19:09:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951074  13 58477 68961569 A  ERRORERROR'
2018-12-25 19:09:21 [DEBUG   ] Got command RPT from MCS: ref #951075
2018-12-25 19:09:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 19:09:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951075  77 58477 68961773 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 19:09:21 [DEBUG   ] Got command RPT from MCS: ref #951076
2018-12-25 19:09:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 19:09:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951076  12 58477 68961977 A  ERRORB™™š'
2018-12-25 19:09:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 19:09:48 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-25 19:09:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:09:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-25 19:09:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:09:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:09:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:09:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:09:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:09:51 [DEBUG   ] Finished updating board flags in 2.170 seconds
2018-12-25 19:10:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 19:10:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 19:10:48 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 19:10:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:10:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:10:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:10:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:10:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:10:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:10:51 [DEBUG   ] Finished updating board flags in 2.024 seconds
2018-12-25 19:10:58 [DEBUG   ] Got command RPT from MCS: ref #951081
2018-12-25 19:10:58 [DEBUG   ] summary = ERROR
2018-12-25 19:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951081  13 58477 69058453 A  ERRORERROR'
2018-12-25 19:10:58 [DEBUG   ] Got command RPT from MCS: ref #951082
2018-12-25 19:10:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 19:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951082  77 58477 69058454 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 19:11:08 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-25 19:11:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 19:11:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 19:11:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 19:11:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:11:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:11:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:11:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:11:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:11:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:11:51 [DEBUG   ] Finished updating board flags in 1.969 seconds
2018-12-25 19:12:08 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 19:12:28 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-25 19:12:49 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-25 19:12:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:12:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:12:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:12:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:12:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:12:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:12:51 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-12-25 19:13:09 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-25 19:13:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 19:13:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 19:13:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:13:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:13:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:13:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:13:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:13:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:13:51 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-12-25 19:14:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 19:14:21 [DEBUG   ] Got command RPT from MCS: ref #951104
2018-12-25 19:14:21 [DEBUG   ] summary = ERROR
2018-12-25 19:14:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951104  13 58477 69261245 A  ERRORERROR'
2018-12-25 19:14:21 [DEBUG   ] Got command RPT from MCS: ref #951105
2018-12-25 19:14:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 19:14:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951105  77 58477 69261449 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 19:14:21 [DEBUG   ] Got command RPT from MCS: ref #951106
2018-12-25 19:14:21 [DEBUG   ] summary = ERROR
2018-12-25 19:14:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951106  13 58477 69261653 A  ERRORERROR'
2018-12-25 19:14:21 [DEBUG   ] Got command RPT from MCS: ref #951108
2018-12-25 19:14:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 19:14:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951108  77 58477 69261845 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 19:14:22 [DEBUG   ] Got command RPT from MCS: ref #951110
2018-12-25 19:14:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 19:14:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951110  12 58477 69262049 A  ERRORB™™š'
2018-12-25 19:14:29 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 19:14:49 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-25 19:14:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:14:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:14:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:14:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:14:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:14:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:14:51 [DEBUG   ] Finished updating board flags in 1.893 seconds
2018-12-25 19:15:09 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-25 19:15:29 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 19:15:49 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-25 19:15:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:15:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 19:15:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-25 19:15:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:15:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:15:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:15:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:15:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:15:51 [DEBUG   ] Finished updating board flags in 1.808 seconds
2018-12-25 19:15:58 [DEBUG   ] Got command RPT from MCS: ref #951118
2018-12-25 19:15:58 [DEBUG   ] summary = ERROR
2018-12-25 19:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951118  13 58477 69358450 A  ERRORERROR'
2018-12-25 19:15:58 [DEBUG   ] Got command RPT from MCS: ref #951119
2018-12-25 19:15:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 19:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951119  77 58477 69358450 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 19:16:09 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2018-12-25 19:16:29 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-25 19:16:50 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-25 19:16:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:16:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:16:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:16:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:16:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:16:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:16:51 [DEBUG   ] Finished updating board flags in 1.678 seconds
2018-12-25 19:17:10 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-25 19:17:30 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 19:17:50 [DEBUG   ] Finished updating ant stats in 1.250 seconds
2018-12-25 19:17:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:17:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:17:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:17:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:17:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:17:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:17:51 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-12-25 19:18:10 [DEBUG   ] Finished updating ant stats in 1.155 seconds
2018-12-25 19:18:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 19:18:50 [DEBUG   ] Finished updating ant stats in 1.048 seconds
2018-12-25 19:18:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:18:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 19:18:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:18:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:18:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:18:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:18:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:18:51 [DEBUG   ] Finished updating board flags in 1.594 seconds
2018-12-25 19:19:10 [DEBUG   ] Finished updating ant stats in 0.956 seconds
2018-12-25 19:19:21 [DEBUG   ] Got command RPT from MCS: ref #951139
2018-12-25 19:19:21 [DEBUG   ] summary = ERROR
2018-12-25 19:19:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951139  13 58477 69561325 A  ERRORERROR'
2018-12-25 19:19:21 [DEBUG   ] Got command RPT from MCS: ref #951140
2018-12-25 19:19:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 19:19:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951140  77 58477 69561529 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 19:19:21 [DEBUG   ] Got command RPT from MCS: ref #951141
2018-12-25 19:19:21 [DEBUG   ] summary = ERROR
2018-12-25 19:19:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951141  13 58477 69561733 A  ERRORERROR'
2018-12-25 19:19:21 [DEBUG   ] Got command RPT from MCS: ref #951142
2018-12-25 19:19:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 19:19:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951142  77 58477 69561937 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 19:19:22 [DEBUG   ] Got command RPT from MCS: ref #951143
2018-12-25 19:19:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 19:19:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951143  12 58477 69562129 A  ERRORB™™š'
2018-12-25 19:19:30 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-25 19:19:50 [DEBUG   ] Finished updating ant stats in 0.649 seconds
2018-12-25 19:19:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 19:19:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:19:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-12-25 19:19:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:19:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:19:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:19:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:19:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:19:51 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-12-25 19:20:10 [DEBUG   ] Finished updating ant stats in 0.555 seconds
2018-12-25 19:20:30 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-25 19:20:50 [DEBUG   ] Finished updating ant stats in 0.440 seconds
2018-12-25 19:20:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:20:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:20:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:20:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:20:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:20:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:20:51 [DEBUG   ] Finished updating board flags in 1.388 seconds
2018-12-25 19:20:58 [DEBUG   ] Got command RPT from MCS: ref #951144
2018-12-25 19:20:58 [DEBUG   ] summary = ERROR
2018-12-25 19:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951144  13 58477 69658461 A  ERRORERROR'
2018-12-25 19:20:58 [DEBUG   ] Got command RPT from MCS: ref #951145
2018-12-25 19:20:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 19:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951145  77 58477 69658462 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 19:21:11 [DEBUG   ] Finished updating ant stats in 1.364 seconds
2018-12-25 19:21:31 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 19:21:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:21:51 [DEBUG   ] Finished updating ant stats in 1.244 seconds
2018-12-25 19:21:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:21:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:21:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:21:51 [WARNING ] (13, 1, 'bot')
2018-12-25 19:21:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:21:51 [DEBUG   ] Finished updating board flags in 1.424 seconds
2018-12-25 19:22:11 [DEBUG   ] Finished updating ant stats in 1.158 seconds
2018-12-25 19:22:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 19:22:51 [DEBUG   ] Finished updating ant stats in 1.051 seconds
2018-12-25 19:22:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:22:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:22:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:22:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:22:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:22:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:22:52 [DEBUG   ] Finished updating board flags in 2.190 seconds
2018-12-25 19:23:11 [DEBUG   ] Finished updating ant stats in 0.955 seconds
2018-12-25 19:23:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 19:23:51 [DEBUG   ] Finished updating ant stats in 0.848 seconds
2018-12-25 19:23:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:23:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-25 19:23:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:23:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:23:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:23:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:23:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:23:52 [DEBUG   ] Finished updating board flags in 1.990 seconds
2018-12-25 19:24:11 [DEBUG   ] Finished updating ant stats in 0.756 seconds
2018-12-25 19:24:21 [DEBUG   ] Got command RPT from MCS: ref #951167
2018-12-25 19:24:21 [DEBUG   ] summary = ERROR
2018-12-25 19:24:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951167  13 58477 69861405 A  ERRORERROR'
2018-12-25 19:24:21 [DEBUG   ] Got command RPT from MCS: ref #951168
2018-12-25 19:24:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 19:24:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951168  77 58477 69861609 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 19:24:21 [DEBUG   ] Got command RPT from MCS: ref #951169
2018-12-25 19:24:21 [DEBUG   ] summary = ERROR
2018-12-25 19:24:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951169  13 58477 69861813 A  ERRORERROR'
2018-12-25 19:24:22 [DEBUG   ] Got command RPT from MCS: ref #951171
2018-12-25 19:24:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 19:24:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951171  77 58477 69862005 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 19:24:22 [DEBUG   ] Got command RPT from MCS: ref #951172
2018-12-25 19:24:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 19:24:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951172  12 58477 69862209 A  ERRORB˜™š'
2018-12-25 19:24:32 [DEBUG   ] Finished updating ant stats in 1.598 seconds
2018-12-25 19:24:51 [DEBUG   ] Finished updating ant stats in 0.452 seconds
2018-12-25 19:24:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:24:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:24:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:24:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:24:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:24:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:24:52 [DEBUG   ] Finished updating board flags in 1.821 seconds
2018-12-25 19:25:12 [DEBUG   ] Finished updating ant stats in 1.360 seconds
2018-12-25 19:25:32 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-25 19:25:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:25:52 [DEBUG   ] Finished updating ant stats in 1.047 seconds
2018-12-25 19:25:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:25:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:25:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:25:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:25:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:25:52 [DEBUG   ] Finished updating board flags in 1.850 seconds
2018-12-25 19:25:58 [DEBUG   ] Got command RPT from MCS: ref #951181
2018-12-25 19:25:58 [DEBUG   ] summary = ERROR
2018-12-25 19:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951181  13 58477 69958453 A  ERRORERROR'
2018-12-25 19:25:58 [DEBUG   ] Got command RPT from MCS: ref #951182
2018-12-25 19:25:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 19:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951182  77 58477 69958454 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 19:26:12 [DEBUG   ] Finished updating ant stats in 0.958 seconds
2018-12-25 19:26:32 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 19:26:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:26:52 [DEBUG   ] Finished updating ant stats in 0.844 seconds
2018-12-25 19:26:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:26:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:26:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:26:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:26:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:26:52 [DEBUG   ] Finished updating board flags in 1.793 seconds
2018-12-25 19:27:12 [DEBUG   ] Finished updating ant stats in 0.754 seconds
2018-12-25 19:27:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 19:27:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:27:52 [DEBUG   ] Finished updating ant stats in 0.648 seconds
2018-12-25 19:27:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:27:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:27:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:27:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:27:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:27:52 [DEBUG   ] Finished updating board flags in 1.631 seconds
2018-12-25 19:28:12 [DEBUG   ] Finished updating ant stats in 0.555 seconds
2018-12-25 19:28:32 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-25 19:28:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:28:52 [DEBUG   ] Finished updating ant stats in 0.446 seconds
2018-12-25 19:28:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:28:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:28:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:28:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:28:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:28:52 [DEBUG   ] Finished updating board flags in 1.570 seconds
2018-12-25 19:29:13 [DEBUG   ] Finished updating ant stats in 1.358 seconds
2018-12-25 19:29:21 [DEBUG   ] Got command RPT from MCS: ref #951202
2018-12-25 19:29:21 [DEBUG   ] summary = ERROR
2018-12-25 19:29:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951202  13 58477 70161485 A  ERRORERROR'
2018-12-25 19:29:21 [DEBUG   ] Got command RPT from MCS: ref #951203
2018-12-25 19:29:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 19:29:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951203  77 58477 70161689 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 19:29:21 [DEBUG   ] Got command RPT from MCS: ref #951204
2018-12-25 19:29:21 [DEBUG   ] summary = ERROR
2018-12-25 19:29:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951204  13 58477 70161897 A  ERRORERROR'
2018-12-25 19:29:22 [DEBUG   ] Got command RPT from MCS: ref #951205
2018-12-25 19:29:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 19:29:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951205  77 58477 70162089 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 19:29:22 [DEBUG   ] Got command RPT from MCS: ref #951206
2018-12-25 19:29:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 19:29:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951206  12 58477 70162293 A  ERRORB˜™š'
2018-12-25 19:29:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 19:29:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:29:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 19:29:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:29:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:29:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:29:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:29:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:29:52 [DEBUG   ] Finished updating board flags in 1.426 seconds
2018-12-25 19:29:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 19:30:13 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 19:30:33 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-25 19:30:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:30:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 19:30:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:30:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:30:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:30:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:30:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:30:52 [DEBUG   ] Finished updating board flags in 1.425 seconds
2018-12-25 19:30:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 19:30:58 [DEBUG   ] Got command RPT from MCS: ref #951211
2018-12-25 19:30:58 [DEBUG   ] summary = ERROR
2018-12-25 19:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951211  13 58477 70258453 A  ERRORERROR'
2018-12-25 19:30:58 [DEBUG   ] Got command RPT from MCS: ref #951212
2018-12-25 19:30:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 19:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951212  77 58477 70258454 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 19:31:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 19:31:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 19:31:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:31:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 19:31:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:31:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:31:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:31:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:31:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:31:52 [DEBUG   ] Finished updating board flags in 1.424 seconds
2018-12-25 19:31:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 19:32:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 19:32:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 19:32:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:32:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:32:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:32:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:32:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:32:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:32:52 [DEBUG   ] Finished updating board flags in 1.437 seconds
2018-12-25 19:32:53 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-25 19:33:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 19:33:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 19:33:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:33:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:33:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:33:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:33:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:33:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:33:52 [DEBUG   ] Finished updating board flags in 1.427 seconds
2018-12-25 19:33:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 19:34:13 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 19:34:21 [DEBUG   ] Got command RPT from MCS: ref #951234
2018-12-25 19:34:21 [DEBUG   ] summary = ERROR
2018-12-25 19:34:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951234  13 58477 70461573 A  ERRORERROR'
2018-12-25 19:34:21 [DEBUG   ] Got command RPT from MCS: ref #951235
2018-12-25 19:34:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 19:34:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951235  77 58477 70461765 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 19:34:21 [DEBUG   ] Got command RPT from MCS: ref #951236
2018-12-25 19:34:21 [DEBUG   ] summary = ERROR
2018-12-25 19:34:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951236  13 58477 70461969 A  ERRORERROR'
2018-12-25 19:34:22 [DEBUG   ] Got command RPT from MCS: ref #951238
2018-12-25 19:34:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 19:34:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951238  77 58477 70462173 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 19:34:22 [DEBUG   ] Got command RPT from MCS: ref #951239
2018-12-25 19:34:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 19:34:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951239  12 58477 70462377 A  ERRORB˜™š'
2018-12-25 19:34:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 19:34:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:34:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:34:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:34:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:34:52 [WARNING ] (13, 1, 'bot')
2018-12-25 19:34:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:34:52 [DEBUG   ] Finished updating board flags in 1.527 seconds
2018-12-25 19:34:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 19:35:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 19:35:33 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 19:35:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:35:53 [DEBUG   ] Finished updating ant stats in 0.842 seconds
2018-12-25 19:35:53 [WARNING ] (13, 1, 'bot')
2018-12-25 19:35:53 [WARNING ] (13, 1, 'bot')
2018-12-25 19:35:53 [WARNING ] (13, 1, 'bot')
2018-12-25 19:35:53 [WARNING ] (13, 1, 'bot')
2018-12-25 19:35:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:35:53 [DEBUG   ] Finished updating board flags in 2.172 seconds
2018-12-25 19:35:58 [DEBUG   ] Got command RPT from MCS: ref #951244
2018-12-25 19:35:58 [DEBUG   ] summary = ERROR
2018-12-25 19:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951244  13 58477 70558453 A  ERRORERROR'
2018-12-25 19:35:58 [DEBUG   ] Got command RPT from MCS: ref #951245
2018-12-25 19:35:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 19:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951245  77 58477 70558454 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 19:36:13 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2018-12-25 19:36:33 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 19:36:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 19:36:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:36:53 [DEBUG   ] Finished updating ant stats in 0.648 seconds
2018-12-25 19:36:53 [WARNING ] (13, 1, 'bot')
2018-12-25 19:36:53 [WARNING ] (13, 1, 'bot')
2018-12-25 19:36:53 [WARNING ] (13, 1, 'bot')
2018-12-25 19:36:53 [WARNING ] (13, 1, 'bot')
2018-12-25 19:36:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:36:53 [DEBUG   ] Finished updating board flags in 1.971 seconds
2018-12-25 19:37:13 [DEBUG   ] Finished updating ant stats in 0.557 seconds
2018-12-25 19:37:33 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-25 19:37:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:37:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 19:37:53 [WARNING ] (13, 1, 'bot')
2018-12-25 19:37:53 [WARNING ] (13, 1, 'bot')
2018-12-25 19:37:53 [WARNING ] (13, 1, 'bot')
2018-12-25 19:37:53 [WARNING ] (13, 1, 'bot')
2018-12-25 19:37:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:37:53 [DEBUG   ] Finished updating board flags in 1.828 seconds
2018-12-25 19:37:54 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-25 19:38:14 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-25 19:38:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 19:38:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:38:53 [WARNING ] (13, 1, 'bot')
2018-12-25 19:38:53 [WARNING ] (13, 1, 'bot')
2018-12-25 19:38:53 [WARNING ] (13, 1, 'bot')
2018-12-25 19:38:53 [WARNING ] (13, 1, 'bot')
2018-12-25 19:38:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:38:53 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-12-25 19:38:54 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 19:39:14 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-25 19:39:21 [DEBUG   ] Got command RPT from MCS: ref #951265
2018-12-25 19:39:21 [DEBUG   ] summary = ERROR
2018-12-25 19:39:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951265  13 58477 70761657 A  ERRORERROR'
2018-12-25 19:39:21 [DEBUG   ] Got command RPT from MCS: ref #951266
2018-12-25 19:39:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 19:39:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951266  77 58477 70761849 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 19:39:22 [DEBUG   ] Got command RPT from MCS: ref #951267
2018-12-25 19:39:22 [DEBUG   ] summary = ERROR
2018-12-25 19:39:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951267  13 58477 70762053 A  ERRORERROR'
2018-12-25 19:39:22 [DEBUG   ] Got command RPT from MCS: ref #951268
2018-12-25 19:39:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 19:39:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951268  77 58477 70762257 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 19:39:22 [DEBUG   ] Got command RPT from MCS: ref #951269
2018-12-25 19:39:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 19:39:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951269  12 58477 70762461 A  ERRORB˜™š'
2018-12-25 19:39:34 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 19:39:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:39:53 [WARNING ] (13, 1, 'bot')
2018-12-25 19:39:53 [WARNING ] (13, 1, 'bot')
2018-12-25 19:39:53 [WARNING ] (13, 1, 'bot')
2018-12-25 19:39:53 [WARNING ] (13, 1, 'bot')
2018-12-25 19:39:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:39:53 [DEBUG   ] Finished updating board flags in 1.827 seconds
2018-12-25 19:39:54 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 19:40:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 19:40:34 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-25 19:40:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:40:53 [WARNING ] (13, 1, 'bot')
2018-12-25 19:40:53 [WARNING ] (13, 1, 'bot')
2018-12-25 19:40:53 [WARNING ] (13, 1, 'bot')
2018-12-25 19:40:53 [WARNING ] (13, 1, 'bot')
2018-12-25 19:40:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:40:53 [DEBUG   ] Finished updating board flags in 1.770 seconds
2018-12-25 19:40:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 19:40:58 [DEBUG   ] Got command RPT from MCS: ref #951274
2018-12-25 19:40:58 [DEBUG   ] summary = ERROR
2018-12-25 19:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951274  13 58477 70858461 A  ERRORERROR'
2018-12-25 19:40:58 [DEBUG   ] Got command RPT from MCS: ref #951275
2018-12-25 19:40:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 19:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951275  77 58477 70858462 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 19:41:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 19:41:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 19:41:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:41:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 19:41:53 [WARNING ] (13, 1, 'bot')
2018-12-25 19:41:53 [WARNING ] (13, 1, 'bot')
2018-12-25 19:41:53 [WARNING ] (13, 1, 'bot')
2018-12-25 19:41:53 [WARNING ] (13, 1, 'bot')
2018-12-25 19:41:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:41:53 [DEBUG   ] Finished updating board flags in 1.626 seconds
2018-12-25 19:41:54 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-25 19:42:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 19:42:34 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 19:42:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:42:53 [WARNING ] (13, 1, 'bot')
2018-12-25 19:42:53 [WARNING ] (13, 1, 'bot')
2018-12-25 19:42:53 [WARNING ] (13, 1, 'bot')
2018-12-25 19:42:53 [WARNING ] (13, 1, 'bot')
2018-12-25 19:42:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:42:53 [DEBUG   ] Finished updating board flags in 1.502 seconds
2018-12-25 19:42:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 19:43:14 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-25 19:43:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-25 19:43:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:43:53 [WARNING ] (13, 1, 'bot')
2018-12-25 19:43:53 [WARNING ] (13, 1, 'bot')
2018-12-25 19:43:53 [WARNING ] (13, 1, 'bot')
2018-12-25 19:43:53 [WARNING ] (13, 1, 'bot')
2018-12-25 19:43:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:43:53 [DEBUG   ] Finished updating board flags in 1.420 seconds
2018-12-25 19:43:55 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-12-25 19:44:14 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-12-25 19:44:21 [DEBUG   ] Got command RPT from MCS: ref #951297
2018-12-25 19:44:21 [DEBUG   ] summary = ERROR
2018-12-25 19:44:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951297  13 58477 71061737 A  ERRORERROR'
2018-12-25 19:44:21 [DEBUG   ] Got command RPT from MCS: ref #951298
2018-12-25 19:44:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 19:44:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951298  77 58477 71061929 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 19:44:22 [DEBUG   ] Got command RPT from MCS: ref #951299
2018-12-25 19:44:22 [DEBUG   ] summary = ERROR
2018-12-25 19:44:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951299  13 58477 71062133 A  ERRORERROR'
2018-12-25 19:44:22 [DEBUG   ] Got command RPT from MCS: ref #951301
2018-12-25 19:44:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 19:44:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951301  77 58477 71062337 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 19:44:22 [DEBUG   ] Got command RPT from MCS: ref #951302
2018-12-25 19:44:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 19:44:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951302  12 58477 71062541 A  ERRORB—™š'
2018-12-25 19:44:34 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-12-25 19:44:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:44:53 [WARNING ] (13, 1, 'bot')
2018-12-25 19:44:53 [WARNING ] (13, 1, 'bot')
2018-12-25 19:44:53 [WARNING ] (13, 1, 'bot')
2018-12-25 19:44:53 [WARNING ] (13, 1, 'bot')
2018-12-25 19:44:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:44:53 [DEBUG   ] Finished updating board flags in 1.384 seconds
2018-12-25 19:44:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 19:45:15 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 19:45:35 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-25 19:45:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:45:53 [WARNING ] (13, 1, 'bot')
2018-12-25 19:45:53 [WARNING ] (13, 1, 'bot')
2018-12-25 19:45:53 [WARNING ] (13, 1, 'bot')
2018-12-25 19:45:53 [WARNING ] (13, 1, 'bot')
2018-12-25 19:45:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:45:53 [DEBUG   ] Finished updating board flags in 1.361 seconds
2018-12-25 19:45:55 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-25 19:45:58 [DEBUG   ] Got command RPT from MCS: ref #951311
2018-12-25 19:45:58 [DEBUG   ] summary = ERROR
2018-12-25 19:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951311  13 58477 71158457 A  ERRORERROR'
2018-12-25 19:45:58 [DEBUG   ] Got command RPT from MCS: ref #951312
2018-12-25 19:45:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 19:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951312  77 58477 71158458 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 19:46:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 19:46:35 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 19:46:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:46:54 [WARNING ] (13, 1, 'bot')
2018-12-25 19:46:54 [WARNING ] (13, 1, 'bot')
2018-12-25 19:46:54 [WARNING ] (13, 1, 'bot')
2018-12-25 19:46:54 [WARNING ] (13, 1, 'bot')
2018-12-25 19:46:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:46:54 [DEBUG   ] Finished updating board flags in 2.128 seconds
2018-12-25 19:46:55 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-25 19:47:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 19:47:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 19:47:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:47:54 [WARNING ] (13, 1, 'bot')
2018-12-25 19:47:54 [WARNING ] (13, 1, 'bot')
2018-12-25 19:47:54 [WARNING ] (13, 1, 'bot')
2018-12-25 19:47:54 [WARNING ] (13, 1, 'bot')
2018-12-25 19:47:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:47:54 [DEBUG   ] Finished updating board flags in 1.929 seconds
2018-12-25 19:47:55 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 19:48:15 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-25 19:48:35 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-25 19:48:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:48:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 19:48:54 [WARNING ] (13, 1, 'bot')
2018-12-25 19:48:54 [WARNING ] (13, 1, 'bot')
2018-12-25 19:48:54 [WARNING ] (13, 1, 'bot')
2018-12-25 19:48:54 [WARNING ] (13, 1, 'bot')
2018-12-25 19:48:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:48:54 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-12-25 19:48:56 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-25 19:49:16 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-25 19:49:21 [DEBUG   ] Got command RPT from MCS: ref #951332
2018-12-25 19:49:21 [DEBUG   ] summary = ERROR
2018-12-25 19:49:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951332  13 58477 71361813 A  ERRORERROR'
2018-12-25 19:49:22 [DEBUG   ] Got command RPT from MCS: ref #951333
2018-12-25 19:49:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 19:49:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951333  77 58477 71362017 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 19:49:22 [DEBUG   ] Got command RPT from MCS: ref #951334
2018-12-25 19:49:22 [DEBUG   ] summary = ERROR
2018-12-25 19:49:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951334  13 58477 71362209 A  ERRORERROR'
2018-12-25 19:49:22 [DEBUG   ] Got command RPT from MCS: ref #951335
2018-12-25 19:49:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 19:49:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951335  77 58477 71362413 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 19:49:22 [DEBUG   ] Got command RPT from MCS: ref #951336
2018-12-25 19:49:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 19:49:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951336  12 58477 71362617 A  ERRORB™™š'
2018-12-25 19:49:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 19:49:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:49:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-25 19:49:54 [WARNING ] (13, 1, 'bot')
2018-12-25 19:49:54 [WARNING ] (13, 1, 'bot')
2018-12-25 19:49:54 [WARNING ] (13, 1, 'bot')
2018-12-25 19:49:54 [WARNING ] (13, 1, 'bot')
2018-12-25 19:49:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:49:54 [DEBUG   ] Finished updating board flags in 1.790 seconds
2018-12-25 19:49:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 19:50:16 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 19:50:36 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-25 19:50:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:50:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 19:50:54 [WARNING ] (13, 1, 'bot')
2018-12-25 19:50:54 [WARNING ] (13, 1, 'bot')
2018-12-25 19:50:54 [WARNING ] (13, 1, 'bot')
2018-12-25 19:50:54 [WARNING ] (13, 1, 'bot')
2018-12-25 19:50:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:50:54 [DEBUG   ] Finished updating board flags in 1.556 seconds
2018-12-25 19:50:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 19:50:58 [DEBUG   ] Got command RPT from MCS: ref #951337
2018-12-25 19:50:58 [DEBUG   ] summary = ERROR
2018-12-25 19:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951337  13 58477 71458465 A  ERRORERROR'
2018-12-25 19:50:58 [DEBUG   ] Got command RPT from MCS: ref #951338
2018-12-25 19:50:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 19:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951338  77 58477 71458466 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 19:51:16 [DEBUG   ] Finished updating ant stats in 0.991 seconds
2018-12-25 19:51:36 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 19:51:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:51:54 [WARNING ] (13, 1, 'bot')
2018-12-25 19:51:54 [WARNING ] (13, 1, 'bot')
2018-12-25 19:51:54 [WARNING ] (13, 1, 'bot')
2018-12-25 19:51:54 [WARNING ] (13, 1, 'bot')
2018-12-25 19:51:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:51:54 [DEBUG   ] Finished updating board flags in 1.426 seconds
2018-12-25 19:51:56 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-25 19:52:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 19:52:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 19:52:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-25 19:52:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:52:54 [WARNING ] (13, 1, 'bot')
2018-12-25 19:52:54 [WARNING ] (13, 1, 'bot')
2018-12-25 19:52:54 [WARNING ] (13, 1, 'bot')
2018-12-25 19:52:54 [WARNING ] (13, 1, 'bot')
2018-12-25 19:52:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:52:54 [DEBUG   ] Finished updating board flags in 1.379 seconds
2018-12-25 19:52:56 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 19:53:16 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-25 19:53:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-25 19:53:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:53:54 [WARNING ] (13, 1, 'bot')
2018-12-25 19:53:54 [WARNING ] (13, 1, 'bot')
2018-12-25 19:53:54 [WARNING ] (13, 1, 'bot')
2018-12-25 19:53:54 [WARNING ] (13, 1, 'bot')
2018-12-25 19:53:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:53:54 [DEBUG   ] Finished updating board flags in 1.377 seconds
2018-12-25 19:53:57 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-25 19:54:16 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-25 19:54:21 [DEBUG   ] Got command RPT from MCS: ref #951360
2018-12-25 19:54:21 [DEBUG   ] summary = ERROR
2018-12-25 19:54:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951360  13 58477 71661893 A  ERRORERROR'
2018-12-25 19:54:22 [DEBUG   ] Got command RPT from MCS: ref #951361
2018-12-25 19:54:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 19:54:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951361  77 58477 71662097 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 19:54:22 [DEBUG   ] Got command RPT from MCS: ref #951362
2018-12-25 19:54:22 [DEBUG   ] summary = ERROR
2018-12-25 19:54:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951362  13 58477 71662301 A  ERRORERROR'
2018-12-25 19:54:22 [DEBUG   ] Got command RPT from MCS: ref #951364
2018-12-25 19:54:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 19:54:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951364  77 58477 71662493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 19:54:22 [DEBUG   ] Got command RPT from MCS: ref #951365
2018-12-25 19:54:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 19:54:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951365  12 58477 71662697 A  ERRORBš™š'
2018-12-25 19:54:37 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-12-25 19:54:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:54:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-12-25 19:54:55 [WARNING ] (13, 1, 'bot')
2018-12-25 19:54:55 [WARNING ] (13, 1, 'bot')
2018-12-25 19:54:55 [WARNING ] (13, 1, 'bot')
2018-12-25 19:54:55 [WARNING ] (13, 1, 'bot')
2018-12-25 19:54:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:54:55 [DEBUG   ] Finished updating board flags in 2.065 seconds
2018-12-25 19:54:57 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-25 19:55:17 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-25 19:55:37 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-25 19:55:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:55:55 [WARNING ] (13, 1, 'bot')
2018-12-25 19:55:55 [WARNING ] (13, 1, 'bot')
2018-12-25 19:55:55 [WARNING ] (13, 1, 'bot')
2018-12-25 19:55:55 [WARNING ] (13, 1, 'bot')
2018-12-25 19:55:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:55:55 [DEBUG   ] Finished updating board flags in 1.967 seconds
2018-12-25 19:55:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 19:55:58 [DEBUG   ] Got command RPT from MCS: ref #951374
2018-12-25 19:55:58 [DEBUG   ] summary = ERROR
2018-12-25 19:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951374  13 58477 71758469 A  ERRORERROR'
2018-12-25 19:55:58 [DEBUG   ] Got command RPT from MCS: ref #951375
2018-12-25 19:55:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 19:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951375  77 58477 71758470 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 19:56:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 19:56:37 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 19:56:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:56:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-25 19:56:55 [WARNING ] (13, 1, 'bot')
2018-12-25 19:56:55 [WARNING ] (13, 1, 'bot')
2018-12-25 19:56:55 [WARNING ] (13, 1, 'bot')
2018-12-25 19:56:55 [WARNING ] (13, 1, 'bot')
2018-12-25 19:56:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:56:55 [DEBUG   ] Finished updating board flags in 1.806 seconds
2018-12-25 19:56:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 19:57:17 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-25 19:57:37 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 19:57:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:57:55 [WARNING ] (13, 1, 'bot')
2018-12-25 19:57:55 [WARNING ] (13, 1, 'bot')
2018-12-25 19:57:55 [WARNING ] (13, 1, 'bot')
2018-12-25 19:57:55 [WARNING ] (13, 1, 'bot')
2018-12-25 19:57:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:57:55 [DEBUG   ] Finished updating board flags in 1.805 seconds
2018-12-25 19:57:57 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-25 19:58:17 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-25 19:58:37 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-25 19:58:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:58:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-25 19:58:55 [WARNING ] (13, 1, 'bot')
2018-12-25 19:58:55 [WARNING ] (13, 1, 'bot')
2018-12-25 19:58:55 [WARNING ] (13, 1, 'bot')
2018-12-25 19:58:55 [WARNING ] (13, 1, 'bot')
2018-12-25 19:58:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:58:55 [DEBUG   ] Finished updating board flags in 1.792 seconds
2018-12-25 19:58:58 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-25 19:59:18 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-25 19:59:21 [DEBUG   ] Got command RPT from MCS: ref #951395
2018-12-25 19:59:21 [DEBUG   ] summary = ERROR
2018-12-25 19:59:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951395  13 58477 71961969 A  ERRORERROR'
2018-12-25 19:59:22 [DEBUG   ] Got command RPT from MCS: ref #951396
2018-12-25 19:59:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 19:59:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951396  77 58477 71962173 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 19:59:22 [DEBUG   ] Got command RPT from MCS: ref #951397
2018-12-25 19:59:22 [DEBUG   ] summary = ERROR
2018-12-25 19:59:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951397  13 58477 71962377 A  ERRORERROR'
2018-12-25 19:59:22 [DEBUG   ] Got command RPT from MCS: ref #951398
2018-12-25 19:59:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 19:59:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951398  77 58477 71962581 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 19:59:22 [DEBUG   ] Got command RPT from MCS: ref #951399
2018-12-25 19:59:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 19:59:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951399  12 58477 71962773 A  ERRORBš™š'
2018-12-25 19:59:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 19:59:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 19:59:55 [WARNING ] (13, 1, 'bot')
2018-12-25 19:59:55 [WARNING ] (13, 1, 'bot')
2018-12-25 19:59:55 [WARNING ] (13, 1, 'bot')
2018-12-25 19:59:55 [WARNING ] (13, 1, 'bot')
2018-12-25 19:59:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 19:59:55 [DEBUG   ] Finished updating board flags in 1.609 seconds
2018-12-25 19:59:58 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 20:00:18 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-25 20:00:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 20:00:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 20:00:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:00:55 [WARNING ] (13, 1, 'bot')
2018-12-25 20:00:55 [WARNING ] (13, 1, 'bot')
2018-12-25 20:00:55 [WARNING ] (13, 1, 'bot')
2018-12-25 20:00:55 [WARNING ] (13, 1, 'bot')
2018-12-25 20:00:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:00:55 [DEBUG   ] Finished updating board flags in 1.585 seconds
2018-12-25 20:00:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 20:00:58 [DEBUG   ] Got command RPT from MCS: ref #951404
2018-12-25 20:00:58 [DEBUG   ] summary = ERROR
2018-12-25 20:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951404  13 58477 72058465 A  ERRORERROR'
2018-12-25 20:00:58 [DEBUG   ] Got command RPT from MCS: ref #951405
2018-12-25 20:00:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 20:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951405  77 58477 72058466 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 20:01:18 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 20:01:38 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-25 20:01:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:01:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 20:01:55 [WARNING ] (13, 1, 'bot')
2018-12-25 20:01:55 [WARNING ] (13, 1, 'bot')
2018-12-25 20:01:55 [WARNING ] (13, 1, 'bot')
2018-12-25 20:01:55 [WARNING ] (13, 1, 'bot')
2018-12-25 20:01:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:01:55 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-12-25 20:01:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 20:02:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 20:02:38 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 20:02:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:02:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 20:02:55 [WARNING ] (13, 1, 'bot')
2018-12-25 20:02:55 [WARNING ] (13, 1, 'bot')
2018-12-25 20:02:55 [WARNING ] (13, 1, 'bot')
2018-12-25 20:02:55 [WARNING ] (13, 1, 'bot')
2018-12-25 20:02:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:02:55 [DEBUG   ] Finished updating board flags in 1.389 seconds
2018-12-25 20:02:58 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-25 20:03:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 20:03:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 20:03:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:03:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 20:03:55 [WARNING ] (13, 1, 'bot')
2018-12-25 20:03:55 [WARNING ] (13, 1, 'bot')
2018-12-25 20:03:55 [WARNING ] (13, 1, 'bot')
2018-12-25 20:03:55 [WARNING ] (13, 1, 'bot')
2018-12-25 20:03:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:03:55 [DEBUG   ] Finished updating board flags in 1.364 seconds
2018-12-25 20:03:58 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-25 20:04:18 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-25 20:04:22 [DEBUG   ] Got command RPT from MCS: ref #951427
2018-12-25 20:04:22 [DEBUG   ] summary = ERROR
2018-12-25 20:04:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951427  13 58477 72262061 A  ERRORERROR'
2018-12-25 20:04:22 [DEBUG   ] Got command RPT from MCS: ref #951428
2018-12-25 20:04:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 20:04:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951428  77 58477 72262253 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 20:04:22 [DEBUG   ] Got command RPT from MCS: ref #951429
2018-12-25 20:04:22 [DEBUG   ] summary = ERROR
2018-12-25 20:04:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951429  13 58477 72262457 A  ERRORERROR'
2018-12-25 20:04:22 [DEBUG   ] Got command RPT from MCS: ref #951431
2018-12-25 20:04:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 20:04:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951431  77 58477 72262661 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 20:04:22 [DEBUG   ] Got command RPT from MCS: ref #951432
2018-12-25 20:04:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 20:04:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951432  12 58477 72262853 A  ERRORB™™š'
2018-12-25 20:04:38 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-25 20:04:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-25 20:04:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:04:56 [WARNING ] (13, 1, 'bot')
2018-12-25 20:04:56 [WARNING ] (13, 1, 'bot')
2018-12-25 20:04:56 [WARNING ] (13, 1, 'bot')
2018-12-25 20:04:56 [WARNING ] (13, 1, 'bot')
2018-12-25 20:04:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:04:56 [DEBUG   ] Finished updating board flags in 2.052 seconds
2018-12-25 20:04:58 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-25 20:05:19 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-12-25 20:05:39 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-25 20:05:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 20:05:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:05:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 20:05:56 [WARNING ] (13, 1, 'bot')
2018-12-25 20:05:56 [WARNING ] (13, 1, 'bot')
2018-12-25 20:05:56 [WARNING ] (13, 1, 'bot')
2018-12-25 20:05:56 [WARNING ] (13, 1, 'bot')
2018-12-25 20:05:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:05:56 [DEBUG   ] Finished updating board flags in 2.009 seconds
2018-12-25 20:05:58 [DEBUG   ] Got command RPT from MCS: ref #951437
2018-12-25 20:05:58 [DEBUG   ] summary = ERROR
2018-12-25 20:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951437  13 58477 72358461 A  ERRORERROR'
2018-12-25 20:05:58 [DEBUG   ] Got command RPT from MCS: ref #951438
2018-12-25 20:05:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 20:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951438  77 58477 72358462 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 20:05:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 20:06:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 20:06:39 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-25 20:06:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:06:56 [WARNING ] (13, 1, 'bot')
2018-12-25 20:06:56 [WARNING ] (13, 1, 'bot')
2018-12-25 20:06:56 [WARNING ] (13, 1, 'bot')
2018-12-25 20:06:56 [WARNING ] (13, 1, 'bot')
2018-12-25 20:06:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:06:56 [DEBUG   ] Finished updating board flags in 1.988 seconds
2018-12-25 20:06:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 20:07:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 20:07:39 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 20:07:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:07:56 [WARNING ] (13, 1, 'bot')
2018-12-25 20:07:56 [WARNING ] (13, 1, 'bot')
2018-12-25 20:07:56 [WARNING ] (13, 1, 'bot')
2018-12-25 20:07:56 [WARNING ] (13, 1, 'bot')
2018-12-25 20:07:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:07:56 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-12-25 20:07:59 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-25 20:08:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 20:08:39 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 20:08:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:08:56 [WARNING ] (13, 1, 'bot')
2018-12-25 20:08:56 [WARNING ] (13, 1, 'bot')
2018-12-25 20:08:56 [WARNING ] (13, 1, 'bot')
2018-12-25 20:08:56 [WARNING ] (13, 1, 'bot')
2018-12-25 20:08:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:08:56 [DEBUG   ] Finished updating board flags in 1.794 seconds
2018-12-25 20:08:59 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 20:09:19 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-25 20:09:22 [DEBUG   ] Got command RPT from MCS: ref #951458
2018-12-25 20:09:22 [DEBUG   ] summary = ERROR
2018-12-25 20:09:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951458  13 58477 72562133 A  ERRORERROR'
2018-12-25 20:09:22 [DEBUG   ] Got command RPT from MCS: ref #951459
2018-12-25 20:09:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 20:09:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951459  77 58477 72562337 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 20:09:22 [DEBUG   ] Got command RPT from MCS: ref #951460
2018-12-25 20:09:22 [DEBUG   ] summary = ERROR
2018-12-25 20:09:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951460  13 58477 72562541 A  ERRORERROR'
2018-12-25 20:09:22 [DEBUG   ] Got command RPT from MCS: ref #951461
2018-12-25 20:09:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 20:09:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951461  77 58477 72562745 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 20:09:22 [DEBUG   ] Got command RPT from MCS: ref #951462
2018-12-25 20:09:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 20:09:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951462  12 58477 72562937 A  ERRORB™™š'
2018-12-25 20:09:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 20:09:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:09:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 20:09:56 [WARNING ] (13, 1, 'bot')
2018-12-25 20:09:56 [WARNING ] (13, 1, 'bot')
2018-12-25 20:09:56 [WARNING ] (13, 1, 'bot')
2018-12-25 20:09:56 [WARNING ] (13, 1, 'bot')
2018-12-25 20:09:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:09:56 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-12-25 20:09:59 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 20:10:19 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-25 20:10:40 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-12-25 20:10:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:10:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 20:10:56 [WARNING ] (13, 1, 'bot')
2018-12-25 20:10:56 [WARNING ] (13, 1, 'bot')
2018-12-25 20:10:56 [WARNING ] (13, 1, 'bot')
2018-12-25 20:10:56 [WARNING ] (13, 1, 'bot')
2018-12-25 20:10:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:10:56 [DEBUG   ] Finished updating board flags in 1.588 seconds
2018-12-25 20:10:58 [DEBUG   ] Got command RPT from MCS: ref #951467
2018-12-25 20:10:58 [DEBUG   ] summary = ERROR
2018-12-25 20:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951467  13 58477 72658465 A  ERRORERROR'
2018-12-25 20:10:58 [DEBUG   ] Got command RPT from MCS: ref #951468
2018-12-25 20:10:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 20:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951468  77 58477 72658466 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 20:11:00 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-25 20:11:20 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 20:11:40 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-25 20:11:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:11:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 20:11:56 [WARNING ] (13, 1, 'bot')
2018-12-25 20:11:56 [WARNING ] (13, 1, 'bot')
2018-12-25 20:11:56 [WARNING ] (13, 1, 'bot')
2018-12-25 20:11:56 [WARNING ] (13, 1, 'bot')
2018-12-25 20:11:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:11:56 [DEBUG   ] Finished updating board flags in 1.412 seconds
2018-12-25 20:12:00 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-25 20:12:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 20:12:40 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2018-12-25 20:12:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:12:56 [WARNING ] (13, 1, 'bot')
2018-12-25 20:12:56 [WARNING ] (13, 1, 'bot')
2018-12-25 20:12:56 [WARNING ] (13, 1, 'bot')
2018-12-25 20:12:56 [WARNING ] (13, 1, 'bot')
2018-12-25 20:12:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:12:56 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-12-25 20:13:00 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-25 20:13:21 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-25 20:13:41 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-25 20:13:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:13:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 20:13:56 [WARNING ] (13, 1, 'bot')
2018-12-25 20:13:56 [WARNING ] (13, 1, 'bot')
2018-12-25 20:13:56 [WARNING ] (13, 1, 'bot')
2018-12-25 20:13:56 [WARNING ] (13, 1, 'bot')
2018-12-25 20:13:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:13:56 [DEBUG   ] Finished updating board flags in 1.389 seconds
2018-12-25 20:14:01 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-25 20:14:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 20:14:22 [DEBUG   ] Got command RPT from MCS: ref #951490
2018-12-25 20:14:22 [DEBUG   ] summary = ERROR
2018-12-25 20:14:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951490  13 58477 72862221 A  ERRORERROR'
2018-12-25 20:14:22 [DEBUG   ] Got command RPT from MCS: ref #951491
2018-12-25 20:14:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 20:14:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951491  77 58477 72862413 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 20:14:22 [DEBUG   ] Got command RPT from MCS: ref #951492
2018-12-25 20:14:22 [DEBUG   ] summary = ERROR
2018-12-25 20:14:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951492  13 58477 72862617 A  ERRORERROR'
2018-12-25 20:14:22 [DEBUG   ] Got command RPT from MCS: ref #951494
2018-12-25 20:14:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 20:14:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951494  77 58477 72862821 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 20:14:23 [DEBUG   ] Got command RPT from MCS: ref #951495
2018-12-25 20:14:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 20:14:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951495  12 58477 72863025 A  ERRORB˜™š'
2018-12-25 20:14:41 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 20:14:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:14:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 20:14:56 [WARNING ] (13, 1, 'bot')
2018-12-25 20:14:56 [WARNING ] (13, 1, 'bot')
2018-12-25 20:14:56 [WARNING ] (13, 1, 'bot')
2018-12-25 20:14:56 [WARNING ] (13, 1, 'bot')
2018-12-25 20:14:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:14:56 [DEBUG   ] Finished updating board flags in 1.353 seconds
2018-12-25 20:15:01 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-12-25 20:15:21 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2018-12-25 20:15:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 20:15:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:15:57 [WARNING ] (13, 1, 'bot')
2018-12-25 20:15:57 [WARNING ] (13, 1, 'bot')
2018-12-25 20:15:57 [WARNING ] (13, 1, 'bot')
2018-12-25 20:15:57 [WARNING ] (13, 1, 'bot')
2018-12-25 20:15:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:15:57 [DEBUG   ] Finished updating board flags in 2.058 seconds
2018-12-25 20:15:58 [DEBUG   ] Got command RPT from MCS: ref #951504
2018-12-25 20:15:58 [DEBUG   ] summary = ERROR
2018-12-25 20:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951504  13 58477 72958469 A  ERRORERROR'
2018-12-25 20:15:58 [DEBUG   ] Got command RPT from MCS: ref #951505
2018-12-25 20:15:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 20:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951505  77 58477 72958470 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 20:16:01 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-12-25 20:16:21 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-25 20:16:41 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-25 20:16:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:16:57 [WARNING ] (13, 1, 'bot')
2018-12-25 20:16:57 [WARNING ] (13, 1, 'bot')
2018-12-25 20:16:57 [WARNING ] (13, 1, 'bot')
2018-12-25 20:16:57 [WARNING ] (13, 1, 'bot')
2018-12-25 20:16:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:16:57 [DEBUG   ] Finished updating board flags in 1.990 seconds
2018-12-25 20:17:01 [DEBUG   ] Finished updating ant stats in 0.474 seconds
2018-12-25 20:17:22 [DEBUG   ] Finished updating ant stats in 1.331 seconds
2018-12-25 20:17:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 20:17:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 20:17:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:17:57 [WARNING ] (13, 1, 'bot')
2018-12-25 20:17:57 [WARNING ] (13, 1, 'bot')
2018-12-25 20:17:57 [WARNING ] (13, 1, 'bot')
2018-12-25 20:17:57 [WARNING ] (13, 1, 'bot')
2018-12-25 20:17:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:17:57 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-12-25 20:18:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 20:18:22 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 20:18:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 20:18:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:18:57 [WARNING ] (13, 1, 'bot')
2018-12-25 20:18:57 [WARNING ] (13, 1, 'bot')
2018-12-25 20:18:57 [WARNING ] (13, 1, 'bot')
2018-12-25 20:18:57 [WARNING ] (13, 1, 'bot')
2018-12-25 20:18:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:18:57 [DEBUG   ] Finished updating board flags in 1.857 seconds
2018-12-25 20:19:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 20:19:22 [DEBUG   ] Got command RPT from MCS: ref #951525
2018-12-25 20:19:22 [DEBUG   ] summary = ERROR
2018-12-25 20:19:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951525  13 58477 73162301 A  ERRORERROR'
2018-12-25 20:19:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 20:19:22 [DEBUG   ] Got command RPT from MCS: ref #951526
2018-12-25 20:19:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 20:19:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951526  77 58477 73162493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 20:19:22 [DEBUG   ] Got command RPT from MCS: ref #951527
2018-12-25 20:19:22 [DEBUG   ] summary = ERROR
2018-12-25 20:19:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951527  13 58477 73162697 A  ERRORERROR'
2018-12-25 20:19:22 [DEBUG   ] Got command RPT from MCS: ref #951528
2018-12-25 20:19:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 20:19:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951528  77 58477 73162901 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 20:19:23 [DEBUG   ] Got command RPT from MCS: ref #951529
2018-12-25 20:19:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 20:19:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951529  12 58477 73163105 A  ERRORB˜™š'
2018-12-25 20:19:42 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 20:19:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:19:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 20:19:57 [WARNING ] (13, 1, 'bot')
2018-12-25 20:19:57 [WARNING ] (13, 1, 'bot')
2018-12-25 20:19:57 [WARNING ] (13, 1, 'bot')
2018-12-25 20:19:57 [WARNING ] (13, 1, 'bot')
2018-12-25 20:19:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:19:57 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-12-25 20:20:02 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-25 20:20:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 20:20:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 20:20:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:20:57 [WARNING ] (13, 1, 'bot')
2018-12-25 20:20:57 [WARNING ] (13, 1, 'bot')
2018-12-25 20:20:57 [WARNING ] (13, 1, 'bot')
2018-12-25 20:20:57 [WARNING ] (13, 1, 'bot')
2018-12-25 20:20:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:20:57 [DEBUG   ] Finished updating board flags in 1.730 seconds
2018-12-25 20:20:58 [DEBUG   ] Got command RPT from MCS: ref #951530
2018-12-25 20:20:58 [DEBUG   ] summary = ERROR
2018-12-25 20:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951530  13 58477 73258465 A  ERRORERROR'
2018-12-25 20:20:58 [DEBUG   ] Got command RPT from MCS: ref #951531
2018-12-25 20:20:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 20:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951531  77 58477 73258466 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 20:21:02 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 20:21:22 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-25 20:21:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 20:21:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:21:57 [WARNING ] (13, 1, 'bot')
2018-12-25 20:21:57 [WARNING ] (13, 1, 'bot')
2018-12-25 20:21:57 [WARNING ] (13, 1, 'bot')
2018-12-25 20:21:57 [WARNING ] (13, 1, 'bot')
2018-12-25 20:21:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:21:57 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-12-25 20:22:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 20:22:22 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 20:22:42 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-25 20:22:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:22:57 [WARNING ] (13, 1, 'bot')
2018-12-25 20:22:57 [WARNING ] (13, 1, 'bot')
2018-12-25 20:22:57 [WARNING ] (13, 1, 'bot')
2018-12-25 20:22:57 [WARNING ] (13, 1, 'bot')
2018-12-25 20:22:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:22:57 [DEBUG   ] Finished updating board flags in 1.645 seconds
2018-12-25 20:23:02 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-25 20:23:22 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-25 20:23:42 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-25 20:23:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 20:23:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:23:57 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 20:23:57 [WARNING ] (13, 1, 'bot')
2018-12-25 20:23:57 [WARNING ] (13, 1, 'bot')
2018-12-25 20:23:57 [WARNING ] (13, 1, 'bot')
2018-12-25 20:23:57 [WARNING ] (13, 1, 'bot')
2018-12-25 20:23:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:23:57 [DEBUG   ] Finished updating board flags in 1.544 seconds
2018-12-25 20:24:03 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-12-25 20:24:22 [DEBUG   ] Got command RPT from MCS: ref #951553
2018-12-25 20:24:22 [DEBUG   ] summary = ERROR
2018-12-25 20:24:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951553  13 58477 73462373 A  ERRORERROR'
2018-12-25 20:24:22 [DEBUG   ] Got command RPT from MCS: ref #951554
2018-12-25 20:24:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 20:24:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951554  77 58477 73462577 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 20:24:22 [DEBUG   ] Got command RPT from MCS: ref #951555
2018-12-25 20:24:22 [DEBUG   ] summary = ERROR
2018-12-25 20:24:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951555  13 58477 73462781 A  ERRORERROR'
2018-12-25 20:24:22 [DEBUG   ] Got command RPT from MCS: ref #951557
2018-12-25 20:24:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 20:24:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951557  77 58477 73462973 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 20:24:23 [DEBUG   ] Got command RPT from MCS: ref #951558
2018-12-25 20:24:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 20:24:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951558  12 58477 73463177 A  ERRORB™™š'
2018-12-25 20:24:23 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-25 20:24:43 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 20:24:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:24:57 [WARNING ] (13, 1, 'bot')
2018-12-25 20:24:57 [WARNING ] (13, 1, 'bot')
2018-12-25 20:24:57 [WARNING ] (13, 1, 'bot')
2018-12-25 20:24:57 [WARNING ] (13, 1, 'bot')
2018-12-25 20:24:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:24:57 [DEBUG   ] Finished updating board flags in 1.399 seconds
2018-12-25 20:25:03 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-25 20:25:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 20:25:43 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 20:25:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:25:57 [WARNING ] (13, 1, 'bot')
2018-12-25 20:25:57 [WARNING ] (13, 1, 'bot')
2018-12-25 20:25:57 [WARNING ] (13, 1, 'bot')
2018-12-25 20:25:57 [WARNING ] (13, 1, 'bot')
2018-12-25 20:25:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:25:57 [DEBUG   ] Finished updating board flags in 1.368 seconds
2018-12-25 20:25:58 [DEBUG   ] Got command RPT from MCS: ref #951567
2018-12-25 20:25:58 [DEBUG   ] summary = ERROR
2018-12-25 20:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951567  13 58477 73558473 A  ERRORERROR'
2018-12-25 20:25:58 [DEBUG   ] Got command RPT from MCS: ref #951568
2018-12-25 20:25:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 20:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951568  77 58477 73558474 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 20:26:03 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 20:26:23 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-25 20:26:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 20:26:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:26:58 [WARNING ] (13, 1, 'bot')
2018-12-25 20:26:58 [WARNING ] (13, 1, 'bot')
2018-12-25 20:26:58 [WARNING ] (13, 1, 'bot')
2018-12-25 20:26:58 [WARNING ] (13, 1, 'bot')
2018-12-25 20:26:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:26:58 [DEBUG   ] Finished updating board flags in 2.048 seconds
2018-12-25 20:27:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 20:27:23 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-12-25 20:27:43 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-25 20:27:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:27:58 [WARNING ] (13, 1, 'bot')
2018-12-25 20:27:58 [WARNING ] (13, 1, 'bot')
2018-12-25 20:27:58 [WARNING ] (13, 1, 'bot')
2018-12-25 20:27:58 [WARNING ] (13, 1, 'bot')
2018-12-25 20:27:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:27:58 [DEBUG   ] Finished updating board flags in 1.985 seconds
2018-12-25 20:28:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 20:28:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 20:28:43 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 20:28:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:28:58 [WARNING ] (13, 1, 'bot')
2018-12-25 20:28:58 [WARNING ] (13, 1, 'bot')
2018-12-25 20:28:58 [WARNING ] (13, 1, 'bot')
2018-12-25 20:28:58 [WARNING ] (13, 1, 'bot')
2018-12-25 20:28:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:28:58 [DEBUG   ] Finished updating board flags in 1.810 seconds
2018-12-25 20:29:03 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-25 20:29:22 [DEBUG   ] Got command RPT from MCS: ref #951588
2018-12-25 20:29:22 [DEBUG   ] summary = ERROR
2018-12-25 20:29:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951588  13 58477 73762457 A  ERRORERROR'
2018-12-25 20:29:22 [DEBUG   ] Got command RPT from MCS: ref #951589
2018-12-25 20:29:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 20:29:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951589  77 58477 73762661 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 20:29:22 [DEBUG   ] Got command RPT from MCS: ref #951590
2018-12-25 20:29:22 [DEBUG   ] summary = ERROR
2018-12-25 20:29:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951590  13 58477 73762865 A  ERRORERROR'
2018-12-25 20:29:23 [DEBUG   ] Got command RPT from MCS: ref #951591
2018-12-25 20:29:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 20:29:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951591  77 58477 73763057 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 20:29:23 [DEBUG   ] Got command RPT from MCS: ref #951592
2018-12-25 20:29:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 20:29:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951592  12 58477 73763261 A  ERRORBš™š'
2018-12-25 20:29:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-25 20:29:43 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-25 20:29:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:29:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-12-25 20:29:58 [WARNING ] (13, 1, 'bot')
2018-12-25 20:29:58 [WARNING ] (13, 1, 'bot')
2018-12-25 20:29:58 [WARNING ] (13, 1, 'bot')
2018-12-25 20:29:58 [WARNING ] (13, 1, 'bot')
2018-12-25 20:29:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:29:58 [DEBUG   ] Finished updating board flags in 1.793 seconds
2018-12-25 20:30:04 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-25 20:30:24 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-25 20:30:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 20:30:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-25 20:30:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:30:58 [DEBUG   ] Got command RPT from MCS: ref #951597
2018-12-25 20:30:58 [DEBUG   ] summary = ERROR
2018-12-25 20:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951597  13 58477 73858469 A  ERRORERROR'
2018-12-25 20:30:58 [DEBUG   ] Got command RPT from MCS: ref #951598
2018-12-25 20:30:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 20:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951598  77 58477 73858470 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 20:30:58 [WARNING ] (13, 1, 'bot')
2018-12-25 20:30:58 [WARNING ] (13, 1, 'bot')
2018-12-25 20:30:58 [WARNING ] (13, 1, 'bot')
2018-12-25 20:30:58 [WARNING ] (13, 1, 'bot')
2018-12-25 20:30:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:30:58 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-12-25 20:31:04 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 20:31:24 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-25 20:31:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 20:31:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:31:58 [WARNING ] (13, 1, 'bot')
2018-12-25 20:31:58 [WARNING ] (13, 1, 'bot')
2018-12-25 20:31:58 [WARNING ] (13, 1, 'bot')
2018-12-25 20:31:58 [WARNING ] (13, 1, 'bot')
2018-12-25 20:31:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:31:58 [DEBUG   ] Finished updating board flags in 1.591 seconds
2018-12-25 20:32:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 20:32:24 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 20:32:44 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-25 20:32:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:32:58 [WARNING ] (13, 1, 'bot')
2018-12-25 20:32:58 [WARNING ] (13, 1, 'bot')
2018-12-25 20:32:58 [WARNING ] (13, 1, 'bot')
2018-12-25 20:32:58 [WARNING ] (13, 1, 'bot')
2018-12-25 20:32:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:32:58 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-12-25 20:33:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 20:33:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 20:33:44 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 20:33:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 20:33:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:33:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 20:33:58 [WARNING ] (13, 1, 'bot')
2018-12-25 20:33:58 [WARNING ] (13, 1, 'bot')
2018-12-25 20:33:58 [WARNING ] (13, 1, 'bot')
2018-12-25 20:33:58 [WARNING ] (13, 1, 'bot')
2018-12-25 20:33:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:33:58 [DEBUG   ] Finished updating board flags in 1.398 seconds
2018-12-25 20:34:04 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-25 20:34:22 [DEBUG   ] Got command RPT from MCS: ref #951620
2018-12-25 20:34:22 [DEBUG   ] summary = ERROR
2018-12-25 20:34:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951620  13 58477 74062541 A  ERRORERROR'
2018-12-25 20:34:22 [DEBUG   ] Got command RPT from MCS: ref #951621
2018-12-25 20:34:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 20:34:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951621  77 58477 74062745 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 20:34:22 [DEBUG   ] Got command RPT from MCS: ref #951622
2018-12-25 20:34:22 [DEBUG   ] summary = ERROR
2018-12-25 20:34:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951622  13 58477 74062937 A  ERRORERROR'
2018-12-25 20:34:23 [DEBUG   ] Got command RPT from MCS: ref #951624
2018-12-25 20:34:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 20:34:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951624  77 58477 74063141 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 20:34:23 [DEBUG   ] Got command RPT from MCS: ref #951625
2018-12-25 20:34:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 20:34:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951625  12 58477 74063345 A  ERRORBš™š'
2018-12-25 20:34:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 20:34:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 20:34:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:34:58 [WARNING ] (13, 1, 'bot')
2018-12-25 20:34:58 [WARNING ] (13, 1, 'bot')
2018-12-25 20:34:58 [WARNING ] (13, 1, 'bot')
2018-12-25 20:34:58 [WARNING ] (13, 1, 'bot')
2018-12-25 20:34:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:34:58 [DEBUG   ] Finished updating board flags in 1.357 seconds
2018-12-25 20:35:04 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 20:35:24 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-25 20:35:45 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-25 20:35:58 [DEBUG   ] Got command RPT from MCS: ref #951630
2018-12-25 20:35:58 [DEBUG   ] summary = ERROR
2018-12-25 20:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951630  13 58477 74158469 A  ERRORERROR'
2018-12-25 20:35:58 [DEBUG   ] Got command RPT from MCS: ref #951631
2018-12-25 20:35:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 20:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951631  77 58477 74158470 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 20:35:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:35:59 [WARNING ] (13, 1, 'bot')
2018-12-25 20:35:59 [WARNING ] (13, 1, 'bot')
2018-12-25 20:35:59 [WARNING ] (13, 1, 'bot')
2018-12-25 20:35:59 [WARNING ] (13, 1, 'bot')
2018-12-25 20:35:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:35:59 [DEBUG   ] Finished updating board flags in 2.050 seconds
2018-12-25 20:36:05 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-25 20:36:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 20:36:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 20:36:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:36:59 [WARNING ] (13, 1, 'bot')
2018-12-25 20:36:59 [WARNING ] (13, 1, 'bot')
2018-12-25 20:36:59 [WARNING ] (13, 1, 'bot')
2018-12-25 20:36:59 [WARNING ] (13, 1, 'bot')
2018-12-25 20:36:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:36:59 [DEBUG   ] Finished updating board flags in 2.006 seconds
2018-12-25 20:37:05 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 20:37:25 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 20:37:45 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-25 20:37:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:37:59 [WARNING ] (13, 1, 'bot')
2018-12-25 20:37:59 [WARNING ] (13, 1, 'bot')
2018-12-25 20:37:59 [WARNING ] (13, 1, 'bot')
2018-12-25 20:37:59 [WARNING ] (13, 1, 'bot')
2018-12-25 20:37:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:37:59 [DEBUG   ] Finished updating board flags in 2.017 seconds
2018-12-25 20:38:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 20:38:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 20:38:45 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-25 20:38:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:38:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 20:38:59 [WARNING ] (13, 1, 'bot')
2018-12-25 20:38:59 [WARNING ] (13, 1, 'bot')
2018-12-25 20:38:59 [WARNING ] (13, 1, 'bot')
2018-12-25 20:38:59 [WARNING ] (13, 1, 'bot')
2018-12-25 20:38:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:38:59 [DEBUG   ] Finished updating board flags in 1.972 seconds
2018-12-25 20:39:05 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-25 20:39:22 [DEBUG   ] Got command RPT from MCS: ref #951651
2018-12-25 20:39:22 [DEBUG   ] summary = ERROR
2018-12-25 20:39:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951651  13 58477 74362625 A  ERRORERROR'
2018-12-25 20:39:22 [DEBUG   ] Got command RPT from MCS: ref #951652
2018-12-25 20:39:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 20:39:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951652  77 58477 74362817 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 20:39:23 [DEBUG   ] Got command RPT from MCS: ref #951653
2018-12-25 20:39:23 [DEBUG   ] summary = ERROR
2018-12-25 20:39:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951653  13 58477 74363021 A  ERRORERROR'
2018-12-25 20:39:23 [DEBUG   ] Got command RPT from MCS: ref #951654
2018-12-25 20:39:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 20:39:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951654  77 58477 74363225 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 20:39:23 [DEBUG   ] Got command RPT from MCS: ref #951655
2018-12-25 20:39:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 20:39:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951655  12 58477 74363417 A  ERRORBš™š'
2018-12-25 20:39:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 20:39:45 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 20:39:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:39:59 [WARNING ] (13, 1, 'bot')
2018-12-25 20:39:59 [WARNING ] (13, 1, 'bot')
2018-12-25 20:39:59 [WARNING ] (13, 1, 'bot')
2018-12-25 20:39:59 [WARNING ] (13, 1, 'bot')
2018-12-25 20:39:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:39:59 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-12-25 20:40:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 20:40:25 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-25 20:40:45 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-25 20:40:58 [DEBUG   ] Got command RPT from MCS: ref #951660
2018-12-25 20:40:58 [DEBUG   ] summary = ERROR
2018-12-25 20:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951660  13 58477 74458469 A  ERRORERROR'
2018-12-25 20:40:58 [DEBUG   ] Got command RPT from MCS: ref #951661
2018-12-25 20:40:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 20:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951661  77 58477 74458470 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 20:40:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:40:59 [WARNING ] (13, 1, 'bot')
2018-12-25 20:40:59 [WARNING ] (13, 1, 'bot')
2018-12-25 20:40:59 [WARNING ] (13, 1, 'bot')
2018-12-25 20:40:59 [WARNING ] (13, 1, 'bot')
2018-12-25 20:40:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:40:59 [DEBUG   ] Finished updating board flags in 1.806 seconds
2018-12-25 20:41:05 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-25 20:41:25 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-25 20:41:46 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-12-25 20:41:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:41:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 20:41:59 [WARNING ] (13, 1, 'bot')
2018-12-25 20:41:59 [WARNING ] (13, 1, 'bot')
2018-12-25 20:41:59 [WARNING ] (13, 1, 'bot')
2018-12-25 20:41:59 [WARNING ] (13, 1, 'bot')
2018-12-25 20:41:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:41:59 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-12-25 20:42:06 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-25 20:42:26 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-25 20:42:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 20:42:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:42:59 [WARNING ] (13, 1, 'bot')
2018-12-25 20:42:59 [WARNING ] (13, 1, 'bot')
2018-12-25 20:42:59 [WARNING ] (13, 1, 'bot')
2018-12-25 20:42:59 [WARNING ] (13, 1, 'bot')
2018-12-25 20:42:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:42:59 [DEBUG   ] Finished updating board flags in 1.786 seconds
2018-12-25 20:43:06 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 20:43:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 20:43:46 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-25 20:43:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:43:59 [WARNING ] (13, 1, 'bot')
2018-12-25 20:43:59 [WARNING ] (13, 1, 'bot')
2018-12-25 20:43:59 [WARNING ] (13, 1, 'bot')
2018-12-25 20:43:59 [WARNING ] (13, 1, 'bot')
2018-12-25 20:43:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:43:59 [DEBUG   ] Finished updating board flags in 1.610 seconds
2018-12-25 20:44:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 20:44:22 [DEBUG   ] Got command RPT from MCS: ref #951683
2018-12-25 20:44:22 [DEBUG   ] summary = ERROR
2018-12-25 20:44:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951683  13 58477 74662701 A  ERRORERROR'
2018-12-25 20:44:22 [DEBUG   ] Got command RPT from MCS: ref #951684
2018-12-25 20:44:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 20:44:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951684  77 58477 74662905 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 20:44:23 [DEBUG   ] Got command RPT from MCS: ref #951685
2018-12-25 20:44:23 [DEBUG   ] summary = ERROR
2018-12-25 20:44:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951685  13 58477 74663097 A  ERRORERROR'
2018-12-25 20:44:23 [DEBUG   ] Got command RPT from MCS: ref #951687
2018-12-25 20:44:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 20:44:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951687  77 58477 74663301 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 20:44:23 [DEBUG   ] Got command RPT from MCS: ref #951689
2018-12-25 20:44:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 20:44:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951689  12 58477 74663505 A  ERRORB™™š'
2018-12-25 20:44:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 20:44:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 20:44:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:44:59 [WARNING ] (13, 1, 'bot')
2018-12-25 20:44:59 [WARNING ] (13, 1, 'bot')
2018-12-25 20:44:59 [WARNING ] (13, 1, 'bot')
2018-12-25 20:44:59 [WARNING ] (13, 1, 'bot')
2018-12-25 20:44:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:44:59 [DEBUG   ] Finished updating board flags in 1.597 seconds
2018-12-25 20:45:06 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2018-12-25 20:45:26 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-25 20:45:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 20:45:58 [DEBUG   ] Got command RPT from MCS: ref #951697
2018-12-25 20:45:58 [DEBUG   ] summary = ERROR
2018-12-25 20:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951697  13 58477 74758470 A  ERRORERROR'
2018-12-25 20:45:58 [DEBUG   ] Got command RPT from MCS: ref #951698
2018-12-25 20:45:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 20:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951698  77 58477 74758470 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 20:45:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:45:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 20:45:59 [WARNING ] (13, 1, 'bot')
2018-12-25 20:45:59 [WARNING ] (13, 1, 'bot')
2018-12-25 20:45:59 [WARNING ] (13, 1, 'bot')
2018-12-25 20:45:59 [WARNING ] (13, 1, 'bot')
2018-12-25 20:45:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:45:59 [DEBUG   ] Finished updating board flags in 1.398 seconds
2018-12-25 20:46:06 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 20:46:26 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-25 20:46:47 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-25 20:46:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:46:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 20:46:59 [WARNING ] (13, 1, 'bot')
2018-12-25 20:46:59 [WARNING ] (13, 1, 'bot')
2018-12-25 20:46:59 [WARNING ] (13, 1, 'bot')
2018-12-25 20:46:59 [WARNING ] (13, 1, 'bot')
2018-12-25 20:46:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:46:59 [DEBUG   ] Finished updating board flags in 1.362 seconds
2018-12-25 20:47:07 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-25 20:47:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 20:47:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 20:47:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:48:00 [WARNING ] (13, 1, 'bot')
2018-12-25 20:48:00 [WARNING ] (13, 1, 'bot')
2018-12-25 20:48:00 [WARNING ] (13, 1, 'bot')
2018-12-25 20:48:00 [WARNING ] (13, 1, 'bot')
2018-12-25 20:48:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:48:00 [DEBUG   ] Finished updating board flags in 2.043 seconds
2018-12-25 20:48:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 20:48:27 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 20:48:47 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-25 20:48:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:49:00 [WARNING ] (13, 1, 'bot')
2018-12-25 20:49:00 [WARNING ] (13, 1, 'bot')
2018-12-25 20:49:00 [WARNING ] (13, 1, 'bot')
2018-12-25 20:49:00 [WARNING ] (13, 1, 'bot')
2018-12-25 20:49:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:49:00 [DEBUG   ] Finished updating board flags in 2.015 seconds
2018-12-25 20:49:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 20:49:22 [DEBUG   ] Got command RPT from MCS: ref #951718
2018-12-25 20:49:22 [DEBUG   ] summary = ERROR
2018-12-25 20:49:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951718  13 58477 74962785 A  ERRORERROR'
2018-12-25 20:49:22 [DEBUG   ] Got command RPT from MCS: ref #951719
2018-12-25 20:49:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 20:49:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951719  77 58477 74962977 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 20:49:23 [DEBUG   ] Got command RPT from MCS: ref #951720
2018-12-25 20:49:23 [DEBUG   ] summary = ERROR
2018-12-25 20:49:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951720  13 58477 74963181 A  ERRORERROR'
2018-12-25 20:49:23 [DEBUG   ] Got command RPT from MCS: ref #951721
2018-12-25 20:49:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 20:49:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951721  77 58477 74963385 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 20:49:23 [DEBUG   ] Got command RPT from MCS: ref #951722
2018-12-25 20:49:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 20:49:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951722  12 58477 74963589 A  ERRORB™™š'
2018-12-25 20:49:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 20:49:47 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 20:49:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:50:00 [WARNING ] (13, 1, 'bot')
2018-12-25 20:50:00 [WARNING ] (13, 1, 'bot')
2018-12-25 20:50:00 [WARNING ] (13, 1, 'bot')
2018-12-25 20:50:00 [WARNING ] (13, 1, 'bot')
2018-12-25 20:50:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:50:00 [DEBUG   ] Finished updating board flags in 1.987 seconds
2018-12-25 20:50:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 20:50:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 20:50:47 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 20:50:58 [DEBUG   ] Got command RPT from MCS: ref #951723
2018-12-25 20:50:58 [DEBUG   ] summary = ERROR
2018-12-25 20:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951723  13 58477 75058469 A  ERRORERROR'
2018-12-25 20:50:58 [DEBUG   ] Got command RPT from MCS: ref #951724
2018-12-25 20:50:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 20:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951724  77 58477 75058470 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 20:50:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:51:00 [WARNING ] (13, 1, 'bot')
2018-12-25 20:51:00 [WARNING ] (13, 1, 'bot')
2018-12-25 20:51:00 [WARNING ] (13, 1, 'bot')
2018-12-25 20:51:00 [WARNING ] (13, 1, 'bot')
2018-12-25 20:51:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:51:00 [DEBUG   ] Finished updating board flags in 1.902 seconds
2018-12-25 20:51:07 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-25 20:51:27 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-25 20:51:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 20:51:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:52:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-25 20:52:00 [WARNING ] (13, 1, 'bot')
2018-12-25 20:52:00 [WARNING ] (13, 1, 'bot')
2018-12-25 20:52:00 [WARNING ] (13, 1, 'bot')
2018-12-25 20:52:00 [WARNING ] (13, 1, 'bot')
2018-12-25 20:52:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:52:00 [DEBUG   ] Finished updating board flags in 1.701 seconds
2018-12-25 20:52:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 20:52:27 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 20:52:47 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-25 20:52:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 20:52:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:53:00 [WARNING ] (13, 1, 'bot')
2018-12-25 20:53:00 [WARNING ] (13, 1, 'bot')
2018-12-25 20:53:00 [WARNING ] (13, 1, 'bot')
2018-12-25 20:53:00 [WARNING ] (13, 1, 'bot')
2018-12-25 20:53:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:53:00 [DEBUG   ] Finished updating board flags in 1.606 seconds
2018-12-25 20:53:08 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-12-25 20:53:28 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-25 20:53:48 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-25 20:53:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:54:00 [WARNING ] (13, 1, 'bot')
2018-12-25 20:54:00 [WARNING ] (13, 1, 'bot')
2018-12-25 20:54:00 [WARNING ] (13, 1, 'bot')
2018-12-25 20:54:00 [WARNING ] (13, 1, 'bot')
2018-12-25 20:54:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:54:00 [DEBUG   ] Finished updating board flags in 1.610 seconds
2018-12-25 20:54:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 20:54:22 [DEBUG   ] Got command RPT from MCS: ref #951746
2018-12-25 20:54:22 [DEBUG   ] summary = ERROR
2018-12-25 20:54:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951746  13 58477 75262865 A  ERRORERROR'
2018-12-25 20:54:23 [DEBUG   ] Got command RPT from MCS: ref #951747
2018-12-25 20:54:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 20:54:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951747  77 58477 75263069 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 20:54:23 [DEBUG   ] Got command RPT from MCS: ref #951748
2018-12-25 20:54:23 [DEBUG   ] summary = ERROR
2018-12-25 20:54:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951748  13 58477 75263261 A  ERRORERROR'
2018-12-25 20:54:23 [DEBUG   ] Got command RPT from MCS: ref #951750
2018-12-25 20:54:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 20:54:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951750  77 58477 75263465 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 20:54:23 [DEBUG   ] Got command RPT from MCS: ref #951752
2018-12-25 20:54:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 20:54:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951752  12 58477 75263669 A  ERRORB˜™š'
2018-12-25 20:54:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 20:54:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 20:54:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:55:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 20:55:00 [WARNING ] (13, 1, 'bot')
2018-12-25 20:55:00 [WARNING ] (13, 1, 'bot')
2018-12-25 20:55:00 [WARNING ] (13, 1, 'bot')
2018-12-25 20:55:00 [WARNING ] (13, 1, 'bot')
2018-12-25 20:55:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:55:00 [DEBUG   ] Finished updating board flags in 1.591 seconds
2018-12-25 20:55:08 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-25 20:55:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 20:55:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 20:55:58 [DEBUG   ] Got command RPT from MCS: ref #951760
2018-12-25 20:55:58 [DEBUG   ] summary = ERROR
2018-12-25 20:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951760  13 58477 75358473 A  ERRORERROR'
2018-12-25 20:55:58 [DEBUG   ] Got command RPT from MCS: ref #951761
2018-12-25 20:55:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 20:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951761  77 58477 75358474 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 20:55:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:56:00 [WARNING ] (13, 1, 'bot')
2018-12-25 20:56:00 [WARNING ] (13, 1, 'bot')
2018-12-25 20:56:00 [WARNING ] (13, 1, 'bot')
2018-12-25 20:56:00 [WARNING ] (13, 1, 'bot')
2018-12-25 20:56:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:56:00 [DEBUG   ] Finished updating board flags in 1.412 seconds
2018-12-25 20:56:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 20:56:28 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-25 20:56:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 20:56:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:57:00 [WARNING ] (13, 1, 'bot')
2018-12-25 20:57:00 [WARNING ] (13, 1, 'bot')
2018-12-25 20:57:00 [WARNING ] (13, 1, 'bot')
2018-12-25 20:57:00 [WARNING ] (13, 1, 'bot')
2018-12-25 20:57:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:57:00 [DEBUG   ] Finished updating board flags in 1.394 seconds
2018-12-25 20:57:08 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-25 20:57:29 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-25 20:57:49 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-25 20:58:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:58:00 [WARNING ] (13, 1, 'bot')
2018-12-25 20:58:00 [WARNING ] (13, 1, 'bot')
2018-12-25 20:58:00 [WARNING ] (13, 1, 'bot')
2018-12-25 20:58:00 [WARNING ] (13, 1, 'bot')
2018-12-25 20:58:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:58:00 [DEBUG   ] Finished updating board flags in 1.355 seconds
2018-12-25 20:58:09 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 20:58:29 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-25 20:58:49 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-25 20:59:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 20:59:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 20:59:01 [WARNING ] (13, 1, 'bot')
2018-12-25 20:59:01 [WARNING ] (13, 1, 'bot')
2018-12-25 20:59:01 [WARNING ] (13, 1, 'bot')
2018-12-25 20:59:01 [WARNING ] (13, 1, 'bot')
2018-12-25 20:59:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 20:59:01 [DEBUG   ] Finished updating board flags in 2.065 seconds
2018-12-25 20:59:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 20:59:22 [DEBUG   ] Got command RPT from MCS: ref #951791
2018-12-25 20:59:22 [DEBUG   ] summary = ERROR
2018-12-25 20:59:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951791  13 58477 75562941 A  ERRORERROR'
2018-12-25 20:59:23 [DEBUG   ] Got command RPT from MCS: ref #951792
2018-12-25 20:59:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 20:59:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951792  77 58477 75563145 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 20:59:23 [DEBUG   ] Got command RPT from MCS: ref #951793
2018-12-25 20:59:23 [DEBUG   ] summary = ERROR
2018-12-25 20:59:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951793  13 58477 75563349 A  ERRORERROR'
2018-12-25 20:59:23 [DEBUG   ] Got command RPT from MCS: ref #951794
2018-12-25 20:59:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 20:59:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951794  77 58477 75563553 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 20:59:23 [DEBUG   ] Got command RPT from MCS: ref #951795
2018-12-25 20:59:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 20:59:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951795  12 58477 75563745 A  ERRORB˜™š'
2018-12-25 20:59:29 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 20:59:49 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 21:00:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 21:00:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:00:01 [WARNING ] (13, 1, 'bot')
2018-12-25 21:00:01 [WARNING ] (13, 1, 'bot')
2018-12-25 21:00:01 [WARNING ] (13, 1, 'bot')
2018-12-25 21:00:01 [WARNING ] (13, 1, 'bot')
2018-12-25 21:00:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:00:01 [DEBUG   ] Finished updating board flags in 1.999 seconds
2018-12-25 21:00:09 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-25 21:00:29 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 21:00:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 21:00:58 [DEBUG   ] Got command RPT from MCS: ref #951800
2018-12-25 21:00:58 [DEBUG   ] summary = ERROR
2018-12-25 21:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951800  13 58477 75658473 A  ERRORERROR'
2018-12-25 21:00:58 [DEBUG   ] Got command RPT from MCS: ref #951801
2018-12-25 21:00:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 21:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951801  77 58477 75658474 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 21:01:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 21:01:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:01:01 [WARNING ] (13, 1, 'bot')
2018-12-25 21:01:01 [WARNING ] (13, 1, 'bot')
2018-12-25 21:01:01 [WARNING ] (13, 1, 'bot')
2018-12-25 21:01:01 [WARNING ] (13, 1, 'bot')
2018-12-25 21:01:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:01:01 [DEBUG   ] Finished updating board flags in 1.802 seconds
2018-12-25 21:01:09 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 21:01:29 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-25 21:01:50 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-25 21:02:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:02:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 21:02:01 [WARNING ] (13, 1, 'bot')
2018-12-25 21:02:01 [WARNING ] (13, 1, 'bot')
2018-12-25 21:02:01 [WARNING ] (13, 1, 'bot')
2018-12-25 21:02:01 [WARNING ] (13, 1, 'bot')
2018-12-25 21:02:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:02:01 [DEBUG   ] Finished updating board flags in 1.784 seconds
2018-12-25 21:02:10 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 21:02:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 21:02:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 21:03:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:03:01 [WARNING ] (13, 1, 'bot')
2018-12-25 21:03:01 [WARNING ] (13, 1, 'bot')
2018-12-25 21:03:01 [WARNING ] (13, 1, 'bot')
2018-12-25 21:03:01 [WARNING ] (13, 1, 'bot')
2018-12-25 21:03:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:03:01 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-12-25 21:03:10 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-25 21:03:30 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-25 21:03:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 21:04:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:04:01 [WARNING ] (13, 1, 'bot')
2018-12-25 21:04:01 [WARNING ] (13, 1, 'bot')
2018-12-25 21:04:01 [WARNING ] (13, 1, 'bot')
2018-12-25 21:04:01 [WARNING ] (13, 1, 'bot')
2018-12-25 21:04:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:04:01 [DEBUG   ] Finished updating board flags in 1.588 seconds
2018-12-25 21:04:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 21:04:23 [DEBUG   ] Got command RPT from MCS: ref #951823
2018-12-25 21:04:23 [DEBUG   ] summary = ERROR
2018-12-25 21:04:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951823  13 58477 75863025 A  ERRORERROR'
2018-12-25 21:04:23 [DEBUG   ] Got command RPT from MCS: ref #951824
2018-12-25 21:04:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 21:04:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951824  77 58477 75863229 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 21:04:23 [DEBUG   ] Got command RPT from MCS: ref #951825
2018-12-25 21:04:23 [DEBUG   ] summary = ERROR
2018-12-25 21:04:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951825  13 58477 75863433 A  ERRORERROR'
2018-12-25 21:04:23 [DEBUG   ] Got command RPT from MCS: ref #951827
2018-12-25 21:04:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 21:04:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951827  77 58477 75863625 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 21:04:23 [DEBUG   ] Got command RPT from MCS: ref #951829
2018-12-25 21:04:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 21:04:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951829  12 58477 75863829 A  ERRORB˜™š'
2018-12-25 21:04:30 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 21:04:50 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-25 21:05:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:05:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 21:05:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 21:05:01 [WARNING ] (13, 1, 'bot')
2018-12-25 21:05:01 [WARNING ] (13, 1, 'bot')
2018-12-25 21:05:01 [WARNING ] (13, 1, 'bot')
2018-12-25 21:05:01 [WARNING ] (13, 1, 'bot')
2018-12-25 21:05:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:05:01 [DEBUG   ] Finished updating board flags in 1.496 seconds
2018-12-25 21:05:10 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-25 21:05:30 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 21:05:50 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 21:05:58 [DEBUG   ] Got command RPT from MCS: ref #951833
2018-12-25 21:05:58 [DEBUG   ] summary = ERROR
2018-12-25 21:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951833  13 58477 75958481 A  ERRORERROR'
2018-12-25 21:05:58 [DEBUG   ] Got command RPT from MCS: ref #951834
2018-12-25 21:05:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 21:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951834  77 58477 75958482 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 21:06:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 21:06:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:06:01 [WARNING ] (13, 1, 'bot')
2018-12-25 21:06:01 [WARNING ] (13, 1, 'bot')
2018-12-25 21:06:01 [WARNING ] (13, 1, 'bot')
2018-12-25 21:06:01 [WARNING ] (13, 1, 'bot')
2018-12-25 21:06:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:06:01 [DEBUG   ] Finished updating board flags in 1.462 seconds
2018-12-25 21:06:10 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-25 21:06:30 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-25 21:06:50 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-25 21:07:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:07:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 21:07:01 [WARNING ] (13, 1, 'bot')
2018-12-25 21:07:01 [WARNING ] (13, 1, 'bot')
2018-12-25 21:07:01 [WARNING ] (13, 1, 'bot')
2018-12-25 21:07:01 [WARNING ] (13, 1, 'bot')
2018-12-25 21:07:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:07:01 [DEBUG   ] Finished updating board flags in 1.482 seconds
2018-12-25 21:07:10 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-25 21:07:31 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-12-25 21:07:51 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-25 21:08:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:08:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:08:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:08:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:08:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:08:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:08:02 [DEBUG   ] Finished updating board flags in 2.256 seconds
2018-12-25 21:08:11 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 21:08:31 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-25 21:08:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 21:09:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:09:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:09:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:09:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:09:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:09:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:09:02 [DEBUG   ] Finished updating board flags in 2.212 seconds
2018-12-25 21:09:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 21:09:23 [DEBUG   ] Got command RPT from MCS: ref #951854
2018-12-25 21:09:23 [DEBUG   ] summary = ERROR
2018-12-25 21:09:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951854  13 58477 76163109 A  ERRORERROR'
2018-12-25 21:09:23 [DEBUG   ] Got command RPT from MCS: ref #951855
2018-12-25 21:09:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 21:09:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951855  77 58477 76163301 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 21:09:23 [DEBUG   ] Got command RPT from MCS: ref #951856
2018-12-25 21:09:23 [DEBUG   ] summary = ERROR
2018-12-25 21:09:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951856  13 58477 76163505 A  ERRORERROR'
2018-12-25 21:09:23 [DEBUG   ] Got command RPT from MCS: ref #951857
2018-12-25 21:09:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 21:09:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951857  77 58477 76163709 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 21:09:23 [DEBUG   ] Got command RPT from MCS: ref #951858
2018-12-25 21:09:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 21:09:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951858  12 58477 76163913 A  ERRORB˜™š'
2018-12-25 21:09:31 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 21:09:51 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-25 21:10:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:10:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 21:10:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:10:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:10:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:10:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:10:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:10:02 [DEBUG   ] Finished updating board flags in 2.107 seconds
2018-12-25 21:10:11 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-25 21:10:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 21:10:51 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 21:10:58 [DEBUG   ] Got command RPT from MCS: ref #951863
2018-12-25 21:10:58 [DEBUG   ] summary = ERROR
2018-12-25 21:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951863  13 58477 76258481 A  ERRORERROR'
2018-12-25 21:10:58 [DEBUG   ] Got command RPT from MCS: ref #951864
2018-12-25 21:10:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 21:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951864  77 58477 76258482 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 21:11:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:11:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:11:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:11:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:11:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:11:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:11:02 [DEBUG   ] Finished updating board flags in 2.021 seconds
2018-12-25 21:11:11 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-25 21:11:32 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-25 21:11:52 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-25 21:12:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:12:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:12:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:12:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:12:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:12:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:12:02 [DEBUG   ] Finished updating board flags in 1.985 seconds
2018-12-25 21:12:12 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-25 21:12:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 21:12:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 21:13:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:13:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 21:13:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:13:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:13:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:13:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:13:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:13:02 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-12-25 21:13:12 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 21:13:32 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-25 21:13:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 21:14:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:14:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-12-25 21:14:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:14:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:14:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:14:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:14:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:14:02 [DEBUG   ] Finished updating board flags in 1.787 seconds
2018-12-25 21:14:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 21:14:23 [DEBUG   ] Got command RPT from MCS: ref #951886
2018-12-25 21:14:23 [DEBUG   ] summary = ERROR
2018-12-25 21:14:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951886  13 58477 76463181 A  ERRORERROR'
2018-12-25 21:14:23 [DEBUG   ] Got command RPT from MCS: ref #951887
2018-12-25 21:14:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 21:14:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951887  77 58477 76463385 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 21:14:23 [DEBUG   ] Got command RPT from MCS: ref #951888
2018-12-25 21:14:23 [DEBUG   ] summary = ERROR
2018-12-25 21:14:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951888  13 58477 76463589 A  ERRORERROR'
2018-12-25 21:14:23 [DEBUG   ] Got command RPT from MCS: ref #951890
2018-12-25 21:14:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 21:14:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951890  77 58477 76463793 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 21:14:23 [DEBUG   ] Got command RPT from MCS: ref #951891
2018-12-25 21:14:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 21:14:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951891  12 58477 76463985 A  ERRORBš™š'
2018-12-25 21:14:32 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 21:14:52 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-25 21:15:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:15:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:15:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:15:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:15:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:15:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:15:02 [DEBUG   ] Finished updating board flags in 1.648 seconds
2018-12-25 21:15:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 21:15:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 21:15:52 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 21:15:58 [DEBUG   ] Got command RPT from MCS: ref #951900
2018-12-25 21:15:58 [DEBUG   ] summary = ERROR
2018-12-25 21:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951900  13 58477 76558477 A  ERRORERROR'
2018-12-25 21:15:58 [DEBUG   ] Got command RPT from MCS: ref #951901
2018-12-25 21:15:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 21:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951901  77 58477 76558478 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 21:16:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 21:16:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:16:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:16:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:16:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:16:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:16:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:16:02 [DEBUG   ] Finished updating board flags in 1.562 seconds
2018-12-25 21:16:12 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-25 21:16:33 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-12-25 21:16:52 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-25 21:17:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:17:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:17:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:17:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:17:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:17:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:17:02 [DEBUG   ] Finished updating board flags in 1.521 seconds
2018-12-25 21:17:13 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-12-25 21:17:33 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-25 21:17:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 21:18:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:18:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-12-25 21:18:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:18:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:18:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:18:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:18:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:18:02 [DEBUG   ] Finished updating board flags in 1.411 seconds
2018-12-25 21:18:13 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 21:18:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 21:18:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 21:19:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:19:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:19:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:19:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:19:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:19:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:19:02 [DEBUG   ] Finished updating board flags in 1.420 seconds
2018-12-25 21:19:13 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-25 21:19:23 [DEBUG   ] Got command RPT from MCS: ref #951921
2018-12-25 21:19:23 [DEBUG   ] summary = ERROR
2018-12-25 21:19:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951921  13 58477 76763273 A  ERRORERROR'
2018-12-25 21:19:23 [DEBUG   ] Got command RPT from MCS: ref #951922
2018-12-25 21:19:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 21:19:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951922  77 58477 76763465 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 21:19:23 [DEBUG   ] Got command RPT from MCS: ref #951923
2018-12-25 21:19:23 [DEBUG   ] summary = ERROR
2018-12-25 21:19:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951923  13 58477 76763669 A  ERRORERROR'
2018-12-25 21:19:23 [DEBUG   ] Got command RPT from MCS: ref #951924
2018-12-25 21:19:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 21:19:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951924  77 58477 76763873 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 21:19:24 [DEBUG   ] Got command RPT from MCS: ref #951925
2018-12-25 21:19:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 21:19:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951925  12 58477 76764065 A  ERRORBš™š'
2018-12-25 21:19:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 21:19:53 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-25 21:20:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:20:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-12-25 21:20:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:20:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:20:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:20:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:20:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:20:02 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-12-25 21:20:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 21:20:33 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 21:20:53 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 21:20:58 [DEBUG   ] Got command RPT from MCS: ref #951926
2018-12-25 21:20:58 [DEBUG   ] summary = ERROR
2018-12-25 21:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951926  13 58477 76858485 A  ERRORERROR'
2018-12-25 21:20:58 [DEBUG   ] Got command RPT from MCS: ref #951927
2018-12-25 21:20:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 21:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951927  77 58477 76858486 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 21:21:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:21:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:21:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:21:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:21:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:21:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:21:02 [DEBUG   ] Finished updating board flags in 1.421 seconds
2018-12-25 21:21:13 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-25 21:21:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 21:21:53 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 21:22:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:22:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:22:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:22:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:22:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:22:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:22:02 [DEBUG   ] Finished updating board flags in 1.412 seconds
2018-12-25 21:22:13 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-25 21:22:33 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-25 21:22:54 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-25 21:23:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:23:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 21:23:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:23:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:23:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:23:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:23:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:23:02 [DEBUG   ] Finished updating board flags in 1.416 seconds
2018-12-25 21:23:14 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 21:23:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 21:23:54 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 21:24:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:24:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:24:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:24:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:24:02 [WARNING ] (13, 1, 'bot')
2018-12-25 21:24:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:24:02 [DEBUG   ] Finished updating board flags in 1.426 seconds
2018-12-25 21:24:14 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-25 21:24:23 [DEBUG   ] Got command RPT from MCS: ref #951949
2018-12-25 21:24:23 [DEBUG   ] summary = ERROR
2018-12-25 21:24:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951949  13 58477 77063353 A  ERRORERROR'
2018-12-25 21:24:23 [DEBUG   ] Got command RPT from MCS: ref #951950
2018-12-25 21:24:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 21:24:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951950  77 58477 77063545 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 21:24:23 [DEBUG   ] Got command RPT from MCS: ref #951951
2018-12-25 21:24:23 [DEBUG   ] summary = ERROR
2018-12-25 21:24:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951951  13 58477 77063753 A  ERRORERROR'
2018-12-25 21:24:23 [DEBUG   ] Got command RPT from MCS: ref #951953
2018-12-25 21:24:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 21:24:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951953  77 58477 77063957 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 21:24:24 [DEBUG   ] Got command RPT from MCS: ref #951954
2018-12-25 21:24:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 21:24:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951954  12 58477 77064149 A  ERRORB™™š'
2018-12-25 21:24:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 21:24:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 21:25:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 21:25:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:25:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:25:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:25:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:25:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:25:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:25:03 [DEBUG   ] Finished updating board flags in 2.194 seconds
2018-12-25 21:25:14 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-25 21:25:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 21:25:54 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-25 21:25:58 [DEBUG   ] Got command RPT from MCS: ref #951963
2018-12-25 21:25:58 [DEBUG   ] summary = ERROR
2018-12-25 21:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951963  13 58477 77158485 A  ERRORERROR'
2018-12-25 21:25:58 [DEBUG   ] Got command RPT from MCS: ref #951964
2018-12-25 21:25:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 21:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951964  77 58477 77158486 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 21:26:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:26:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:26:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:26:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:26:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:26:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:26:03 [DEBUG   ] Finished updating board flags in 1.992 seconds
2018-12-25 21:26:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 21:26:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 21:26:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 21:27:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:27:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:27:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:27:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:27:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:27:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:27:03 [DEBUG   ] Finished updating board flags in 1.815 seconds
2018-12-25 21:27:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 21:27:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 21:27:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 21:28:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:28:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 21:28:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:28:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:28:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:28:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:28:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:28:03 [DEBUG   ] Finished updating board flags in 1.865 seconds
2018-12-25 21:28:14 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-12-25 21:28:34 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-25 21:28:54 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-12-25 21:29:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:29:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 21:29:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:29:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:29:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:29:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:29:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:29:03 [DEBUG   ] Finished updating board flags in 1.721 seconds
2018-12-25 21:29:15 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-25 21:29:23 [DEBUG   ] Got command RPT from MCS: ref #951984
2018-12-25 21:29:23 [DEBUG   ] summary = ERROR
2018-12-25 21:29:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951984  13 58477 77363433 A  ERRORERROR'
2018-12-25 21:29:23 [DEBUG   ] Got command RPT from MCS: ref #951985
2018-12-25 21:29:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 21:29:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951985  77 58477 77363637 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 21:29:23 [DEBUG   ] Got command RPT from MCS: ref #951986
2018-12-25 21:29:23 [DEBUG   ] summary = ERROR
2018-12-25 21:29:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951986  13 58477 77363842 A  ERRORERROR'
2018-12-25 21:29:24 [DEBUG   ] Got command RPT from MCS: ref #951987
2018-12-25 21:29:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 21:29:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951987  77 58477 77364033 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 21:29:24 [DEBUG   ] Got command RPT from MCS: ref #951988
2018-12-25 21:29:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 21:29:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951988  12 58477 77364243 A  ERRORB™™š'
2018-12-25 21:29:35 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-25 21:29:55 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-25 21:30:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:30:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:30:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:30:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:30:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:30:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:30:03 [DEBUG   ] Finished updating board flags in 1.622 seconds
2018-12-25 21:30:15 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 21:30:35 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-25 21:30:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 21:30:58 [DEBUG   ] Got command RPT from MCS: ref #951993
2018-12-25 21:30:58 [DEBUG   ] summary = ERROR
2018-12-25 21:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951993  13 58477 77458485 A  ERRORERROR'
2018-12-25 21:30:58 [DEBUG   ] Got command RPT from MCS: ref #951994
2018-12-25 21:30:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 21:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   951994  77 58477 77458486 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 21:31:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:31:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 21:31:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:31:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:31:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:31:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:31:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:31:03 [DEBUG   ] Finished updating board flags in 1.589 seconds
2018-12-25 21:31:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 21:31:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 21:31:55 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 21:32:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:32:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:32:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:32:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:32:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:32:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:32:03 [DEBUG   ] Finished updating board flags in 1.417 seconds
2018-12-25 21:32:15 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-25 21:32:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 21:32:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 21:33:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:33:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-25 21:33:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:33:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:33:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:33:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:33:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:33:03 [DEBUG   ] Finished updating board flags in 1.417 seconds
2018-12-25 21:33:15 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 21:33:35 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-25 21:33:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 21:34:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:34:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:34:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:34:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:34:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:34:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:34:03 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-12-25 21:34:15 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 21:34:23 [DEBUG   ] Got command RPT from MCS: ref #952016
2018-12-25 21:34:23 [DEBUG   ] summary = ERROR
2018-12-25 21:34:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952016  13 58477 77663505 A  ERRORERROR'
2018-12-25 21:34:23 [DEBUG   ] Got command RPT from MCS: ref #952017
2018-12-25 21:34:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 21:34:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952017  77 58477 77663709 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 21:34:23 [DEBUG   ] Got command RPT from MCS: ref #952018
2018-12-25 21:34:23 [DEBUG   ] summary = ERROR
2018-12-25 21:34:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952018  13 58477 77663913 A  ERRORERROR'
2018-12-25 21:34:24 [DEBUG   ] Got command RPT from MCS: ref #952020
2018-12-25 21:34:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 21:34:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952020  77 58477 77664117 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 21:34:24 [DEBUG   ] Got command RPT from MCS: ref #952021
2018-12-25 21:34:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 21:34:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952021  12 58477 77664309 A  ERRORB˜™š'
2018-12-25 21:34:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 21:34:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 21:35:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 21:35:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:35:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:35:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:35:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:35:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:35:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:35:03 [DEBUG   ] Finished updating board flags in 1.470 seconds
2018-12-25 21:35:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 21:35:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 21:35:55 [DEBUG   ] Finished updating ant stats in 0.588 seconds
2018-12-25 21:35:58 [DEBUG   ] Got command RPT from MCS: ref #952026
2018-12-25 21:35:58 [DEBUG   ] summary = ERROR
2018-12-25 21:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952026  13 58477 77758481 A  ERRORERROR'
2018-12-25 21:35:58 [DEBUG   ] Got command RPT from MCS: ref #952027
2018-12-25 21:35:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 21:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952027  77 58477 77758482 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 21:36:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:36:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:36:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:36:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:36:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:36:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:36:03 [DEBUG   ] Finished updating board flags in 1.462 seconds
2018-12-25 21:36:15 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-25 21:36:36 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-25 21:36:56 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-25 21:37:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:37:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:37:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:37:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:37:03 [WARNING ] (13, 1, 'bot')
2018-12-25 21:37:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:37:03 [DEBUG   ] Finished updating board flags in 1.472 seconds
2018-12-25 21:37:16 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-25 21:37:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 21:37:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 21:38:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:38:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 21:38:04 [WARNING ] (13, 1, 'bot')
2018-12-25 21:38:04 [WARNING ] (13, 1, 'bot')
2018-12-25 21:38:04 [WARNING ] (13, 1, 'bot')
2018-12-25 21:38:04 [WARNING ] (13, 1, 'bot')
2018-12-25 21:38:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:38:04 [DEBUG   ] Finished updating board flags in 2.190 seconds
2018-12-25 21:38:16 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 21:38:36 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-25 21:38:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 21:39:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:39:04 [WARNING ] (13, 1, 'bot')
2018-12-25 21:39:04 [WARNING ] (13, 1, 'bot')
2018-12-25 21:39:04 [WARNING ] (13, 1, 'bot')
2018-12-25 21:39:04 [WARNING ] (13, 1, 'bot')
2018-12-25 21:39:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:39:04 [DEBUG   ] Finished updating board flags in 1.958 seconds
2018-12-25 21:39:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 21:39:23 [DEBUG   ] Got command RPT from MCS: ref #952047
2018-12-25 21:39:23 [DEBUG   ] summary = ERROR
2018-12-25 21:39:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952047  13 58477 77963589 A  ERRORERROR'
2018-12-25 21:39:23 [DEBUG   ] Got command RPT from MCS: ref #952048
2018-12-25 21:39:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 21:39:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952048  77 58477 77963793 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 21:39:23 [DEBUG   ] Got command RPT from MCS: ref #952049
2018-12-25 21:39:23 [DEBUG   ] summary = ERROR
2018-12-25 21:39:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952049  13 58477 77963997 A  ERRORERROR'
2018-12-25 21:39:24 [DEBUG   ] Got command RPT from MCS: ref #952050
2018-12-25 21:39:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 21:39:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952050  77 58477 77964189 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 21:39:24 [DEBUG   ] Got command RPT from MCS: ref #952051
2018-12-25 21:39:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 21:39:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952051  12 58477 77964393 A  ERRORB™™š'
2018-12-25 21:39:36 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 21:39:56 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-25 21:40:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:40:04 [WARNING ] (13, 1, 'bot')
2018-12-25 21:40:04 [WARNING ] (13, 1, 'bot')
2018-12-25 21:40:04 [WARNING ] (13, 1, 'bot')
2018-12-25 21:40:04 [WARNING ] (13, 1, 'bot')
2018-12-25 21:40:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:40:04 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-12-25 21:40:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 21:40:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 21:40:56 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 21:40:58 [DEBUG   ] Got command RPT from MCS: ref #952056
2018-12-25 21:40:58 [DEBUG   ] summary = ERROR
2018-12-25 21:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952056  13 58477 78058485 A  ERRORERROR'
2018-12-25 21:40:58 [DEBUG   ] Got command RPT from MCS: ref #952057
2018-12-25 21:40:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 21:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952057  77 58477 78058486 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 21:41:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:41:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-12-25 21:41:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 21:41:04 [WARNING ] (13, 1, 'bot')
2018-12-25 21:41:04 [WARNING ] (13, 1, 'bot')
2018-12-25 21:41:04 [WARNING ] (13, 1, 'bot')
2018-12-25 21:41:04 [WARNING ] (13, 1, 'bot')
2018-12-25 21:41:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:41:04 [DEBUG   ] Finished updating board flags in 1.784 seconds
2018-12-25 21:41:16 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-25 21:41:37 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-25 21:41:57 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-25 21:42:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:42:04 [WARNING ] (13, 1, 'bot')
2018-12-25 21:42:04 [WARNING ] (13, 1, 'bot')
2018-12-25 21:42:04 [WARNING ] (13, 1, 'bot')
2018-12-25 21:42:04 [WARNING ] (13, 1, 'bot')
2018-12-25 21:42:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:42:04 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-12-25 21:42:17 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-25 21:42:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 21:42:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 21:43:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:43:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-25 21:43:04 [WARNING ] (13, 1, 'bot')
2018-12-25 21:43:04 [WARNING ] (13, 1, 'bot')
2018-12-25 21:43:04 [WARNING ] (13, 1, 'bot')
2018-12-25 21:43:04 [WARNING ] (13, 1, 'bot')
2018-12-25 21:43:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:43:04 [DEBUG   ] Finished updating board flags in 1.610 seconds
2018-12-25 21:43:17 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 21:43:37 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-12-25 21:43:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 21:44:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:44:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 21:44:04 [WARNING ] (13, 1, 'bot')
2018-12-25 21:44:04 [WARNING ] (13, 1, 'bot')
2018-12-25 21:44:04 [WARNING ] (13, 1, 'bot')
2018-12-25 21:44:04 [WARNING ] (13, 1, 'bot')
2018-12-25 21:44:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:44:04 [DEBUG   ] Finished updating board flags in 1.589 seconds
2018-12-25 21:44:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 21:44:23 [DEBUG   ] Got command RPT from MCS: ref #952079
2018-12-25 21:44:23 [DEBUG   ] summary = ERROR
2018-12-25 21:44:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952079  13 58477 78263673 A  ERRORERROR'
2018-12-25 21:44:23 [DEBUG   ] Got command RPT from MCS: ref #952080
2018-12-25 21:44:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 21:44:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952080  77 58477 78263878 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 21:44:24 [DEBUG   ] Got command RPT from MCS: ref #952081
2018-12-25 21:44:24 [DEBUG   ] summary = ERROR
2018-12-25 21:44:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952081  13 58477 78264069 A  ERRORERROR'
2018-12-25 21:44:24 [DEBUG   ] Got command RPT from MCS: ref #952083
2018-12-25 21:44:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 21:44:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952083  77 58477 78264273 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 21:44:24 [DEBUG   ] Got command RPT from MCS: ref #952085
2018-12-25 21:44:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 21:44:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952085  12 58477 78264477 A  ERRORBš™š'
2018-12-25 21:44:37 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 21:44:57 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-25 21:45:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-25 21:45:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:45:04 [WARNING ] (13, 1, 'bot')
2018-12-25 21:45:04 [WARNING ] (13, 1, 'bot')
2018-12-25 21:45:04 [WARNING ] (13, 1, 'bot')
2018-12-25 21:45:04 [WARNING ] (13, 1, 'bot')
2018-12-25 21:45:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:45:04 [DEBUG   ] Finished updating board flags in 1.506 seconds
2018-12-25 21:45:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 21:45:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 21:45:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 21:45:58 [DEBUG   ] Got command RPT from MCS: ref #952093
2018-12-25 21:45:58 [DEBUG   ] summary = ERROR
2018-12-25 21:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952093  13 58477 78358485 A  ERRORERROR'
2018-12-25 21:45:58 [DEBUG   ] Got command RPT from MCS: ref #952094
2018-12-25 21:45:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 21:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952094  77 58477 78358486 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 21:46:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:46:04 [WARNING ] (13, 1, 'bot')
2018-12-25 21:46:04 [WARNING ] (13, 1, 'bot')
2018-12-25 21:46:04 [WARNING ] (13, 1, 'bot')
2018-12-25 21:46:04 [WARNING ] (13, 1, 'bot')
2018-12-25 21:46:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:46:04 [DEBUG   ] Finished updating board flags in 1.491 seconds
2018-12-25 21:46:17 [DEBUG   ] Finished updating ant stats in 0.593 seconds
2018-12-25 21:46:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-25 21:46:57 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-25 21:47:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:47:04 [WARNING ] (13, 1, 'bot')
2018-12-25 21:47:04 [WARNING ] (13, 1, 'bot')
2018-12-25 21:47:04 [WARNING ] (13, 1, 'bot')
2018-12-25 21:47:04 [WARNING ] (13, 1, 'bot')
2018-12-25 21:47:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:47:04 [DEBUG   ] Finished updating board flags in 1.496 seconds
2018-12-25 21:47:17 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-25 21:47:38 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-12-25 21:47:58 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-25 21:48:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-25 21:48:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:48:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 21:48:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-25 21:48:05 [WARNING ] (13, 1, 'bot')
2018-12-25 21:48:05 [WARNING ] (13, 1, 'bot')
2018-12-25 21:48:05 [WARNING ] (13, 1, 'bot')
2018-12-25 21:48:05 [WARNING ] (13, 1, 'bot')
2018-12-25 21:48:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:48:05 [DEBUG   ] Finished updating board flags in 2.207 seconds
2018-12-25 21:48:18 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-25 21:48:38 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 21:48:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 21:49:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:49:05 [WARNING ] (13, 1, 'bot')
2018-12-25 21:49:05 [WARNING ] (13, 1, 'bot')
2018-12-25 21:49:05 [WARNING ] (13, 1, 'bot')
2018-12-25 21:49:05 [WARNING ] (13, 1, 'bot')
2018-12-25 21:49:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:49:05 [DEBUG   ] Finished updating board flags in 2.164 seconds
2018-12-25 21:49:18 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 21:49:23 [DEBUG   ] Got command RPT from MCS: ref #952114
2018-12-25 21:49:23 [DEBUG   ] summary = ERROR
2018-12-25 21:49:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952114  13 58477 78563749 A  ERRORERROR'
2018-12-25 21:49:23 [DEBUG   ] Got command RPT from MCS: ref #952115
2018-12-25 21:49:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 21:49:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952115  77 58477 78563953 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 21:49:24 [DEBUG   ] Got command RPT from MCS: ref #952116
2018-12-25 21:49:24 [DEBUG   ] summary = ERROR
2018-12-25 21:49:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952116  13 58477 78564157 A  ERRORERROR'
2018-12-25 21:49:24 [DEBUG   ] Got command RPT from MCS: ref #952117
2018-12-25 21:49:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 21:49:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952117  77 58477 78564349 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 21:49:24 [DEBUG   ] Got command RPT from MCS: ref #952118
2018-12-25 21:49:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 21:49:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952118  12 58477 78564553 A  ERRORBš™š'
2018-12-25 21:49:38 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-25 21:49:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 21:50:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:50:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-25 21:50:05 [WARNING ] (13, 1, 'bot')
2018-12-25 21:50:05 [WARNING ] (13, 1, 'bot')
2018-12-25 21:50:05 [WARNING ] (13, 1, 'bot')
2018-12-25 21:50:05 [WARNING ] (13, 1, 'bot')
2018-12-25 21:50:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:50:05 [DEBUG   ] Finished updating board flags in 1.957 seconds
2018-12-25 21:50:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 21:50:38 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 21:50:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 21:50:58 [DEBUG   ] Got command RPT from MCS: ref #952119
2018-12-25 21:50:58 [DEBUG   ] summary = ERROR
2018-12-25 21:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952119  13 58477 78658481 A  ERRORERROR'
2018-12-25 21:50:58 [DEBUG   ] Got command RPT from MCS: ref #952120
2018-12-25 21:50:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 21:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952120  77 58477 78658482 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 21:51:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:51:05 [WARNING ] (13, 1, 'bot')
2018-12-25 21:51:05 [WARNING ] (13, 1, 'bot')
2018-12-25 21:51:05 [WARNING ] (13, 1, 'bot')
2018-12-25 21:51:05 [WARNING ] (13, 1, 'bot')
2018-12-25 21:51:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:51:05 [DEBUG   ] Finished updating board flags in 1.792 seconds
2018-12-25 21:51:18 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-25 21:51:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 21:51:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 21:52:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:52:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-12-25 21:52:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 21:52:05 [WARNING ] (13, 1, 'bot')
2018-12-25 21:52:05 [WARNING ] (13, 1, 'bot')
2018-12-25 21:52:05 [WARNING ] (13, 1, 'bot')
2018-12-25 21:52:05 [WARNING ] (13, 1, 'bot')
2018-12-25 21:52:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:52:05 [DEBUG   ] Finished updating board flags in 1.608 seconds
2018-12-25 21:52:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 21:52:38 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-25 21:52:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 21:53:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:53:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-25 21:53:05 [WARNING ] (13, 1, 'bot')
2018-12-25 21:53:05 [WARNING ] (13, 1, 'bot')
2018-12-25 21:53:05 [WARNING ] (13, 1, 'bot')
2018-12-25 21:53:05 [WARNING ] (13, 1, 'bot')
2018-12-25 21:53:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:53:05 [DEBUG   ] Finished updating board flags in 1.588 seconds
2018-12-25 21:53:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 21:53:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 21:53:58 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-25 21:54:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:54:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 21:54:05 [WARNING ] (13, 1, 'bot')
2018-12-25 21:54:05 [WARNING ] (13, 1, 'bot')
2018-12-25 21:54:05 [WARNING ] (13, 1, 'bot')
2018-12-25 21:54:05 [WARNING ] (13, 1, 'bot')
2018-12-25 21:54:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:54:05 [DEBUG   ] Finished updating board flags in 1.492 seconds
2018-12-25 21:54:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 21:54:23 [DEBUG   ] Got command RPT from MCS: ref #952142
2018-12-25 21:54:23 [DEBUG   ] summary = ERROR
2018-12-25 21:54:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952142  13 58477 78863848 A  ERRORERROR'
2018-12-25 21:54:24 [DEBUG   ] Got command RPT from MCS: ref #952143
2018-12-25 21:54:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 21:54:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952143  77 58477 78864025 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 21:54:24 [DEBUG   ] Got command RPT from MCS: ref #952144
2018-12-25 21:54:24 [DEBUG   ] summary = ERROR
2018-12-25 21:54:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952144  13 58477 78864229 A  ERRORERROR'
2018-12-25 21:54:24 [DEBUG   ] Got command RPT from MCS: ref #952146
2018-12-25 21:54:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 21:54:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952146  77 58477 78864433 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 21:54:24 [DEBUG   ] Got command RPT from MCS: ref #952148
2018-12-25 21:54:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 21:54:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952148  12 58477 78864637 A  ERRORB™™š'
2018-12-25 21:54:38 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 21:54:58 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-25 21:55:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 21:55:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:55:05 [WARNING ] (13, 1, 'bot')
2018-12-25 21:55:05 [WARNING ] (13, 1, 'bot')
2018-12-25 21:55:05 [WARNING ] (13, 1, 'bot')
2018-12-25 21:55:05 [WARNING ] (13, 1, 'bot')
2018-12-25 21:55:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:55:05 [DEBUG   ] Finished updating board flags in 1.534 seconds
2018-12-25 21:55:18 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-25 21:55:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 21:55:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 21:55:58 [DEBUG   ] Got command RPT from MCS: ref #952156
2018-12-25 21:55:58 [DEBUG   ] summary = ERROR
2018-12-25 21:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952156  13 58477 78958485 A  ERRORERROR'
2018-12-25 21:55:58 [DEBUG   ] Got command RPT from MCS: ref #952157
2018-12-25 21:55:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 21:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952157  77 58477 78958486 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 21:56:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:56:06 [WARNING ] (13, 1, 'bot')
2018-12-25 21:56:06 [WARNING ] (13, 1, 'bot')
2018-12-25 21:56:06 [WARNING ] (13, 1, 'bot')
2018-12-25 21:56:06 [WARNING ] (13, 1, 'bot')
2018-12-25 21:56:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:56:06 [DEBUG   ] Finished updating board flags in 2.303 seconds
2018-12-25 21:56:18 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-25 21:56:38 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-25 21:56:58 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-25 21:57:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:57:06 [WARNING ] (13, 1, 'bot')
2018-12-25 21:57:06 [WARNING ] (13, 1, 'bot')
2018-12-25 21:57:06 [WARNING ] (13, 1, 'bot')
2018-12-25 21:57:06 [WARNING ] (13, 1, 'bot')
2018-12-25 21:57:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:57:06 [DEBUG   ] Finished updating board flags in 2.090 seconds
2018-12-25 21:57:19 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-25 21:57:39 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-25 21:57:59 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 21:58:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:58:06 [WARNING ] (13, 1, 'bot')
2018-12-25 21:58:06 [WARNING ] (13, 1, 'bot')
2018-12-25 21:58:06 [WARNING ] (13, 1, 'bot')
2018-12-25 21:58:06 [WARNING ] (13, 1, 'bot')
2018-12-25 21:58:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:58:06 [DEBUG   ] Finished updating board flags in 2.001 seconds
2018-12-25 21:58:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 21:58:39 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-25 21:58:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 21:59:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 21:59:06 [WARNING ] (13, 1, 'bot')
2018-12-25 21:59:06 [WARNING ] (13, 1, 'bot')
2018-12-25 21:59:06 [WARNING ] (13, 1, 'bot')
2018-12-25 21:59:06 [WARNING ] (13, 1, 'bot')
2018-12-25 21:59:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 21:59:06 [DEBUG   ] Finished updating board flags in 2.002 seconds
2018-12-25 21:59:19 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 21:59:23 [DEBUG   ] Got command RPT from MCS: ref #952177
2018-12-25 21:59:23 [DEBUG   ] summary = ERROR
2018-12-25 21:59:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952177  13 58477 79163913 A  ERRORERROR'
2018-12-25 21:59:24 [DEBUG   ] Got command RPT from MCS: ref #952178
2018-12-25 21:59:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 21:59:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952178  77 58477 79164117 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 21:59:24 [DEBUG   ] Got command RPT from MCS: ref #952179
2018-12-25 21:59:24 [DEBUG   ] summary = ERROR
2018-12-25 21:59:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952179  13 58477 79164309 A  ERRORERROR'
2018-12-25 21:59:24 [DEBUG   ] Got command RPT from MCS: ref #952180
2018-12-25 21:59:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 21:59:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952180  77 58477 79164513 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 21:59:24 [DEBUG   ] Got command RPT from MCS: ref #952181
2018-12-25 21:59:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 21:59:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952181  12 58477 79164717 A  ERRORB™™š'
2018-12-25 21:59:39 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 21:59:59 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-25 22:00:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:00:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 22:00:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:00:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:00:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:00:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:00:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:00:06 [DEBUG   ] Finished updating board flags in 2.004 seconds
2018-12-25 22:00:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 22:00:39 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 22:00:58 [DEBUG   ] Got command RPT from MCS: ref #952186
2018-12-25 22:00:58 [DEBUG   ] summary = ERROR
2018-12-25 22:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952186  13 58477 79258489 A  ERRORERROR'
2018-12-25 22:00:58 [DEBUG   ] Got command RPT from MCS: ref #952187
2018-12-25 22:00:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 22:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952187  77 58477 79258490 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 22:00:59 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 22:01:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:01:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 22:01:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-25 22:01:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:01:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:01:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:01:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:01:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:01:06 [DEBUG   ] Finished updating board flags in 2.018 seconds
2018-12-25 22:01:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 22:01:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-25 22:01:59 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 22:02:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 22:02:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:02:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 22:02:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:02:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:02:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:02:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:02:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:02:06 [DEBUG   ] Finished updating board flags in 1.975 seconds
2018-12-25 22:02:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 22:02:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 22:02:59 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-25 22:03:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:03:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:03:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:03:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:03:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:03:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:03:06 [DEBUG   ] Finished updating board flags in 1.823 seconds
2018-12-25 22:03:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 22:03:39 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 22:03:59 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-25 22:04:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:04:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 22:04:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:04:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:04:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:04:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:04:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:04:06 [DEBUG   ] Finished updating board flags in 1.898 seconds
2018-12-25 22:04:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 22:04:23 [DEBUG   ] Got command RPT from MCS: ref #952209
2018-12-25 22:04:24 [DEBUG   ] summary = ERROR
2018-12-25 22:04:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952209  13 58477 79464016 A  ERRORERROR'
2018-12-25 22:04:24 [DEBUG   ] Got command RPT from MCS: ref #952210
2018-12-25 22:04:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 22:04:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952210  77 58477 79464193 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 22:04:24 [DEBUG   ] Got command RPT from MCS: ref #952211
2018-12-25 22:04:24 [DEBUG   ] summary = ERROR
2018-12-25 22:04:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952211  13 58477 79464397 A  ERRORERROR'
2018-12-25 22:04:24 [DEBUG   ] Got command RPT from MCS: ref #952213
2018-12-25 22:04:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 22:04:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952213  77 58477 79464589 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 22:04:24 [DEBUG   ] Got command RPT from MCS: ref #952215
2018-12-25 22:04:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 22:04:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952215  12 58477 79464793 A  ERRORB˜™š'
2018-12-25 22:04:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 22:04:59 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 22:05:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:05:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 22:05:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:05:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:05:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:05:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:05:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:05:06 [DEBUG   ] Finished updating board flags in 1.691 seconds
2018-12-25 22:05:19 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 22:05:39 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-25 22:05:58 [DEBUG   ] Got command RPT from MCS: ref #952219
2018-12-25 22:05:58 [DEBUG   ] summary = ERROR
2018-12-25 22:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952219  13 58477 79558489 A  ERRORERROR'
2018-12-25 22:05:58 [DEBUG   ] Got command RPT from MCS: ref #952220
2018-12-25 22:05:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 22:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952220  77 58477 79558490 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 22:05:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 22:06:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:06:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:06:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:06:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:06:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:06:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:06:06 [DEBUG   ] Finished updating board flags in 1.628 seconds
2018-12-25 22:06:19 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-25 22:06:39 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-25 22:06:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-25 22:07:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 22:07:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:07:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:07:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:07:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:07:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:07:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:07:06 [DEBUG   ] Finished updating board flags in 1.582 seconds
2018-12-25 22:07:20 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-25 22:07:39 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-25 22:08:00 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-12-25 22:08:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:08:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:08:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:08:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:08:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:08:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:08:06 [DEBUG   ] Finished updating board flags in 1.427 seconds
2018-12-25 22:08:20 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-25 22:08:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 22:09:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 22:09:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:09:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 22:09:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:09:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:09:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:09:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:09:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:09:06 [DEBUG   ] Finished updating board flags in 1.431 seconds
2018-12-25 22:09:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 22:09:24 [DEBUG   ] Got command RPT from MCS: ref #952240
2018-12-25 22:09:24 [DEBUG   ] summary = ERROR
2018-12-25 22:09:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952240  13 58477 79764069 A  ERRORERROR'
2018-12-25 22:09:24 [DEBUG   ] Got command RPT from MCS: ref #952241
2018-12-25 22:09:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 22:09:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952241  77 58477 79764273 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 22:09:24 [DEBUG   ] Got command RPT from MCS: ref #952242
2018-12-25 22:09:24 [DEBUG   ] summary = ERROR
2018-12-25 22:09:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952242  13 58477 79764477 A  ERRORERROR'
2018-12-25 22:09:24 [DEBUG   ] Got command RPT from MCS: ref #952243
2018-12-25 22:09:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 22:09:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952243  77 58477 79764681 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 22:09:24 [DEBUG   ] Got command RPT from MCS: ref #952244
2018-12-25 22:09:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 22:09:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952244  12 58477 79764873 A  ERRORB˜™š'
2018-12-25 22:09:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 22:10:00 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 22:10:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:10:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:10:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:10:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:10:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:10:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:10:06 [DEBUG   ] Finished updating board flags in 1.467 seconds
2018-12-25 22:10:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 22:10:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 22:10:58 [DEBUG   ] Got command RPT from MCS: ref #952249
2018-12-25 22:10:58 [DEBUG   ] summary = ERROR
2018-12-25 22:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952249  13 58477 79858493 A  ERRORERROR'
2018-12-25 22:10:58 [DEBUG   ] Got command RPT from MCS: ref #952250
2018-12-25 22:10:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 22:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952250  77 58477 79858494 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 22:11:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 22:11:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:11:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:11:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:11:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:11:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:11:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:11:06 [DEBUG   ] Finished updating board flags in 1.471 seconds
2018-12-25 22:11:20 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 22:11:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 22:12:00 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-25 22:12:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:12:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:12:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:12:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:12:06 [WARNING ] (13, 1, 'bot')
2018-12-25 22:12:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:12:06 [DEBUG   ] Finished updating board flags in 1.491 seconds
2018-12-25 22:12:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 22:12:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 22:13:00 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2018-12-25 22:13:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:13:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 22:13:07 [WARNING ] (13, 1, 'bot')
2018-12-25 22:13:07 [WARNING ] (13, 1, 'bot')
2018-12-25 22:13:07 [WARNING ] (13, 1, 'bot')
2018-12-25 22:13:07 [WARNING ] (13, 1, 'bot')
2018-12-25 22:13:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:13:07 [DEBUG   ] Finished updating board flags in 2.152 seconds
2018-12-25 22:13:20 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-25 22:13:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 22:14:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 22:14:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:14:07 [WARNING ] (13, 1, 'bot')
2018-12-25 22:14:07 [WARNING ] (13, 1, 'bot')
2018-12-25 22:14:07 [WARNING ] (13, 1, 'bot')
2018-12-25 22:14:07 [WARNING ] (13, 1, 'bot')
2018-12-25 22:14:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:14:07 [DEBUG   ] Finished updating board flags in 1.957 seconds
2018-12-25 22:14:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 22:14:24 [DEBUG   ] Got command RPT from MCS: ref #952272
2018-12-25 22:14:24 [DEBUG   ] summary = ERROR
2018-12-25 22:14:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952272  13 58477 80064153 A  ERRORERROR'
2018-12-25 22:14:24 [DEBUG   ] Got command RPT from MCS: ref #952273
2018-12-25 22:14:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 22:14:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952273  77 58477 80064357 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 22:14:24 [DEBUG   ] Got command RPT from MCS: ref #952274
2018-12-25 22:14:24 [DEBUG   ] summary = ERROR
2018-12-25 22:14:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952274  13 58477 80064549 A  ERRORERROR'
2018-12-25 22:14:24 [DEBUG   ] Got command RPT from MCS: ref #952276
2018-12-25 22:14:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 22:14:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952276  77 58477 80064753 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 22:14:24 [DEBUG   ] Got command RPT from MCS: ref #952277
2018-12-25 22:14:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 22:14:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952277  12 58477 80064957 A  ERRORB˜™š'
2018-12-25 22:14:40 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-25 22:15:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 22:15:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:15:07 [WARNING ] (13, 1, 'bot')
2018-12-25 22:15:07 [WARNING ] (13, 1, 'bot')
2018-12-25 22:15:07 [WARNING ] (13, 1, 'bot')
2018-12-25 22:15:07 [WARNING ] (13, 1, 'bot')
2018-12-25 22:15:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:15:07 [DEBUG   ] Finished updating board flags in 1.903 seconds
2018-12-25 22:15:20 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-25 22:15:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 22:15:58 [DEBUG   ] Got command RPT from MCS: ref #952286
2018-12-25 22:15:58 [DEBUG   ] summary = ERROR
2018-12-25 22:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952286  13 58477 80158489 A  ERRORERROR'
2018-12-25 22:15:58 [DEBUG   ] Got command RPT from MCS: ref #952287
2018-12-25 22:15:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 22:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952287  77 58477 80158490 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 22:16:00 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-25 22:16:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:16:07 [WARNING ] (13, 1, 'bot')
2018-12-25 22:16:07 [WARNING ] (13, 1, 'bot')
2018-12-25 22:16:07 [WARNING ] (13, 1, 'bot')
2018-12-25 22:16:07 [WARNING ] (13, 1, 'bot')
2018-12-25 22:16:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:16:07 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-12-25 22:16:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 22:16:40 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 22:17:00 [DEBUG   ] Finished updating ant stats in 0.523 seconds
2018-12-25 22:17:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:17:07 [WARNING ] (13, 1, 'bot')
2018-12-25 22:17:07 [WARNING ] (13, 1, 'bot')
2018-12-25 22:17:07 [WARNING ] (13, 1, 'bot')
2018-12-25 22:17:07 [WARNING ] (13, 1, 'bot')
2018-12-25 22:17:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:17:07 [DEBUG   ] Finished updating board flags in 1.697 seconds
2018-12-25 22:17:20 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-12-25 22:17:41 [DEBUG   ] Finished updating ant stats in 1.311 seconds
2018-12-25 22:18:01 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 22:18:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:18:07 [WARNING ] (13, 1, 'bot')
2018-12-25 22:18:07 [WARNING ] (13, 1, 'bot')
2018-12-25 22:18:07 [WARNING ] (13, 1, 'bot')
2018-12-25 22:18:07 [WARNING ] (13, 1, 'bot')
2018-12-25 22:18:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:18:07 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-12-25 22:18:21 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-25 22:18:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 22:19:01 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 22:19:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 22:19:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:19:07 [WARNING ] (13, 1, 'bot')
2018-12-25 22:19:07 [WARNING ] (13, 1, 'bot')
2018-12-25 22:19:07 [WARNING ] (13, 1, 'bot')
2018-12-25 22:19:07 [WARNING ] (13, 1, 'bot')
2018-12-25 22:19:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:19:07 [DEBUG   ] Finished updating board flags in 1.579 seconds
2018-12-25 22:19:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 22:19:24 [DEBUG   ] Got command RPT from MCS: ref #952307
2018-12-25 22:19:24 [DEBUG   ] summary = ERROR
2018-12-25 22:19:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952307  13 58477 80364233 A  ERRORERROR'
2018-12-25 22:19:24 [DEBUG   ] Got command RPT from MCS: ref #952308
2018-12-25 22:19:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 22:19:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952308  77 58477 80364437 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 22:19:24 [DEBUG   ] Got command RPT from MCS: ref #952309
2018-12-25 22:19:24 [DEBUG   ] summary = ERROR
2018-12-25 22:19:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952309  13 58477 80364641 A  ERRORERROR'
2018-12-25 22:19:24 [DEBUG   ] Got command RPT from MCS: ref #952310
2018-12-25 22:19:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 22:19:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952310  77 58477 80364833 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 22:19:25 [DEBUG   ] Got command RPT from MCS: ref #952311
2018-12-25 22:19:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 22:19:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952311  12 58477 80365037 A  ERRORB˜™š'
2018-12-25 22:19:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 22:20:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 22:20:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:20:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-12-25 22:20:07 [WARNING ] (13, 1, 'bot')
2018-12-25 22:20:07 [WARNING ] (13, 1, 'bot')
2018-12-25 22:20:07 [WARNING ] (13, 1, 'bot')
2018-12-25 22:20:07 [WARNING ] (13, 1, 'bot')
2018-12-25 22:20:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:20:07 [DEBUG   ] Finished updating board flags in 1.431 seconds
2018-12-25 22:20:21 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 22:20:41 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-12-25 22:20:58 [DEBUG   ] Got command RPT from MCS: ref #952312
2018-12-25 22:20:58 [DEBUG   ] summary = ERROR
2018-12-25 22:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952312  13 58477 80458493 A  ERRORERROR'
2018-12-25 22:20:58 [DEBUG   ] Got command RPT from MCS: ref #952313
2018-12-25 22:20:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 22:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952313  77 58477 80458494 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 22:21:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 22:21:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:21:07 [WARNING ] (13, 1, 'bot')
2018-12-25 22:21:07 [WARNING ] (13, 1, 'bot')
2018-12-25 22:21:07 [WARNING ] (13, 1, 'bot')
2018-12-25 22:21:07 [WARNING ] (13, 1, 'bot')
2018-12-25 22:21:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:21:07 [DEBUG   ] Finished updating board flags in 1.376 seconds
2018-12-25 22:21:21 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 22:21:41 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 22:22:01 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-12-25 22:22:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:22:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-12-25 22:22:07 [WARNING ] (13, 1, 'bot')
2018-12-25 22:22:07 [WARNING ] (13, 1, 'bot')
2018-12-25 22:22:07 [WARNING ] (13, 1, 'bot')
2018-12-25 22:22:07 [WARNING ] (13, 1, 'bot')
2018-12-25 22:22:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:22:07 [DEBUG   ] Finished updating board flags in 1.353 seconds
2018-12-25 22:22:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 22:22:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 22:23:01 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2018-12-25 22:23:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:23:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 22:23:08 [WARNING ] (13, 1, 'bot')
2018-12-25 22:23:08 [WARNING ] (13, 1, 'bot')
2018-12-25 22:23:08 [WARNING ] (13, 1, 'bot')
2018-12-25 22:23:08 [WARNING ] (13, 1, 'bot')
2018-12-25 22:23:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:23:08 [DEBUG   ] Finished updating board flags in 2.068 seconds
2018-12-25 22:23:21 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-25 22:23:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-25 22:24:02 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-25 22:24:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 22:24:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:24:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-12-25 22:24:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 22:24:08 [WARNING ] (13, 1, 'bot')
2018-12-25 22:24:08 [WARNING ] (13, 1, 'bot')
2018-12-25 22:24:08 [WARNING ] (13, 1, 'bot')
2018-12-25 22:24:08 [WARNING ] (13, 1, 'bot')
2018-12-25 22:24:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:24:08 [DEBUG   ] Finished updating board flags in 1.989 seconds
2018-12-25 22:24:22 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-25 22:24:24 [DEBUG   ] Got command RPT from MCS: ref #952335
2018-12-25 22:24:24 [DEBUG   ] summary = ERROR
2018-12-25 22:24:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952335  13 58477 80664309 A  ERRORERROR'
2018-12-25 22:24:24 [DEBUG   ] Got command RPT from MCS: ref #952336
2018-12-25 22:24:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 22:24:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952336  77 58477 80664513 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 22:24:24 [DEBUG   ] Got command RPT from MCS: ref #952337
2018-12-25 22:24:24 [DEBUG   ] summary = ERROR
2018-12-25 22:24:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952337  13 58477 80664717 A  ERRORERROR'
2018-12-25 22:24:24 [DEBUG   ] Got command RPT from MCS: ref #952339
2018-12-25 22:24:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 22:24:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952339  77 58477 80664921 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 22:24:25 [DEBUG   ] Got command RPT from MCS: ref #952340
2018-12-25 22:24:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 22:24:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952340  12 58477 80665113 A  ERRORBš™š'
2018-12-25 22:24:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 22:25:02 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 22:25:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:25:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-12-25 22:25:08 [WARNING ] (13, 1, 'bot')
2018-12-25 22:25:08 [WARNING ] (13, 1, 'bot')
2018-12-25 22:25:08 [WARNING ] (13, 1, 'bot')
2018-12-25 22:25:08 [WARNING ] (13, 1, 'bot')
2018-12-25 22:25:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:25:08 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-12-25 22:25:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 22:25:42 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-25 22:25:58 [DEBUG   ] Got command RPT from MCS: ref #952349
2018-12-25 22:25:58 [DEBUG   ] summary = ERROR
2018-12-25 22:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952349  13 58477 80758493 A  ERRORERROR'
2018-12-25 22:25:58 [DEBUG   ] Got command RPT from MCS: ref #952350
2018-12-25 22:25:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 22:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952350  77 58477 80758494 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 22:26:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 22:26:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:26:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 22:26:08 [WARNING ] (13, 1, 'bot')
2018-12-25 22:26:08 [WARNING ] (13, 1, 'bot')
2018-12-25 22:26:08 [WARNING ] (13, 1, 'bot')
2018-12-25 22:26:08 [WARNING ] (13, 1, 'bot')
2018-12-25 22:26:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:26:08 [DEBUG   ] Finished updating board flags in 1.886 seconds
2018-12-25 22:26:22 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 22:26:42 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-25 22:27:02 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 22:27:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:27:08 [WARNING ] (13, 1, 'bot')
2018-12-25 22:27:08 [WARNING ] (13, 1, 'bot')
2018-12-25 22:27:08 [WARNING ] (13, 1, 'bot')
2018-12-25 22:27:08 [WARNING ] (13, 1, 'bot')
2018-12-25 22:27:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:27:08 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-12-25 22:27:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 22:27:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 22:28:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 22:28:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:28:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 22:28:08 [WARNING ] (13, 1, 'bot')
2018-12-25 22:28:08 [WARNING ] (13, 1, 'bot')
2018-12-25 22:28:08 [WARNING ] (13, 1, 'bot')
2018-12-25 22:28:08 [WARNING ] (13, 1, 'bot')
2018-12-25 22:28:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:28:08 [DEBUG   ] Finished updating board flags in 1.688 seconds
2018-12-25 22:28:22 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 22:28:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 22:29:02 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 22:29:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:29:08 [WARNING ] (13, 1, 'bot')
2018-12-25 22:29:08 [WARNING ] (13, 1, 'bot')
2018-12-25 22:29:08 [WARNING ] (13, 1, 'bot')
2018-12-25 22:29:08 [WARNING ] (13, 1, 'bot')
2018-12-25 22:29:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:29:08 [DEBUG   ] Finished updating board flags in 1.639 seconds
2018-12-25 22:29:22 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-25 22:29:24 [DEBUG   ] Got command RPT from MCS: ref #952370
2018-12-25 22:29:24 [DEBUG   ] summary = ERROR
2018-12-25 22:29:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952370  13 58477 80964389 A  ERRORERROR'
2018-12-25 22:29:24 [DEBUG   ] Got command RPT from MCS: ref #952371
2018-12-25 22:29:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 22:29:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952371  77 58477 80964593 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 22:29:24 [DEBUG   ] Got command RPT from MCS: ref #952372
2018-12-25 22:29:24 [DEBUG   ] summary = ERROR
2018-12-25 22:29:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952372  13 58477 80964797 A  ERRORERROR'
2018-12-25 22:29:24 [DEBUG   ] Got command RPT from MCS: ref #952373
2018-12-25 22:29:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 22:29:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952373  77 58477 80964989 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 22:29:25 [DEBUG   ] Got command RPT from MCS: ref #952374
2018-12-25 22:29:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 22:29:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952374  12 58477 80965193 A  ERRORB™™š'
2018-12-25 22:29:42 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-25 22:30:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 22:30:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:30:08 [WARNING ] (13, 1, 'bot')
2018-12-25 22:30:08 [WARNING ] (13, 1, 'bot')
2018-12-25 22:30:08 [WARNING ] (13, 1, 'bot')
2018-12-25 22:30:08 [WARNING ] (13, 1, 'bot')
2018-12-25 22:30:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:30:08 [DEBUG   ] Finished updating board flags in 1.583 seconds
2018-12-25 22:30:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 22:30:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 22:30:58 [DEBUG   ] Got command RPT from MCS: ref #952379
2018-12-25 22:30:58 [DEBUG   ] summary = ERROR
2018-12-25 22:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952379  13 58477 81058497 A  ERRORERROR'
2018-12-25 22:30:58 [DEBUG   ] Got command RPT from MCS: ref #952380
2018-12-25 22:30:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 22:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952380  77 58477 81058498 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 22:31:02 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-25 22:31:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:31:08 [WARNING ] (13, 1, 'bot')
2018-12-25 22:31:08 [WARNING ] (13, 1, 'bot')
2018-12-25 22:31:08 [WARNING ] (13, 1, 'bot')
2018-12-25 22:31:08 [WARNING ] (13, 1, 'bot')
2018-12-25 22:31:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:31:08 [DEBUG   ] Finished updating board flags in 1.424 seconds
2018-12-25 22:31:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 22:31:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 22:32:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 22:32:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:32:08 [WARNING ] (13, 1, 'bot')
2018-12-25 22:32:08 [WARNING ] (13, 1, 'bot')
2018-12-25 22:32:08 [WARNING ] (13, 1, 'bot')
2018-12-25 22:32:08 [WARNING ] (13, 1, 'bot')
2018-12-25 22:32:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:32:08 [DEBUG   ] Finished updating board flags in 1.517 seconds
2018-12-25 22:32:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 22:32:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 22:33:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 22:33:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:33:08 [WARNING ] (13, 1, 'bot')
2018-12-25 22:33:08 [WARNING ] (13, 1, 'bot')
2018-12-25 22:33:08 [WARNING ] (13, 1, 'bot')
2018-12-25 22:33:08 [WARNING ] (13, 1, 'bot')
2018-12-25 22:33:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:33:08 [DEBUG   ] Finished updating board flags in 1.550 seconds
2018-12-25 22:33:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 22:33:42 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-25 22:34:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 22:34:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:34:09 [WARNING ] (13, 1, 'bot')
2018-12-25 22:34:09 [WARNING ] (13, 1, 'bot')
2018-12-25 22:34:09 [WARNING ] (13, 1, 'bot')
2018-12-25 22:34:09 [WARNING ] (13, 1, 'bot')
2018-12-25 22:34:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:34:09 [DEBUG   ] Finished updating board flags in 2.220 seconds
2018-12-25 22:34:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 22:34:24 [DEBUG   ] Got command RPT from MCS: ref #952402
2018-12-25 22:34:24 [DEBUG   ] summary = ERROR
2018-12-25 22:34:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952402  13 58477 81264469 A  ERRORERROR'
2018-12-25 22:34:24 [DEBUG   ] Got command RPT from MCS: ref #952403
2018-12-25 22:34:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 22:34:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952403  77 58477 81264673 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 22:34:24 [DEBUG   ] Got command RPT from MCS: ref #952404
2018-12-25 22:34:24 [DEBUG   ] summary = ERROR
2018-12-25 22:34:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952404  13 58477 81264877 A  ERRORERROR'
2018-12-25 22:34:25 [DEBUG   ] Got command RPT from MCS: ref #952405
2018-12-25 22:34:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 22:34:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952405  77 58477 81265081 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 22:34:25 [DEBUG   ] Got command RPT from MCS: ref #952407
2018-12-25 22:34:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 22:34:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952407  12 58477 81265273 A  ERRORB™™š'
2018-12-25 22:34:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 22:35:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 22:35:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:35:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 22:35:09 [WARNING ] (13, 1, 'bot')
2018-12-25 22:35:09 [WARNING ] (13, 1, 'bot')
2018-12-25 22:35:09 [WARNING ] (13, 1, 'bot')
2018-12-25 22:35:09 [WARNING ] (13, 1, 'bot')
2018-12-25 22:35:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:35:09 [DEBUG   ] Finished updating board flags in 2.089 seconds
2018-12-25 22:35:22 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-25 22:35:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 22:35:58 [DEBUG   ] Got command RPT from MCS: ref #952412
2018-12-25 22:35:58 [DEBUG   ] summary = ERROR
2018-12-25 22:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952412  13 58477 81358493 A  ERRORERROR'
2018-12-25 22:35:58 [DEBUG   ] Got command RPT from MCS: ref #952413
2018-12-25 22:35:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 22:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952413  77 58477 81358494 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 22:36:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 22:36:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:36:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-25 22:36:09 [WARNING ] (13, 1, 'bot')
2018-12-25 22:36:09 [WARNING ] (13, 1, 'bot')
2018-12-25 22:36:09 [WARNING ] (13, 1, 'bot')
2018-12-25 22:36:09 [WARNING ] (13, 1, 'bot')
2018-12-25 22:36:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:36:09 [DEBUG   ] Finished updating board flags in 2.035 seconds
2018-12-25 22:36:22 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-25 22:36:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 22:37:02 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 22:37:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 22:37:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:37:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-25 22:37:09 [WARNING ] (13, 1, 'bot')
2018-12-25 22:37:09 [WARNING ] (13, 1, 'bot')
2018-12-25 22:37:09 [WARNING ] (13, 1, 'bot')
2018-12-25 22:37:09 [WARNING ] (13, 1, 'bot')
2018-12-25 22:37:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:37:09 [DEBUG   ] Finished updating board flags in 1.966 seconds
2018-12-25 22:37:22 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-25 22:37:42 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-25 22:38:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 22:38:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:38:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-25 22:38:09 [WARNING ] (13, 1, 'bot')
2018-12-25 22:38:09 [WARNING ] (13, 1, 'bot')
2018-12-25 22:38:09 [WARNING ] (13, 1, 'bot')
2018-12-25 22:38:09 [WARNING ] (13, 1, 'bot')
2018-12-25 22:38:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:38:09 [DEBUG   ] Finished updating board flags in 1.807 seconds
2018-12-25 22:38:22 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 22:38:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 22:39:02 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-25 22:39:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:39:09 [WARNING ] (13, 1, 'bot')
2018-12-25 22:39:09 [WARNING ] (13, 1, 'bot')
2018-12-25 22:39:09 [WARNING ] (13, 1, 'bot')
2018-12-25 22:39:09 [WARNING ] (13, 1, 'bot')
2018-12-25 22:39:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:39:09 [DEBUG   ] Finished updating board flags in 1.788 seconds
2018-12-25 22:39:22 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-25 22:39:24 [DEBUG   ] Got command RPT from MCS: ref #952433
2018-12-25 22:39:24 [DEBUG   ] summary = ERROR
2018-12-25 22:39:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952433  13 58477 81564553 A  ERRORERROR'
2018-12-25 22:39:24 [DEBUG   ] Got command RPT from MCS: ref #952434
2018-12-25 22:39:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 22:39:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952434  77 58477 81564757 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 22:39:24 [DEBUG   ] Got command RPT from MCS: ref #952435
2018-12-25 22:39:24 [DEBUG   ] summary = ERROR
2018-12-25 22:39:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952435  13 58477 81564949 A  ERRORERROR'
2018-12-25 22:39:25 [DEBUG   ] Got command RPT from MCS: ref #952436
2018-12-25 22:39:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 22:39:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952436  77 58477 81565153 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 22:39:25 [DEBUG   ] Got command RPT from MCS: ref #952437
2018-12-25 22:39:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 22:39:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952437  12 58477 81565357 A  ERRORB™™š'
2018-12-25 22:39:42 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 22:40:02 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-25 22:40:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:40:09 [WARNING ] (13, 1, 'bot')
2018-12-25 22:40:09 [WARNING ] (13, 1, 'bot')
2018-12-25 22:40:09 [WARNING ] (13, 1, 'bot')
2018-12-25 22:40:09 [WARNING ] (13, 1, 'bot')
2018-12-25 22:40:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:40:09 [DEBUG   ] Finished updating board flags in 1.657 seconds
2018-12-25 22:40:22 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-12-25 22:40:42 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-25 22:40:58 [DEBUG   ] Got command RPT from MCS: ref #952442
2018-12-25 22:40:58 [DEBUG   ] summary = ERROR
2018-12-25 22:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952442  13 58477 81658493 A  ERRORERROR'
2018-12-25 22:40:58 [DEBUG   ] Got command RPT from MCS: ref #952443
2018-12-25 22:40:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 22:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952443  77 58477 81658494 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 22:41:02 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-25 22:41:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:41:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 22:41:09 [WARNING ] (13, 1, 'bot')
2018-12-25 22:41:09 [WARNING ] (13, 1, 'bot')
2018-12-25 22:41:09 [WARNING ] (13, 1, 'bot')
2018-12-25 22:41:09 [WARNING ] (13, 1, 'bot')
2018-12-25 22:41:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:41:09 [DEBUG   ] Finished updating board flags in 1.554 seconds
2018-12-25 22:41:23 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-12-25 22:41:43 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-25 22:42:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 22:42:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:42:09 [WARNING ] (13, 1, 'bot')
2018-12-25 22:42:09 [WARNING ] (13, 1, 'bot')
2018-12-25 22:42:09 [WARNING ] (13, 1, 'bot')
2018-12-25 22:42:09 [WARNING ] (13, 1, 'bot')
2018-12-25 22:42:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:42:09 [DEBUG   ] Finished updating board flags in 1.408 seconds
2018-12-25 22:42:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 22:42:43 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-25 22:43:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 22:43:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 22:43:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:43:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 22:43:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 22:43:09 [WARNING ] (13, 1, 'bot')
2018-12-25 22:43:09 [WARNING ] (13, 1, 'bot')
2018-12-25 22:43:09 [WARNING ] (13, 1, 'bot')
2018-12-25 22:43:09 [WARNING ] (13, 1, 'bot')
2018-12-25 22:43:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:43:09 [DEBUG   ] Finished updating board flags in 1.527 seconds
2018-12-25 22:43:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 22:43:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 22:44:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-25 22:44:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:44:09 [WARNING ] (13, 1, 'bot')
2018-12-25 22:44:09 [WARNING ] (13, 1, 'bot')
2018-12-25 22:44:09 [WARNING ] (13, 1, 'bot')
2018-12-25 22:44:09 [WARNING ] (13, 1, 'bot')
2018-12-25 22:44:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:44:09 [DEBUG   ] Finished updating board flags in 1.545 seconds
2018-12-25 22:44:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 22:44:24 [DEBUG   ] Got command RPT from MCS: ref #952465
2018-12-25 22:44:24 [DEBUG   ] summary = ERROR
2018-12-25 22:44:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952465  13 58477 81864629 A  ERRORERROR'
2018-12-25 22:44:24 [DEBUG   ] Got command RPT from MCS: ref #952466
2018-12-25 22:44:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 22:44:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952466  77 58477 81864833 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 22:44:25 [DEBUG   ] Got command RPT from MCS: ref #952467
2018-12-25 22:44:25 [DEBUG   ] summary = ERROR
2018-12-25 22:44:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952467  13 58477 81865037 A  ERRORERROR'
2018-12-25 22:44:25 [DEBUG   ] Got command RPT from MCS: ref #952469
2018-12-25 22:44:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 22:44:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952469  77 58477 81865241 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 22:44:25 [DEBUG   ] Got command RPT from MCS: ref #952470
2018-12-25 22:44:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 22:44:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952470  12 58477 81865433 A  ERRORB˜™š'
2018-12-25 22:44:43 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 22:45:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 22:45:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:45:10 [WARNING ] (13, 1, 'bot')
2018-12-25 22:45:10 [WARNING ] (13, 1, 'bot')
2018-12-25 22:45:10 [WARNING ] (13, 1, 'bot')
2018-12-25 22:45:10 [WARNING ] (13, 1, 'bot')
2018-12-25 22:45:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:45:10 [DEBUG   ] Finished updating board flags in 2.198 seconds
2018-12-25 22:45:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 22:45:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 22:45:58 [DEBUG   ] Got command RPT from MCS: ref #952479
2018-12-25 22:45:58 [DEBUG   ] summary = ERROR
2018-12-25 22:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952479  13 58477 81958497 A  ERRORERROR'
2018-12-25 22:45:58 [DEBUG   ] Got command RPT from MCS: ref #952480
2018-12-25 22:45:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 22:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952480  77 58477 81958498 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 22:46:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 22:46:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:46:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 22:46:10 [WARNING ] (13, 1, 'bot')
2018-12-25 22:46:10 [WARNING ] (13, 1, 'bot')
2018-12-25 22:46:10 [WARNING ] (13, 1, 'bot')
2018-12-25 22:46:10 [WARNING ] (13, 1, 'bot')
2018-12-25 22:46:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:46:10 [DEBUG   ] Finished updating board flags in 2.048 seconds
2018-12-25 22:46:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 22:46:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 22:47:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 22:47:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:47:10 [WARNING ] (13, 1, 'bot')
2018-12-25 22:47:10 [WARNING ] (13, 1, 'bot')
2018-12-25 22:47:10 [WARNING ] (13, 1, 'bot')
2018-12-25 22:47:10 [WARNING ] (13, 1, 'bot')
2018-12-25 22:47:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:47:10 [DEBUG   ] Finished updating board flags in 1.875 seconds
2018-12-25 22:47:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 22:47:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 22:48:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 22:48:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 22:48:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:48:10 [WARNING ] (13, 1, 'bot')
2018-12-25 22:48:10 [WARNING ] (13, 1, 'bot')
2018-12-25 22:48:10 [WARNING ] (13, 1, 'bot')
2018-12-25 22:48:10 [WARNING ] (13, 1, 'bot')
2018-12-25 22:48:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:48:10 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-12-25 22:48:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 22:48:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 22:49:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 22:49:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:49:10 [WARNING ] (13, 1, 'bot')
2018-12-25 22:49:10 [WARNING ] (13, 1, 'bot')
2018-12-25 22:49:10 [WARNING ] (13, 1, 'bot')
2018-12-25 22:49:10 [WARNING ] (13, 1, 'bot')
2018-12-25 22:49:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:49:10 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-12-25 22:49:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 22:49:24 [DEBUG   ] Got command RPT from MCS: ref #952500
2018-12-25 22:49:24 [DEBUG   ] summary = ERROR
2018-12-25 22:49:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952500  13 58477 82164717 A  ERRORERROR'
2018-12-25 22:49:24 [DEBUG   ] Got command RPT from MCS: ref #952501
2018-12-25 22:49:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 22:49:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952501  77 58477 82164921 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 22:49:25 [DEBUG   ] Got command RPT from MCS: ref #952502
2018-12-25 22:49:25 [DEBUG   ] summary = ERROR
2018-12-25 22:49:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952502  13 58477 82165113 A  ERRORERROR'
2018-12-25 22:49:25 [DEBUG   ] Got command RPT from MCS: ref #952503
2018-12-25 22:49:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 22:49:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952503  77 58477 82165317 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 22:49:25 [DEBUG   ] Got command RPT from MCS: ref #952504
2018-12-25 22:49:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 22:49:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952504  12 58477 82165521 A  ERRORB˜™š'
2018-12-25 22:49:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 22:50:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 22:50:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:50:10 [WARNING ] (13, 1, 'bot')
2018-12-25 22:50:10 [WARNING ] (13, 1, 'bot')
2018-12-25 22:50:10 [WARNING ] (13, 1, 'bot')
2018-12-25 22:50:10 [WARNING ] (13, 1, 'bot')
2018-12-25 22:50:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:50:10 [DEBUG   ] Finished updating board flags in 1.804 seconds
2018-12-25 22:50:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 22:50:43 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-25 22:50:58 [DEBUG   ] Got command RPT from MCS: ref #952505
2018-12-25 22:50:58 [DEBUG   ] summary = ERROR
2018-12-25 22:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952505  13 58477 82258493 A  ERRORERROR'
2018-12-25 22:50:58 [DEBUG   ] Got command RPT from MCS: ref #952506
2018-12-25 22:50:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 22:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952506  77 58477 82258494 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 22:51:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 22:51:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:51:10 [WARNING ] (13, 1, 'bot')
2018-12-25 22:51:10 [WARNING ] (13, 1, 'bot')
2018-12-25 22:51:10 [WARNING ] (13, 1, 'bot')
2018-12-25 22:51:10 [WARNING ] (13, 1, 'bot')
2018-12-25 22:51:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:51:10 [DEBUG   ] Finished updating board flags in 1.906 seconds
2018-12-25 22:51:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 22:51:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 22:52:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-25 22:52:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:52:10 [WARNING ] (13, 1, 'bot')
2018-12-25 22:52:10 [WARNING ] (13, 1, 'bot')
2018-12-25 22:52:10 [WARNING ] (13, 1, 'bot')
2018-12-25 22:52:10 [WARNING ] (13, 1, 'bot')
2018-12-25 22:52:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:52:10 [DEBUG   ] Finished updating board flags in 1.691 seconds
2018-12-25 22:52:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 22:52:43 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 22:53:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 22:53:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:53:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-25 22:53:10 [WARNING ] (13, 1, 'bot')
2018-12-25 22:53:10 [WARNING ] (13, 1, 'bot')
2018-12-25 22:53:10 [WARNING ] (13, 1, 'bot')
2018-12-25 22:53:10 [WARNING ] (13, 1, 'bot')
2018-12-25 22:53:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:53:10 [DEBUG   ] Finished updating board flags in 1.599 seconds
2018-12-25 22:53:23 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-25 22:53:43 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 22:54:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 22:54:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:54:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 22:54:10 [WARNING ] (13, 1, 'bot')
2018-12-25 22:54:10 [WARNING ] (13, 1, 'bot')
2018-12-25 22:54:10 [WARNING ] (13, 1, 'bot')
2018-12-25 22:54:10 [WARNING ] (13, 1, 'bot')
2018-12-25 22:54:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:54:10 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-12-25 22:54:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 22:54:24 [DEBUG   ] Got command RPT from MCS: ref #952528
2018-12-25 22:54:24 [DEBUG   ] summary = ERROR
2018-12-25 22:54:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952528  13 58477 82464793 A  ERRORERROR'
2018-12-25 22:54:24 [DEBUG   ] Got command RPT from MCS: ref #952529
2018-12-25 22:54:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 22:54:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952529  77 58477 82464997 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 22:54:25 [DEBUG   ] Got command RPT from MCS: ref #952530
2018-12-25 22:54:25 [DEBUG   ] summary = ERROR
2018-12-25 22:54:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952530  13 58477 82465201 A  ERRORERROR'
2018-12-25 22:54:25 [DEBUG   ] Got command RPT from MCS: ref #952532
2018-12-25 22:54:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 22:54:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952532  77 58477 82465393 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 22:54:25 [DEBUG   ] Got command RPT from MCS: ref #952533
2018-12-25 22:54:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 22:54:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952533  12 58477 82465597 A  ERRORB™™š'
2018-12-25 22:54:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 22:55:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 22:55:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:55:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-12-25 22:55:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-25 22:55:10 [WARNING ] (13, 1, 'bot')
2018-12-25 22:55:10 [WARNING ] (13, 1, 'bot')
2018-12-25 22:55:10 [WARNING ] (13, 1, 'bot')
2018-12-25 22:55:10 [WARNING ] (13, 1, 'bot')
2018-12-25 22:55:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:55:10 [DEBUG   ] Finished updating board flags in 1.375 seconds
2018-12-25 22:55:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 22:55:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 22:55:58 [DEBUG   ] Got command RPT from MCS: ref #952542
2018-12-25 22:55:58 [DEBUG   ] summary = ERROR
2018-12-25 22:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952542  13 58477 82558497 A  ERRORERROR'
2018-12-25 22:55:58 [DEBUG   ] Got command RPT from MCS: ref #952543
2018-12-25 22:55:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 22:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952543  77 58477 82558498 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 22:56:03 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 22:56:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:56:10 [WARNING ] (13, 1, 'bot')
2018-12-25 22:56:10 [WARNING ] (13, 1, 'bot')
2018-12-25 22:56:10 [WARNING ] (13, 1, 'bot')
2018-12-25 22:56:10 [WARNING ] (13, 1, 'bot')
2018-12-25 22:56:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:56:10 [DEBUG   ] Finished updating board flags in 1.395 seconds
2018-12-25 22:56:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 22:56:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 22:57:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 22:57:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:57:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-12-25 22:57:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 22:57:11 [WARNING ] (13, 1, 'bot')
2018-12-25 22:57:11 [WARNING ] (13, 1, 'bot')
2018-12-25 22:57:11 [WARNING ] (13, 1, 'bot')
2018-12-25 22:57:11 [WARNING ] (13, 1, 'bot')
2018-12-25 22:57:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:57:11 [DEBUG   ] Finished updating board flags in 2.028 seconds
2018-12-25 22:57:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 22:57:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 22:58:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 22:58:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:58:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-25 22:58:11 [WARNING ] (13, 1, 'bot')
2018-12-25 22:58:11 [WARNING ] (13, 1, 'bot')
2018-12-25 22:58:11 [WARNING ] (13, 1, 'bot')
2018-12-25 22:58:11 [WARNING ] (13, 1, 'bot')
2018-12-25 22:58:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:58:11 [DEBUG   ] Finished updating board flags in 2.042 seconds
2018-12-25 22:58:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 22:58:43 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 22:59:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 22:59:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 22:59:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-25 22:59:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-12-25 22:59:11 [WARNING ] (13, 1, 'bot')
2018-12-25 22:59:11 [WARNING ] (13, 1, 'bot')
2018-12-25 22:59:11 [WARNING ] (13, 1, 'bot')
2018-12-25 22:59:11 [WARNING ] (13, 1, 'bot')
2018-12-25 22:59:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 22:59:11 [DEBUG   ] Finished updating board flags in 2.006 seconds
2018-12-25 22:59:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 22:59:24 [DEBUG   ] Got command RPT from MCS: ref #952563
2018-12-25 22:59:24 [DEBUG   ] summary = ERROR
2018-12-25 22:59:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952563  13 58477 82764881 A  ERRORERROR'
2018-12-25 22:59:25 [DEBUG   ] Got command RPT from MCS: ref #952564
2018-12-25 22:59:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 22:59:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952564  77 58477 82765073 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 22:59:25 [DEBUG   ] Got command RPT from MCS: ref #952565
2018-12-25 22:59:25 [DEBUG   ] summary = ERROR
2018-12-25 22:59:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952565  13 58477 82765277 A  ERRORERROR'
2018-12-25 22:59:25 [DEBUG   ] Got command RPT from MCS: ref #952566
2018-12-25 22:59:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 22:59:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952566  77 58477 82765481 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 22:59:25 [DEBUG   ] Got command RPT from MCS: ref #952567
2018-12-25 22:59:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 22:59:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952567  12 58477 82765685 A  ERRORBš™š'
2018-12-25 22:59:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 23:00:03 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 23:00:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:00:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 23:00:11 [WARNING ] (13, 1, 'bot')
2018-12-25 23:00:11 [WARNING ] (13, 1, 'bot')
2018-12-25 23:00:11 [WARNING ] (13, 1, 'bot')
2018-12-25 23:00:11 [WARNING ] (13, 1, 'bot')
2018-12-25 23:00:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:00:11 [DEBUG   ] Finished updating board flags in 1.956 seconds
2018-12-25 23:00:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 23:00:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 23:00:58 [DEBUG   ] Got command RPT from MCS: ref #952572
2018-12-25 23:00:58 [DEBUG   ] summary = ERROR
2018-12-25 23:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952572  13 58477 82858497 A  ERRORERROR'
2018-12-25 23:00:58 [DEBUG   ] Got command RPT from MCS: ref #952573
2018-12-25 23:00:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 23:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952573  77 58477 82858498 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 23:01:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 23:01:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:01:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-25 23:01:11 [WARNING ] (13, 1, 'bot')
2018-12-25 23:01:11 [WARNING ] (13, 1, 'bot')
2018-12-25 23:01:11 [WARNING ] (13, 1, 'bot')
2018-12-25 23:01:11 [WARNING ] (13, 1, 'bot')
2018-12-25 23:01:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:01:11 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-12-25 23:01:23 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 23:01:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 23:02:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 23:02:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:02:11 [WARNING ] (13, 1, 'bot')
2018-12-25 23:02:11 [WARNING ] (13, 1, 'bot')
2018-12-25 23:02:11 [WARNING ] (13, 1, 'bot')
2018-12-25 23:02:11 [WARNING ] (13, 1, 'bot')
2018-12-25 23:02:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:02:11 [DEBUG   ] Finished updating board flags in 1.779 seconds
2018-12-25 23:02:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 23:02:43 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 23:03:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 23:03:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 23:03:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:03:11 [WARNING ] (13, 1, 'bot')
2018-12-25 23:03:11 [WARNING ] (13, 1, 'bot')
2018-12-25 23:03:11 [WARNING ] (13, 1, 'bot')
2018-12-25 23:03:11 [WARNING ] (13, 1, 'bot')
2018-12-25 23:03:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:03:11 [DEBUG   ] Finished updating board flags in 1.664 seconds
2018-12-25 23:03:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 23:03:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 23:04:03 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 23:04:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:04:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-25 23:04:11 [WARNING ] (13, 1, 'bot')
2018-12-25 23:04:11 [WARNING ] (13, 1, 'bot')
2018-12-25 23:04:11 [WARNING ] (13, 1, 'bot')
2018-12-25 23:04:11 [WARNING ] (13, 1, 'bot')
2018-12-25 23:04:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:04:11 [DEBUG   ] Finished updating board flags in 1.596 seconds
2018-12-25 23:04:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 23:04:24 [DEBUG   ] Got command RPT from MCS: ref #952595
2018-12-25 23:04:24 [DEBUG   ] summary = ERROR
2018-12-25 23:04:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952595  13 58477 83064957 A  ERRORERROR'
2018-12-25 23:04:25 [DEBUG   ] Got command RPT from MCS: ref #952596
2018-12-25 23:04:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 23:04:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952596  77 58477 83065161 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 23:04:25 [DEBUG   ] Got command RPT from MCS: ref #952597
2018-12-25 23:04:25 [DEBUG   ] summary = ERROR
2018-12-25 23:04:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952597  13 58477 83065353 A  ERRORERROR'
2018-12-25 23:04:25 [DEBUG   ] Got command RPT from MCS: ref #952599
2018-12-25 23:04:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 23:04:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952599  77 58477 83065557 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 23:04:25 [DEBUG   ] Got command RPT from MCS: ref #952600
2018-12-25 23:04:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 23:04:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952600  12 58477 83065761 A  ERRORB™™š'
2018-12-25 23:04:43 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 23:05:03 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-25 23:05:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:05:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 23:05:11 [WARNING ] (13, 1, 'bot')
2018-12-25 23:05:11 [WARNING ] (13, 1, 'bot')
2018-12-25 23:05:11 [WARNING ] (13, 1, 'bot')
2018-12-25 23:05:11 [WARNING ] (13, 1, 'bot')
2018-12-25 23:05:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:05:11 [DEBUG   ] Finished updating board flags in 1.550 seconds
2018-12-25 23:05:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 23:05:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 23:05:58 [DEBUG   ] Got command RPT from MCS: ref #952605
2018-12-25 23:05:58 [DEBUG   ] summary = ERROR
2018-12-25 23:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952605  13 58477 83158505 A  ERRORERROR'
2018-12-25 23:05:58 [DEBUG   ] Got command RPT from MCS: ref #952606
2018-12-25 23:05:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 23:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952606  77 58477 83158506 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 23:06:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 23:06:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:06:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-25 23:06:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:06:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:06:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:06:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:06:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:06:12 [DEBUG   ] Finished updating board flags in 2.285 seconds
2018-12-25 23:06:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 23:06:43 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-25 23:07:03 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-25 23:07:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:07:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:07:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:07:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:07:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:07:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:07:12 [DEBUG   ] Finished updating board flags in 2.112 seconds
2018-12-25 23:07:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 23:07:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 23:08:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 23:08:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:08:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:08:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:08:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:08:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:08:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:08:12 [DEBUG   ] Finished updating board flags in 2.012 seconds
2018-12-25 23:08:23 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-25 23:08:43 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 23:09:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 23:09:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 23:09:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:09:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:09:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:09:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:09:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:09:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:09:12 [DEBUG   ] Finished updating board flags in 2.033 seconds
2018-12-25 23:09:23 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-25 23:09:25 [DEBUG   ] Got command RPT from MCS: ref #952626
2018-12-25 23:09:25 [DEBUG   ] summary = ERROR
2018-12-25 23:09:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952626  13 58477 83365041 A  ERRORERROR'
2018-12-25 23:09:25 [DEBUG   ] Got command RPT from MCS: ref #952627
2018-12-25 23:09:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 23:09:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952627  77 58477 83365233 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 23:09:25 [DEBUG   ] Got command RPT from MCS: ref #952628
2018-12-25 23:09:25 [DEBUG   ] summary = ERROR
2018-12-25 23:09:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952628  13 58477 83365437 A  ERRORERROR'
2018-12-25 23:09:25 [DEBUG   ] Got command RPT from MCS: ref #952629
2018-12-25 23:09:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 23:09:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952629  77 58477 83365641 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 23:09:25 [DEBUG   ] Got command RPT from MCS: ref #952630
2018-12-25 23:09:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 23:09:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952630  12 58477 83365845 A  ERRORB™™š'
2018-12-25 23:09:43 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 23:10:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 23:10:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 23:10:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:10:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 23:10:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:10:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:10:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:10:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:10:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:10:12 [DEBUG   ] Finished updating board flags in 1.965 seconds
2018-12-25 23:10:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 23:10:43 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-25 23:10:58 [DEBUG   ] Got command RPT from MCS: ref #952635
2018-12-25 23:10:58 [DEBUG   ] summary = ERROR
2018-12-25 23:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952635  13 58477 83458501 A  ERRORERROR'
2018-12-25 23:10:58 [DEBUG   ] Got command RPT from MCS: ref #952636
2018-12-25 23:10:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 23:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952636  77 58477 83458502 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 23:11:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 23:11:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:11:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:11:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:11:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:11:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:11:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:11:12 [DEBUG   ] Finished updating board flags in 1.849 seconds
2018-12-25 23:11:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 23:11:43 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 23:12:03 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-25 23:12:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 23:12:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:12:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:12:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:12:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:12:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:12:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:12:12 [DEBUG   ] Finished updating board flags in 1.757 seconds
2018-12-25 23:12:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 23:12:43 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 23:13:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 23:13:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:13:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:13:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:13:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:13:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:13:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:13:12 [DEBUG   ] Finished updating board flags in 1.628 seconds
2018-12-25 23:13:23 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-25 23:13:43 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-25 23:14:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 23:14:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:14:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:14:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:14:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:14:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:14:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:14:12 [DEBUG   ] Finished updating board flags in 1.635 seconds
2018-12-25 23:14:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 23:14:25 [DEBUG   ] Got command RPT from MCS: ref #952658
2018-12-25 23:14:25 [DEBUG   ] summary = ERROR
2018-12-25 23:14:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952658  13 58477 83665121 A  ERRORERROR'
2018-12-25 23:14:25 [DEBUG   ] Got command RPT from MCS: ref #952659
2018-12-25 23:14:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 23:14:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952659  77 58477 83665313 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 23:14:25 [DEBUG   ] Got command RPT from MCS: ref #952660
2018-12-25 23:14:25 [DEBUG   ] summary = ERROR
2018-12-25 23:14:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952660  13 58477 83665517 A  ERRORERROR'
2018-12-25 23:14:25 [DEBUG   ] Got command RPT from MCS: ref #952662
2018-12-25 23:14:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 23:14:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952662  77 58477 83665721 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 23:14:25 [DEBUG   ] Got command RPT from MCS: ref #952664
2018-12-25 23:14:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 23:14:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952664  12 58477 83665925 A  ERRORB˜™š'
2018-12-25 23:14:43 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-25 23:15:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 23:15:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 23:15:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:15:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-25 23:15:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:15:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:15:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:15:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:15:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:15:12 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-12-25 23:15:23 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-25 23:15:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 23:15:58 [DEBUG   ] Got command RPT from MCS: ref #952672
2018-12-25 23:15:58 [DEBUG   ] summary = ERROR
2018-12-25 23:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952672  13 58477 83758501 A  ERRORERROR'
2018-12-25 23:15:58 [DEBUG   ] Got command RPT from MCS: ref #952673
2018-12-25 23:15:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 23:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952673  77 58477 83758502 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 23:16:03 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-25 23:16:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:16:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:16:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:16:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:16:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:16:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:16:12 [DEBUG   ] Finished updating board flags in 1.521 seconds
2018-12-25 23:16:23 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-25 23:16:43 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-25 23:17:04 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-12-25 23:17:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:17:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:17:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:17:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:17:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:17:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:17:12 [DEBUG   ] Finished updating board flags in 1.417 seconds
2018-12-25 23:17:24 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-25 23:17:44 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 23:18:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 23:18:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 23:18:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:18:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:18:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:18:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:18:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:18:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:18:12 [DEBUG   ] Finished updating board flags in 1.384 seconds
2018-12-25 23:18:24 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-12-25 23:18:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 23:19:04 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 23:19:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:19:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 23:19:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:19:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:19:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:19:12 [WARNING ] (13, 1, 'bot')
2018-12-25 23:19:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:19:12 [DEBUG   ] Finished updating board flags in 1.356 seconds
2018-12-25 23:19:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 23:19:25 [DEBUG   ] Got command RPT from MCS: ref #952693
2018-12-25 23:19:25 [DEBUG   ] summary = ERROR
2018-12-25 23:19:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952693  13 58477 83965193 A  ERRORERROR'
2018-12-25 23:19:25 [DEBUG   ] Got command RPT from MCS: ref #952694
2018-12-25 23:19:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 23:19:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952694  77 58477 83965397 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 23:19:25 [DEBUG   ] Got command RPT from MCS: ref #952695
2018-12-25 23:19:25 [DEBUG   ] summary = ERROR
2018-12-25 23:19:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952695  13 58477 83965601 A  ERRORERROR'
2018-12-25 23:19:25 [DEBUG   ] Got command RPT from MCS: ref #952696
2018-12-25 23:19:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 23:19:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952696  77 58477 83965793 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 23:19:25 [DEBUG   ] Got command RPT from MCS: ref #952697
2018-12-25 23:19:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 23:19:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952697  12 58477 83965997 A  ERRORB˜™š'
2018-12-25 23:19:44 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 23:20:04 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 23:20:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 23:20:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:20:13 [WARNING ] (13, 1, 'bot')
2018-12-25 23:20:13 [WARNING ] (13, 1, 'bot')
2018-12-25 23:20:13 [WARNING ] (13, 1, 'bot')
2018-12-25 23:20:13 [WARNING ] (13, 1, 'bot')
2018-12-25 23:20:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:20:13 [DEBUG   ] Finished updating board flags in 2.101 seconds
2018-12-25 23:20:24 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 23:20:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 23:20:58 [DEBUG   ] Got command RPT from MCS: ref #952698
2018-12-25 23:20:58 [DEBUG   ] summary = ERROR
2018-12-25 23:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952698  13 58477 84058505 A  ERRORERROR'
2018-12-25 23:20:58 [DEBUG   ] Got command RPT from MCS: ref #952699
2018-12-25 23:20:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 23:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952699  77 58477 84058506 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 23:21:04 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 23:21:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:21:13 [WARNING ] (13, 1, 'bot')
2018-12-25 23:21:13 [WARNING ] (13, 1, 'bot')
2018-12-25 23:21:13 [WARNING ] (13, 1, 'bot')
2018-12-25 23:21:13 [WARNING ] (13, 1, 'bot')
2018-12-25 23:21:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:21:13 [DEBUG   ] Finished updating board flags in 1.948 seconds
2018-12-25 23:21:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 23:21:44 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 23:22:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 23:22:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:22:13 [WARNING ] (13, 1, 'bot')
2018-12-25 23:22:13 [WARNING ] (13, 1, 'bot')
2018-12-25 23:22:13 [WARNING ] (13, 1, 'bot')
2018-12-25 23:22:13 [WARNING ] (13, 1, 'bot')
2018-12-25 23:22:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:22:13 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-12-25 23:22:24 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 23:22:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 23:23:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 23:23:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:23:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 23:23:13 [WARNING ] (13, 1, 'bot')
2018-12-25 23:23:13 [WARNING ] (13, 1, 'bot')
2018-12-25 23:23:13 [WARNING ] (13, 1, 'bot')
2018-12-25 23:23:13 [WARNING ] (13, 1, 'bot')
2018-12-25 23:23:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:23:13 [DEBUG   ] Finished updating board flags in 1.838 seconds
2018-12-25 23:23:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 23:23:44 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 23:24:04 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 23:24:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:24:13 [WARNING ] (13, 1, 'bot')
2018-12-25 23:24:13 [WARNING ] (13, 1, 'bot')
2018-12-25 23:24:13 [WARNING ] (13, 1, 'bot')
2018-12-25 23:24:13 [WARNING ] (13, 1, 'bot')
2018-12-25 23:24:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:24:13 [DEBUG   ] Finished updating board flags in 1.835 seconds
2018-12-25 23:24:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 23:24:25 [DEBUG   ] Got command RPT from MCS: ref #952721
2018-12-25 23:24:25 [DEBUG   ] summary = ERROR
2018-12-25 23:24:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952721  13 58477 84265273 A  ERRORERROR'
2018-12-25 23:24:25 [DEBUG   ] Got command RPT from MCS: ref #952722
2018-12-25 23:24:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 23:24:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952722  77 58477 84265477 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 23:24:25 [DEBUG   ] Got command RPT from MCS: ref #952723
2018-12-25 23:24:25 [DEBUG   ] summary = ERROR
2018-12-25 23:24:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952723  13 58477 84265681 A  ERRORERROR'
2018-12-25 23:24:25 [DEBUG   ] Got command RPT from MCS: ref #952725
2018-12-25 23:24:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 23:24:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952725  77 58477 84265885 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 23:24:26 [DEBUG   ] Got command RPT from MCS: ref #952726
2018-12-25 23:24:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 23:24:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952726  12 58477 84266077 A  ERRORB˜™š'
2018-12-25 23:24:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 23:25:04 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 23:25:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:25:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 23:25:13 [WARNING ] (13, 1, 'bot')
2018-12-25 23:25:13 [WARNING ] (13, 1, 'bot')
2018-12-25 23:25:13 [WARNING ] (13, 1, 'bot')
2018-12-25 23:25:13 [WARNING ] (13, 1, 'bot')
2018-12-25 23:25:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:25:13 [DEBUG   ] Finished updating board flags in 1.767 seconds
2018-12-25 23:25:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 23:25:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 23:25:58 [DEBUG   ] Got command RPT from MCS: ref #952735
2018-12-25 23:25:58 [DEBUG   ] summary = ERROR
2018-12-25 23:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952735  13 58477 84358505 A  ERRORERROR'
2018-12-25 23:25:58 [DEBUG   ] Got command RPT from MCS: ref #952736
2018-12-25 23:25:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 23:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952736  77 58477 84358506 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 23:26:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 23:26:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:26:13 [WARNING ] (13, 1, 'bot')
2018-12-25 23:26:13 [WARNING ] (13, 1, 'bot')
2018-12-25 23:26:13 [WARNING ] (13, 1, 'bot')
2018-12-25 23:26:13 [WARNING ] (13, 1, 'bot')
2018-12-25 23:26:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:26:13 [DEBUG   ] Finished updating board flags in 1.620 seconds
2018-12-25 23:26:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 23:26:44 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 23:27:04 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 23:27:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:27:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 23:27:13 [WARNING ] (13, 1, 'bot')
2018-12-25 23:27:13 [WARNING ] (13, 1, 'bot')
2018-12-25 23:27:13 [WARNING ] (13, 1, 'bot')
2018-12-25 23:27:13 [WARNING ] (13, 1, 'bot')
2018-12-25 23:27:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:27:13 [DEBUG   ] Finished updating board flags in 1.542 seconds
2018-12-25 23:27:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 23:27:44 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 23:28:04 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 23:28:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-25 23:28:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:28:13 [WARNING ] (13, 1, 'bot')
2018-12-25 23:28:13 [WARNING ] (13, 1, 'bot')
2018-12-25 23:28:13 [WARNING ] (13, 1, 'bot')
2018-12-25 23:28:13 [WARNING ] (13, 1, 'bot')
2018-12-25 23:28:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:28:13 [DEBUG   ] Finished updating board flags in 1.496 seconds
2018-12-25 23:28:24 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 23:28:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 23:29:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 23:29:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:29:13 [WARNING ] (13, 1, 'bot')
2018-12-25 23:29:13 [WARNING ] (13, 1, 'bot')
2018-12-25 23:29:13 [WARNING ] (13, 1, 'bot')
2018-12-25 23:29:13 [WARNING ] (13, 1, 'bot')
2018-12-25 23:29:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:29:13 [DEBUG   ] Finished updating board flags in 1.505 seconds
2018-12-25 23:29:24 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 23:29:25 [DEBUG   ] Got command RPT from MCS: ref #952756
2018-12-25 23:29:25 [DEBUG   ] summary = ERROR
2018-12-25 23:29:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952756  13 58477 84565357 A  ERRORERROR'
2018-12-25 23:29:25 [DEBUG   ] Got command RPT from MCS: ref #952757
2018-12-25 23:29:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 23:29:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952757  77 58477 84565561 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 23:29:25 [DEBUG   ] Got command RPT from MCS: ref #952758
2018-12-25 23:29:25 [DEBUG   ] summary = ERROR
2018-12-25 23:29:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952758  13 58477 84565753 A  ERRORERROR'
2018-12-25 23:29:25 [DEBUG   ] Got command RPT from MCS: ref #952759
2018-12-25 23:29:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 23:29:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952759  77 58477 84565957 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 23:29:26 [DEBUG   ] Got command RPT from MCS: ref #952760
2018-12-25 23:29:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 23:29:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952760  12 58477 84566161 A  ERRORBš™š'
2018-12-25 23:29:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 23:30:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 23:30:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-25 23:30:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:30:14 [WARNING ] (13, 1, 'bot')
2018-12-25 23:30:14 [WARNING ] (13, 1, 'bot')
2018-12-25 23:30:14 [WARNING ] (13, 1, 'bot')
2018-12-25 23:30:14 [WARNING ] (13, 1, 'bot')
2018-12-25 23:30:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:30:14 [DEBUG   ] Finished updating board flags in 1.578 seconds
2018-12-25 23:30:24 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 23:30:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 23:30:58 [DEBUG   ] Got command RPT from MCS: ref #952765
2018-12-25 23:30:58 [DEBUG   ] summary = ERROR
2018-12-25 23:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952765  13 58477 84658505 A  ERRORERROR'
2018-12-25 23:30:58 [DEBUG   ] Got command RPT from MCS: ref #952766
2018-12-25 23:30:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 23:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952766  77 58477 84658506 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 23:31:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 23:31:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:31:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 23:31:14 [WARNING ] (13, 1, 'bot')
2018-12-25 23:31:14 [WARNING ] (13, 1, 'bot')
2018-12-25 23:31:14 [WARNING ] (13, 1, 'bot')
2018-12-25 23:31:14 [WARNING ] (13, 1, 'bot')
2018-12-25 23:31:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:31:14 [DEBUG   ] Finished updating board flags in 2.133 seconds
2018-12-25 23:31:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 23:31:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 23:32:04 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-25 23:32:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:32:14 [WARNING ] (13, 1, 'bot')
2018-12-25 23:32:14 [WARNING ] (13, 1, 'bot')
2018-12-25 23:32:14 [WARNING ] (13, 1, 'bot')
2018-12-25 23:32:14 [WARNING ] (13, 1, 'bot')
2018-12-25 23:32:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:32:14 [DEBUG   ] Finished updating board flags in 1.912 seconds
2018-12-25 23:32:24 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 23:32:44 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-25 23:33:04 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-25 23:33:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:33:14 [WARNING ] (13, 1, 'bot')
2018-12-25 23:33:14 [WARNING ] (13, 1, 'bot')
2018-12-25 23:33:14 [WARNING ] (13, 1, 'bot')
2018-12-25 23:33:14 [WARNING ] (13, 1, 'bot')
2018-12-25 23:33:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:33:14 [DEBUG   ] Finished updating board flags in 1.823 seconds
2018-12-25 23:33:24 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-25 23:33:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 23:34:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 23:34:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:34:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 23:34:14 [WARNING ] (13, 1, 'bot')
2018-12-25 23:34:14 [WARNING ] (13, 1, 'bot')
2018-12-25 23:34:14 [WARNING ] (13, 1, 'bot')
2018-12-25 23:34:14 [WARNING ] (13, 1, 'bot')
2018-12-25 23:34:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:34:14 [DEBUG   ] Finished updating board flags in 1.758 seconds
2018-12-25 23:34:24 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-25 23:34:25 [DEBUG   ] Got command RPT from MCS: ref #952788
2018-12-25 23:34:25 [DEBUG   ] summary = ERROR
2018-12-25 23:34:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952788  13 58477 84865433 A  ERRORERROR'
2018-12-25 23:34:25 [DEBUG   ] Got command RPT from MCS: ref #952789
2018-12-25 23:34:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 23:34:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952789  77 58477 84865637 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 23:34:25 [DEBUG   ] Got command RPT from MCS: ref #952790
2018-12-25 23:34:25 [DEBUG   ] summary = ERROR
2018-12-25 23:34:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952790  13 58477 84865841 A  ERRORERROR'
2018-12-25 23:34:26 [DEBUG   ] Got command RPT from MCS: ref #952792
2018-12-25 23:34:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 23:34:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952792  77 58477 84866033 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 23:34:26 [DEBUG   ] Got command RPT from MCS: ref #952793
2018-12-25 23:34:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 23:34:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952793  12 58477 84866237 A  ERRORB™™š'
2018-12-25 23:34:44 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-25 23:35:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 23:35:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:35:14 [WARNING ] (13, 1, 'bot')
2018-12-25 23:35:14 [WARNING ] (13, 1, 'bot')
2018-12-25 23:35:14 [WARNING ] (13, 1, 'bot')
2018-12-25 23:35:14 [WARNING ] (13, 1, 'bot')
2018-12-25 23:35:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:35:14 [DEBUG   ] Finished updating board flags in 1.625 seconds
2018-12-25 23:35:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 23:35:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 23:35:58 [DEBUG   ] Got command RPT from MCS: ref #952798
2018-12-25 23:35:58 [DEBUG   ] summary = ERROR
2018-12-25 23:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952798  13 58477 84958501 A  ERRORERROR'
2018-12-25 23:35:58 [DEBUG   ] Got command RPT from MCS: ref #952799
2018-12-25 23:35:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 23:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952799  77 58477 84958502 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 23:36:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 23:36:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:36:14 [WARNING ] (13, 1, 'bot')
2018-12-25 23:36:14 [WARNING ] (13, 1, 'bot')
2018-12-25 23:36:14 [WARNING ] (13, 1, 'bot')
2018-12-25 23:36:14 [WARNING ] (13, 1, 'bot')
2018-12-25 23:36:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:36:14 [DEBUG   ] Finished updating board flags in 1.578 seconds
2018-12-25 23:36:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 23:36:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 23:37:04 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-25 23:37:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:37:14 [WARNING ] (13, 1, 'bot')
2018-12-25 23:37:14 [WARNING ] (13, 1, 'bot')
2018-12-25 23:37:14 [WARNING ] (13, 1, 'bot')
2018-12-25 23:37:14 [WARNING ] (13, 1, 'bot')
2018-12-25 23:37:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:37:14 [DEBUG   ] Finished updating board flags in 1.558 seconds
2018-12-25 23:37:24 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-25 23:37:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 23:38:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 23:38:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:38:14 [WARNING ] (13, 1, 'bot')
2018-12-25 23:38:14 [WARNING ] (13, 1, 'bot')
2018-12-25 23:38:14 [WARNING ] (13, 1, 'bot')
2018-12-25 23:38:14 [WARNING ] (13, 1, 'bot')
2018-12-25 23:38:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:38:14 [DEBUG   ] Finished updating board flags in 1.572 seconds
2018-12-25 23:38:24 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-25 23:38:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 23:39:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 23:39:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:39:15 [WARNING ] (13, 1, 'bot')
2018-12-25 23:39:15 [WARNING ] (13, 1, 'bot')
2018-12-25 23:39:15 [WARNING ] (13, 1, 'bot')
2018-12-25 23:39:15 [WARNING ] (13, 1, 'bot')
2018-12-25 23:39:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:39:15 [DEBUG   ] Finished updating board flags in 2.214 seconds
2018-12-25 23:39:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 23:39:25 [DEBUG   ] Got command RPT from MCS: ref #952819
2018-12-25 23:39:25 [DEBUG   ] summary = ERROR
2018-12-25 23:39:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952819  13 58477 85165521 A  ERRORERROR'
2018-12-25 23:39:25 [DEBUG   ] Got command RPT from MCS: ref #952820
2018-12-25 23:39:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 23:39:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952820  77 58477 85165713 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 23:39:25 [DEBUG   ] Got command RPT from MCS: ref #952821
2018-12-25 23:39:25 [DEBUG   ] summary = ERROR
2018-12-25 23:39:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952821  13 58477 85165917 A  ERRORERROR'
2018-12-25 23:39:26 [DEBUG   ] Got command RPT from MCS: ref #952822
2018-12-25 23:39:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 23:39:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952822  77 58477 85166121 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 23:39:26 [DEBUG   ] Got command RPT from MCS: ref #952823
2018-12-25 23:39:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 23:39:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952823  12 58477 85166325 A  ERRORB™™š'
2018-12-25 23:39:44 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-25 23:40:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 23:40:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:40:15 [WARNING ] (13, 1, 'bot')
2018-12-25 23:40:15 [WARNING ] (13, 1, 'bot')
2018-12-25 23:40:15 [WARNING ] (13, 1, 'bot')
2018-12-25 23:40:15 [WARNING ] (13, 1, 'bot')
2018-12-25 23:40:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:40:15 [DEBUG   ] Finished updating board flags in 2.084 seconds
2018-12-25 23:40:24 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 23:40:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 23:40:58 [DEBUG   ] Got command RPT from MCS: ref #952828
2018-12-25 23:40:58 [DEBUG   ] summary = ERROR
2018-12-25 23:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952828  13 58477 85258513 A  ERRORERROR'
2018-12-25 23:40:58 [DEBUG   ] Got command RPT from MCS: ref #952829
2018-12-25 23:40:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 23:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952829  77 58477 85258514 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 23:41:04 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-25 23:41:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:41:15 [WARNING ] (13, 1, 'bot')
2018-12-25 23:41:15 [WARNING ] (13, 1, 'bot')
2018-12-25 23:41:15 [WARNING ] (13, 1, 'bot')
2018-12-25 23:41:15 [WARNING ] (13, 1, 'bot')
2018-12-25 23:41:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:41:15 [DEBUG   ] Finished updating board flags in 2.027 seconds
2018-12-25 23:41:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 23:41:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 23:42:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 23:42:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:42:15 [WARNING ] (13, 1, 'bot')
2018-12-25 23:42:15 [WARNING ] (13, 1, 'bot')
2018-12-25 23:42:15 [WARNING ] (13, 1, 'bot')
2018-12-25 23:42:15 [WARNING ] (13, 1, 'bot')
2018-12-25 23:42:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:42:15 [DEBUG   ] Finished updating board flags in 1.795 seconds
2018-12-25 23:42:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 23:42:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 23:43:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 23:43:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 23:43:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:43:15 [WARNING ] (13, 1, 'bot')
2018-12-25 23:43:15 [WARNING ] (13, 1, 'bot')
2018-12-25 23:43:15 [WARNING ] (13, 1, 'bot')
2018-12-25 23:43:15 [WARNING ] (13, 1, 'bot')
2018-12-25 23:43:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:43:15 [DEBUG   ] Finished updating board flags in 1.621 seconds
2018-12-25 23:43:24 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-25 23:43:44 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-25 23:44:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 23:44:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:44:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 23:44:15 [WARNING ] (13, 1, 'bot')
2018-12-25 23:44:15 [WARNING ] (13, 1, 'bot')
2018-12-25 23:44:15 [WARNING ] (13, 1, 'bot')
2018-12-25 23:44:15 [WARNING ] (13, 1, 'bot')
2018-12-25 23:44:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:44:15 [DEBUG   ] Finished updating board flags in 1.570 seconds
2018-12-25 23:44:24 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 23:44:25 [DEBUG   ] Got command RPT from MCS: ref #952851
2018-12-25 23:44:25 [DEBUG   ] summary = ERROR
2018-12-25 23:44:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952851  13 58477 85465593 A  ERRORERROR'
2018-12-25 23:44:25 [DEBUG   ] Got command RPT from MCS: ref #952852
2018-12-25 23:44:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 23:44:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952852  77 58477 85465797 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 23:44:26 [DEBUG   ] Got command RPT from MCS: ref #952853
2018-12-25 23:44:26 [DEBUG   ] summary = ERROR
2018-12-25 23:44:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952853  13 58477 85466001 A  ERRORERROR'
2018-12-25 23:44:26 [DEBUG   ] Got command RPT from MCS: ref #952854
2018-12-25 23:44:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 23:44:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952854  77 58477 85466193 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 23:44:26 [DEBUG   ] Got command RPT from MCS: ref #952856
2018-12-25 23:44:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 23:44:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952856  12 58477 85466397 A  ERRORB™™š'
2018-12-25 23:44:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 23:45:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 23:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:45:15 [WARNING ] (13, 1, 'bot')
2018-12-25 23:45:15 [WARNING ] (13, 1, 'bot')
2018-12-25 23:45:15 [WARNING ] (13, 1, 'bot')
2018-12-25 23:45:15 [WARNING ] (13, 1, 'bot')
2018-12-25 23:45:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:45:15 [DEBUG   ] Finished updating board flags in 1.591 seconds
2018-12-25 23:45:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 23:45:44 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-25 23:45:58 [DEBUG   ] Got command RPT from MCS: ref #952865
2018-12-25 23:45:58 [DEBUG   ] summary = ERROR
2018-12-25 23:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952865  13 58477 85558509 A  ERRORERROR'
2018-12-25 23:45:58 [DEBUG   ] Got command RPT from MCS: ref #952866
2018-12-25 23:45:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 23:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952866  77 58477 85558510 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 23:46:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 23:46:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:46:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 23:46:16 [WARNING ] (13, 1, 'bot')
2018-12-25 23:46:16 [WARNING ] (13, 1, 'bot')
2018-12-25 23:46:16 [WARNING ] (13, 1, 'bot')
2018-12-25 23:46:16 [WARNING ] (13, 1, 'bot')
2018-12-25 23:46:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:46:16 [DEBUG   ] Finished updating board flags in 1.598 seconds
2018-12-25 23:46:24 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-25 23:46:44 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-25 23:47:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 23:47:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-12-25 23:47:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:47:16 [WARNING ] (13, 1, 'bot')
2018-12-25 23:47:16 [WARNING ] (13, 1, 'bot')
2018-12-25 23:47:16 [WARNING ] (13, 1, 'bot')
2018-12-25 23:47:16 [WARNING ] (13, 1, 'bot')
2018-12-25 23:47:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:47:16 [DEBUG   ] Finished updating board flags in 2.144 seconds
2018-12-25 23:47:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 23:47:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 23:48:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 23:48:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 23:48:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:48:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 23:48:16 [WARNING ] (13, 1, 'bot')
2018-12-25 23:48:16 [WARNING ] (13, 1, 'bot')
2018-12-25 23:48:16 [WARNING ] (13, 1, 'bot')
2018-12-25 23:48:16 [WARNING ] (13, 1, 'bot')
2018-12-25 23:48:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:48:16 [DEBUG   ] Finished updating board flags in 2.015 seconds
2018-12-25 23:48:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 23:48:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 23:49:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-25 23:49:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 23:49:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:49:16 [WARNING ] (13, 1, 'bot')
2018-12-25 23:49:16 [WARNING ] (13, 1, 'bot')
2018-12-25 23:49:16 [WARNING ] (13, 1, 'bot')
2018-12-25 23:49:16 [WARNING ] (13, 1, 'bot')
2018-12-25 23:49:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:49:16 [DEBUG   ] Finished updating board flags in 1.873 seconds
2018-12-25 23:49:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 23:49:25 [DEBUG   ] Got command RPT from MCS: ref #952886
2018-12-25 23:49:25 [DEBUG   ] summary = ERROR
2018-12-25 23:49:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952886  13 58477 85765673 A  ERRORERROR'
2018-12-25 23:49:25 [DEBUG   ] Got command RPT from MCS: ref #952887
2018-12-25 23:49:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 23:49:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952887  77 58477 85765877 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 23:49:26 [DEBUG   ] Got command RPT from MCS: ref #952888
2018-12-25 23:49:26 [DEBUG   ] summary = ERROR
2018-12-25 23:49:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952888  13 58477 85766069 A  ERRORERROR'
2018-12-25 23:49:26 [DEBUG   ] Got command RPT from MCS: ref #952889
2018-12-25 23:49:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 23:49:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952889  77 58477 85766273 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 23:49:26 [DEBUG   ] Got command RPT from MCS: ref #952890
2018-12-25 23:49:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 23:49:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952890  12 58477 85766477 A  ERRORB˜™š'
2018-12-25 23:49:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-25 23:50:04 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-25 23:50:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 23:50:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:50:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 23:50:16 [WARNING ] (13, 1, 'bot')
2018-12-25 23:50:16 [WARNING ] (13, 1, 'bot')
2018-12-25 23:50:16 [WARNING ] (13, 1, 'bot')
2018-12-25 23:50:16 [WARNING ] (13, 1, 'bot')
2018-12-25 23:50:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:50:16 [DEBUG   ] Finished updating board flags in 1.829 seconds
2018-12-25 23:50:25 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-25 23:50:45 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-25 23:50:58 [DEBUG   ] Got command RPT from MCS: ref #952891
2018-12-25 23:50:58 [DEBUG   ] summary = ERROR
2018-12-25 23:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952891  13 58477 85858509 A  ERRORERROR'
2018-12-25 23:50:58 [DEBUG   ] Got command RPT from MCS: ref #952892
2018-12-25 23:50:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 23:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952892  77 58477 85858510 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 23:51:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-25 23:51:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:51:16 [WARNING ] (13, 1, 'bot')
2018-12-25 23:51:16 [WARNING ] (13, 1, 'bot')
2018-12-25 23:51:16 [WARNING ] (13, 1, 'bot')
2018-12-25 23:51:16 [WARNING ] (13, 1, 'bot')
2018-12-25 23:51:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:51:16 [DEBUG   ] Finished updating board flags in 1.782 seconds
2018-12-25 23:51:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 23:51:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 23:52:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 23:52:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-25 23:52:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:52:16 [WARNING ] (13, 1, 'bot')
2018-12-25 23:52:16 [WARNING ] (13, 1, 'bot')
2018-12-25 23:52:16 [WARNING ] (13, 1, 'bot')
2018-12-25 23:52:16 [WARNING ] (13, 1, 'bot')
2018-12-25 23:52:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:52:16 [DEBUG   ] Finished updating board flags in 1.606 seconds
2018-12-25 23:52:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 23:52:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 23:53:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 23:53:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:53:16 [WARNING ] (13, 1, 'bot')
2018-12-25 23:53:16 [WARNING ] (13, 1, 'bot')
2018-12-25 23:53:16 [WARNING ] (13, 1, 'bot')
2018-12-25 23:53:16 [WARNING ] (13, 1, 'bot')
2018-12-25 23:53:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:53:16 [DEBUG   ] Finished updating board flags in 1.629 seconds
2018-12-25 23:53:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 23:53:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-25 23:54:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-25 23:54:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:54:16 [WARNING ] (13, 1, 'bot')
2018-12-25 23:54:16 [WARNING ] (13, 1, 'bot')
2018-12-25 23:54:16 [WARNING ] (13, 1, 'bot')
2018-12-25 23:54:16 [WARNING ] (13, 1, 'bot')
2018-12-25 23:54:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:54:16 [DEBUG   ] Finished updating board flags in 1.560 seconds
2018-12-25 23:54:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-25 23:54:25 [DEBUG   ] Got command RPT from MCS: ref #952914
2018-12-25 23:54:25 [DEBUG   ] summary = ERROR
2018-12-25 23:54:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952914  13 58477 86065753 A  ERRORERROR'
2018-12-25 23:54:25 [DEBUG   ] Got command RPT from MCS: ref #952915
2018-12-25 23:54:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 23:54:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952915  77 58477 86065957 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 23:54:26 [DEBUG   ] Got command RPT from MCS: ref #952916
2018-12-25 23:54:26 [DEBUG   ] summary = ERROR
2018-12-25 23:54:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952916  13 58477 86066161 A  ERRORERROR'
2018-12-25 23:54:26 [DEBUG   ] Got command RPT from MCS: ref #952918
2018-12-25 23:54:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 23:54:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952918  77 58477 86066353 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 23:54:26 [DEBUG   ] Got command RPT from MCS: ref #952919
2018-12-25 23:54:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 23:54:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952919  12 58477 86066557 A  ERRORB˜™š'
2018-12-25 23:54:45 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-25 23:55:05 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-25 23:55:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:55:16 [WARNING ] (13, 1, 'bot')
2018-12-25 23:55:16 [WARNING ] (13, 1, 'bot')
2018-12-25 23:55:16 [WARNING ] (13, 1, 'bot')
2018-12-25 23:55:16 [WARNING ] (13, 1, 'bot')
2018-12-25 23:55:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:55:16 [DEBUG   ] Finished updating board flags in 1.536 seconds
2018-12-25 23:55:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 23:55:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-25 23:55:58 [DEBUG   ] Got command RPT from MCS: ref #952928
2018-12-25 23:55:58 [DEBUG   ] summary = ERROR
2018-12-25 23:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952928  13 58477 86158509 A  ERRORERROR'
2018-12-25 23:55:58 [DEBUG   ] Got command RPT from MCS: ref #952929
2018-12-25 23:55:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 23:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952929  77 58477 86158510 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 23:56:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-25 23:56:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:56:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 23:56:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-25 23:56:16 [WARNING ] (13, 1, 'bot')
2018-12-25 23:56:16 [WARNING ] (13, 1, 'bot')
2018-12-25 23:56:16 [WARNING ] (13, 1, 'bot')
2018-12-25 23:56:16 [WARNING ] (13, 1, 'bot')
2018-12-25 23:56:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:56:16 [DEBUG   ] Finished updating board flags in 1.540 seconds
2018-12-25 23:56:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 23:56:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-25 23:57:05 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-25 23:57:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-25 23:57:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:57:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 23:57:17 [WARNING ] (13, 1, 'bot')
2018-12-25 23:57:17 [WARNING ] (13, 1, 'bot')
2018-12-25 23:57:17 [WARNING ] (13, 1, 'bot')
2018-12-25 23:57:17 [WARNING ] (13, 1, 'bot')
2018-12-25 23:57:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:57:17 [DEBUG   ] Finished updating board flags in 2.218 seconds
2018-12-25 23:57:25 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 23:57:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 23:58:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 23:58:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:58:17 [WARNING ] (13, 1, 'bot')
2018-12-25 23:58:17 [WARNING ] (13, 1, 'bot')
2018-12-25 23:58:17 [WARNING ] (13, 1, 'bot')
2018-12-25 23:58:17 [WARNING ] (13, 1, 'bot')
2018-12-25 23:58:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:58:17 [DEBUG   ] Finished updating board flags in 2.109 seconds
2018-12-25 23:58:25 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-25 23:58:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-25 23:59:05 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-25 23:59:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-25 23:59:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-25 23:59:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-25 23:59:17 [WARNING ] (13, 1, 'bot')
2018-12-25 23:59:17 [WARNING ] (13, 1, 'bot')
2018-12-25 23:59:17 [WARNING ] (13, 1, 'bot')
2018-12-25 23:59:17 [WARNING ] (13, 1, 'bot')
2018-12-25 23:59:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-25 23:59:17 [DEBUG   ] Finished updating board flags in 2.058 seconds
2018-12-25 23:59:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-25 23:59:25 [DEBUG   ] Got command RPT from MCS: ref #952949
2018-12-25 23:59:25 [DEBUG   ] summary = ERROR
2018-12-25 23:59:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952949  13 58477 86365837 A  ERRORERROR'
2018-12-25 23:59:26 [DEBUG   ] Got command RPT from MCS: ref #952950
2018-12-25 23:59:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 23:59:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952950  77 58477 86366041 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 23:59:26 [DEBUG   ] Got command RPT from MCS: ref #952951
2018-12-25 23:59:26 [DEBUG   ] summary = ERROR
2018-12-25 23:59:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952951  13 58477 86366233 A  ERRORERROR'
2018-12-25 23:59:26 [DEBUG   ] Got command RPT from MCS: ref #952952
2018-12-25 23:59:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-25 23:59:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952952  77 58477 86366437 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-25 23:59:26 [DEBUG   ] Got command RPT from MCS: ref #952953
2018-12-25 23:59:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-25 23:59:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952953  12 58477 86366641 A  ERRORBš™š'
2018-12-25 23:59:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 00:00:05 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 00:00:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:00:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-26 00:00:17 [WARNING ] (13, 1, 'bot')
2018-12-26 00:00:17 [WARNING ] (13, 1, 'bot')
2018-12-26 00:00:17 [WARNING ] (13, 1, 'bot')
2018-12-26 00:00:17 [WARNING ] (13, 1, 'bot')
2018-12-26 00:00:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:00:17 [DEBUG   ] Finished updating board flags in 1.958 seconds
2018-12-26 00:00:25 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2018-12-26 00:00:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 00:00:58 [DEBUG   ] Got command RPT from MCS: ref #952958
2018-12-26 00:00:58 [DEBUG   ] summary = ERROR
2018-12-26 00:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952958  13 58478    58513 A  ERRORERROR'
2018-12-26 00:00:58 [DEBUG   ] Got command RPT from MCS: ref #952959
2018-12-26 00:00:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 00:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952959  77 58478    58514 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 00:01:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 00:01:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 00:01:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-26 00:01:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:01:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-26 00:01:17 [WARNING ] (13, 1, 'bot')
2018-12-26 00:01:17 [WARNING ] (13, 1, 'bot')
2018-12-26 00:01:17 [WARNING ] (13, 1, 'bot')
2018-12-26 00:01:17 [WARNING ] (13, 1, 'bot')
2018-12-26 00:01:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:01:17 [DEBUG   ] Finished updating board flags in 1.816 seconds
2018-12-26 00:01:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 00:01:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 00:02:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 00:02:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:02:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-12-26 00:02:17 [WARNING ] (13, 1, 'bot')
2018-12-26 00:02:17 [WARNING ] (13, 1, 'bot')
2018-12-26 00:02:17 [WARNING ] (13, 1, 'bot')
2018-12-26 00:02:17 [WARNING ] (13, 1, 'bot')
2018-12-26 00:02:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:02:17 [DEBUG   ] Finished updating board flags in 1.792 seconds
2018-12-26 00:02:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 00:02:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 00:03:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 00:03:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:03:17 [WARNING ] (13, 1, 'bot')
2018-12-26 00:03:17 [WARNING ] (13, 1, 'bot')
2018-12-26 00:03:17 [WARNING ] (13, 1, 'bot')
2018-12-26 00:03:17 [WARNING ] (13, 1, 'bot')
2018-12-26 00:03:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:03:17 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-12-26 00:03:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 00:03:45 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 00:04:00 [DEBUG   ] Got command TBN from MCS: ref #952981
2018-12-26 00:04:00 [DEBUG   ] spawn_process: at 2018-12-26 00:04:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1545782642']
2018-12-26 00:04:00 [DEBUG   ] spawn_process: at 2018-12-26 00:04:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1545782642']
2018-12-26 00:04:00 [DEBUG   ] tbn = exited with status True, code 0x00
2018-12-26 00:04:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN   952981   8 58478   240905 A  ERROR'
2018-12-26 00:04:00 [DEBUG   ] spawn_process: at 2018-12-26 00:04:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1545782642']
2018-12-26 00:04:00 [DEBUG   ] spawn_process: at 2018-12-26 00:04:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1545782642']
2018-12-26 00:04:00 [DEBUG   ] spawn_process: at 2018-12-26 00:04:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1545782642']
2018-12-26 00:04:00 [DEBUG   ] spawn_process: at 2018-12-26 00:04:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1545782642']
2018-12-26 00:04:00 [DEBUG   ] spawn_process: at 2018-12-26 00:04:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1545782642']
2018-12-26 00:04:00 [DEBUG   ] spawn_process: at 2018-12-26 00:04:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1545782642']
2018-12-26 00:04:00 [DEBUG   ] spawn_process: at 2018-12-26 00:04:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1545782642']
2018-12-26 00:04:00 [DEBUG   ] spawn_process: at 2018-12-26 00:04:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1545782642']
2018-12-26 00:04:00 [DEBUG   ] spawn_process: at 2018-12-26 00:04:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1545782642']
2018-12-26 00:04:00 [DEBUG   ] spawn_process: at 2018-12-26 00:04:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1545782642']
2018-12-26 00:04:00 [DEBUG   ] spawn_process: at 2018-12-26 00:04:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1545782642']
2018-12-26 00:04:00 [DEBUG   ] spawn_process: at 2018-12-26 00:04:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1545782642']
2018-12-26 00:04:00 [DEBUG   ] spawn_process: at 2018-12-26 00:04:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1545782642']
2018-12-26 00:04:00 [DEBUG   ] spawn_process: at 2018-12-26 00:04:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1545782642']
2018-12-26 00:04:00 [DEBUG   ] spawn_process: at 2018-12-26 00:04:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1545782642']
2018-12-26 00:04:00 [DEBUG   ] spawn_process: at 2018-12-26 00:04:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1545782642']
2018-12-26 00:04:00 [DEBUG   ] spawn_process: at 2018-12-26 00:04:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1545782642']
2018-12-26 00:04:00 [DEBUG   ] spawn_process: at 2018-12-26 00:04:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1545782642']
2018-12-26 00:04:00 [DEBUG   ] spawn_process: at 2018-12-26 00:04:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1545782642']
2018-12-26 00:04:00 [DEBUG   ] spawn_process: at 2018-12-26 00:04:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1545782642']
2018-12-26 00:04:00 [DEBUG   ] spawn_process: at 2018-12-26 00:04:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1545782642']
2018-12-26 00:04:00 [DEBUG   ] spawn_process: at 2018-12-26 00:04:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1545782642']
2018-12-26 00:04:00 [DEBUG   ] spawn_process: at 2018-12-26 00:04:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1545782642']
2018-12-26 00:04:00 [DEBUG   ] spawn_process: at 2018-12-26 00:04:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1545782642']
2018-12-26 00:04:00 [INFO    ] Finished spawning TBN in 0.053 s
2018-12-26 00:04:05 [DEBUG   ] Finished updating ant stats in 0.536 seconds
2018-12-26 00:04:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:04:17 [WARNING ] (13, 1, 'bot')
2018-12-26 00:04:17 [WARNING ] (13, 1, 'bot')
2018-12-26 00:04:17 [WARNING ] (13, 1, 'bot')
2018-12-26 00:04:17 [WARNING ] (13, 1, 'bot')
2018-12-26 00:04:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:04:17 [DEBUG   ] Finished updating board flags in 1.651 seconds
2018-12-26 00:04:25 [DEBUG   ] Finished updating ant stats in 0.467 seconds
2018-12-26 00:04:25 [DEBUG   ] Got command RPT from MCS: ref #952982
2018-12-26 00:04:25 [DEBUG   ] summary = ERROR
2018-12-26 00:04:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952982  13 58478   265913 A  ERRORERROR'
2018-12-26 00:04:26 [DEBUG   ] Got command RPT from MCS: ref #952983
2018-12-26 00:04:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 00:04:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952983  77 58478   266117 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 00:04:26 [DEBUG   ] Got command RPT from MCS: ref #952984
2018-12-26 00:04:26 [DEBUG   ] summary = ERROR
2018-12-26 00:04:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952984  13 58478   266309 A  ERRORERROR'
2018-12-26 00:04:26 [DEBUG   ] Got command RPT from MCS: ref #952986
2018-12-26 00:04:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 00:04:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952986  77 58478   266513 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 00:04:26 [DEBUG   ] Got command RPT from MCS: ref #952988
2018-12-26 00:04:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 00:04:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952988  12 58478   266717 A  ERRORBš™š'
2018-12-26 00:04:45 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-26 00:05:05 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-12-26 00:05:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:05:17 [WARNING ] (13, 1, 'bot')
2018-12-26 00:05:17 [WARNING ] (13, 1, 'bot')
2018-12-26 00:05:17 [WARNING ] (13, 1, 'bot')
2018-12-26 00:05:17 [WARNING ] (13, 1, 'bot')
2018-12-26 00:05:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:05:17 [DEBUG   ] Finished updating board flags in 1.620 seconds
2018-12-26 00:05:26 [DEBUG   ] Finished updating ant stats in 1.256 seconds
2018-12-26 00:05:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 00:05:58 [DEBUG   ] Got command RPT from MCS: ref #952992
2018-12-26 00:05:58 [DEBUG   ] summary = ERROR
2018-12-26 00:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952992  13 58478   358517 A  ERRORERROR'
2018-12-26 00:05:58 [DEBUG   ] Got command RPT from MCS: ref #952993
2018-12-26 00:05:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 00:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   952993  77 58478   358518 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 00:06:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 00:06:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:06:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-12-26 00:06:17 [WARNING ] (13, 1, 'bot')
2018-12-26 00:06:17 [WARNING ] (13, 1, 'bot')
2018-12-26 00:06:17 [WARNING ] (13, 1, 'bot')
2018-12-26 00:06:17 [WARNING ] (13, 1, 'bot')
2018-12-26 00:06:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:06:17 [DEBUG   ] Finished updating board flags in 1.521 seconds
2018-12-26 00:06:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 00:06:46 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 00:07:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 00:07:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 00:07:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:07:17 [WARNING ] (13, 1, 'bot')
2018-12-26 00:07:17 [WARNING ] (13, 1, 'bot')
2018-12-26 00:07:17 [WARNING ] (13, 1, 'bot')
2018-12-26 00:07:17 [WARNING ] (13, 1, 'bot')
2018-12-26 00:07:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:07:17 [DEBUG   ] Finished updating board flags in 1.486 seconds
2018-12-26 00:07:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 00:07:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 00:08:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 00:08:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:08:17 [WARNING ] (13, 1, 'bot')
2018-12-26 00:08:17 [WARNING ] (13, 1, 'bot')
2018-12-26 00:08:17 [WARNING ] (13, 1, 'bot')
2018-12-26 00:08:17 [WARNING ] (13, 1, 'bot')
2018-12-26 00:08:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:08:17 [DEBUG   ] Finished updating board flags in 1.536 seconds
2018-12-26 00:08:26 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-26 00:08:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 00:09:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 00:09:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:09:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:09:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:09:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:09:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:09:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:09:18 [DEBUG   ] Finished updating board flags in 2.247 seconds
2018-12-26 00:09:25 [DEBUG   ] Got command RPT from MCS: ref #953013
2018-12-26 00:09:25 [DEBUG   ] summary = ERROR
2018-12-26 00:09:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953013  13 58478   565989 A  ERRORERROR'
2018-12-26 00:09:26 [DEBUG   ] Got command RPT from MCS: ref #953014
2018-12-26 00:09:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 00:09:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953014  77 58478   566193 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 00:09:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 00:09:26 [DEBUG   ] Got command RPT from MCS: ref #953015
2018-12-26 00:09:26 [DEBUG   ] summary = ERROR
2018-12-26 00:09:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953015  13 58478   566397 A  ERRORERROR'
2018-12-26 00:09:26 [DEBUG   ] Got command RPT from MCS: ref #953016
2018-12-26 00:09:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 00:09:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953016  77 58478   566601 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 00:09:26 [DEBUG   ] Got command RPT from MCS: ref #953017
2018-12-26 00:09:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 00:09:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953017  12 58478   566793 A  ERRORB™™š'
2018-12-26 00:09:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 00:10:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 00:10:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:10:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-26 00:10:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:10:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:10:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:10:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:10:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:10:18 [DEBUG   ] Finished updating board flags in 2.143 seconds
2018-12-26 00:10:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 00:10:46 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 00:10:58 [DEBUG   ] Got command RPT from MCS: ref #953022
2018-12-26 00:10:58 [DEBUG   ] summary = ERROR
2018-12-26 00:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953022  13 58478   658509 A  ERRORERROR'
2018-12-26 00:10:58 [DEBUG   ] Got command RPT from MCS: ref #953023
2018-12-26 00:10:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 00:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953023  77 58478   658510 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 00:11:06 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-12-26 00:11:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:11:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-26 00:11:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:11:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:11:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:11:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:11:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:11:18 [DEBUG   ] Finished updating board flags in 2.045 seconds
2018-12-26 00:11:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 00:11:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 00:12:06 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 00:12:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:12:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:12:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:12:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:12:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:12:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:12:18 [DEBUG   ] Finished updating board flags in 1.951 seconds
2018-12-26 00:12:26 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2018-12-26 00:12:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 00:13:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 00:13:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:13:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:13:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:13:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:13:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:13:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:13:18 [DEBUG   ] Finished updating board flags in 1.820 seconds
2018-12-26 00:13:26 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 00:13:46 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-12-26 00:14:07 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-26 00:14:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:14:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:14:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:14:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:14:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:14:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:14:18 [DEBUG   ] Finished updating board flags in 1.788 seconds
2018-12-26 00:14:26 [DEBUG   ] Got command RPT from MCS: ref #953045
2018-12-26 00:14:26 [DEBUG   ] summary = ERROR
2018-12-26 00:14:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953045  13 58478   866069 A  ERRORERROR'
2018-12-26 00:14:26 [DEBUG   ] Got command RPT from MCS: ref #953046
2018-12-26 00:14:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 00:14:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953046  77 58478   866273 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 00:14:26 [DEBUG   ] Got command RPT from MCS: ref #953047
2018-12-26 00:14:26 [DEBUG   ] summary = ERROR
2018-12-26 00:14:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953047  13 58478   866477 A  ERRORERROR'
2018-12-26 00:14:26 [DEBUG   ] Got command RPT from MCS: ref #953048
2018-12-26 00:14:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 00:14:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953048  77 58478   866669 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 00:14:26 [DEBUG   ] Got command RPT from MCS: ref #953050
2018-12-26 00:14:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 00:14:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953050  12 58478   866873 A  ERRORB™™š'
2018-12-26 00:14:27 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-26 00:14:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 00:15:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 00:15:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:15:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:15:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:15:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:15:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:15:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:15:18 [DEBUG   ] Finished updating board flags in 1.604 seconds
2018-12-26 00:15:27 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 00:15:47 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-26 00:15:58 [DEBUG   ] Got command RPT from MCS: ref #953059
2018-12-26 00:15:58 [DEBUG   ] summary = ERROR
2018-12-26 00:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953059  13 58478   958513 A  ERRORERROR'
2018-12-26 00:15:58 [DEBUG   ] Got command RPT from MCS: ref #953060
2018-12-26 00:15:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 00:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953060  77 58478   958514 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 00:16:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 00:16:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:16:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:16:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:16:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:16:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:16:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:16:18 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-12-26 00:16:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 00:16:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 00:17:07 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-26 00:17:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 00:17:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:17:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-26 00:17:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:17:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:17:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:17:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:17:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:17:18 [DEBUG   ] Finished updating board flags in 1.593 seconds
2018-12-26 00:17:27 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-26 00:17:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 00:18:07 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 00:18:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:18:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:18:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:18:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:18:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:18:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:18:18 [DEBUG   ] Finished updating board flags in 1.407 seconds
2018-12-26 00:18:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 00:18:47 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-26 00:19:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 00:19:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:19:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:19:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:19:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:19:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:19:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:19:18 [DEBUG   ] Finished updating board flags in 1.436 seconds
2018-12-26 00:19:26 [DEBUG   ] Got command RPT from MCS: ref #953080
2018-12-26 00:19:26 [DEBUG   ] summary = ERROR
2018-12-26 00:19:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953080  13 58478  1166149 A  ERRORERROR'
2018-12-26 00:19:26 [DEBUG   ] Got command RPT from MCS: ref #953081
2018-12-26 00:19:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 00:19:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953081  77 58478  1166353 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 00:19:26 [DEBUG   ] Got command RPT from MCS: ref #953082
2018-12-26 00:19:26 [DEBUG   ] summary = ERROR
2018-12-26 00:19:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953082  13 58478  1166547 A  ERRORERROR'
2018-12-26 00:19:26 [DEBUG   ] Got command RPT from MCS: ref #953083
2018-12-26 00:19:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 00:19:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953083  77 58478  1166750 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 00:19:26 [DEBUG   ] Got command RPT from MCS: ref #953084
2018-12-26 00:19:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 00:19:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953084  12 58478  1166953 A  ERRORB˜™š'
2018-12-26 00:19:27 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-26 00:19:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 00:20:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-26 00:20:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:20:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:20:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:20:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:20:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:20:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:20:18 [DEBUG   ] Finished updating board flags in 1.358 seconds
2018-12-26 00:20:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 00:20:47 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 00:20:58 [DEBUG   ] Got command RPT from MCS: ref #953085
2018-12-26 00:20:58 [DEBUG   ] summary = ERROR
2018-12-26 00:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953085  13 58478  1258517 A  ERRORERROR'
2018-12-26 00:20:58 [DEBUG   ] Got command RPT from MCS: ref #953086
2018-12-26 00:20:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 00:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953086  77 58478  1258518 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 00:21:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 00:21:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:21:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:21:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:21:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:21:18 [WARNING ] (13, 1, 'bot')
2018-12-26 00:21:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:21:18 [DEBUG   ] Finished updating board flags in 1.350 seconds
2018-12-26 00:21:27 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-26 00:21:48 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-26 00:22:08 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-26 00:22:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:22:19 [WARNING ] (13, 1, 'bot')
2018-12-26 00:22:19 [WARNING ] (13, 1, 'bot')
2018-12-26 00:22:19 [WARNING ] (13, 1, 'bot')
2018-12-26 00:22:19 [WARNING ] (13, 1, 'bot')
2018-12-26 00:22:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:22:19 [DEBUG   ] Finished updating board flags in 2.061 seconds
2018-12-26 00:22:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 00:22:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 00:23:08 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 00:23:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:23:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-12-26 00:23:19 [WARNING ] (13, 1, 'bot')
2018-12-26 00:23:19 [WARNING ] (13, 1, 'bot')
2018-12-26 00:23:19 [WARNING ] (13, 1, 'bot')
2018-12-26 00:23:19 [WARNING ] (13, 1, 'bot')
2018-12-26 00:23:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:23:19 [DEBUG   ] Finished updating board flags in 2.081 seconds
2018-12-26 00:23:28 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-26 00:23:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 00:24:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 00:24:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:24:19 [WARNING ] (13, 1, 'bot')
2018-12-26 00:24:19 [WARNING ] (13, 1, 'bot')
2018-12-26 00:24:19 [WARNING ] (13, 1, 'bot')
2018-12-26 00:24:19 [WARNING ] (13, 1, 'bot')
2018-12-26 00:24:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:24:19 [DEBUG   ] Finished updating board flags in 1.915 seconds
2018-12-26 00:24:26 [DEBUG   ] Got command RPT from MCS: ref #953108
2018-12-26 00:24:26 [DEBUG   ] summary = ERROR
2018-12-26 00:24:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953108  13 58478  1466233 A  ERRORERROR'
2018-12-26 00:24:26 [DEBUG   ] Got command RPT from MCS: ref #953109
2018-12-26 00:24:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 00:24:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953109  77 58478  1466425 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 00:24:26 [DEBUG   ] Got command RPT from MCS: ref #953110
2018-12-26 00:24:26 [DEBUG   ] summary = ERROR
2018-12-26 00:24:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953110  13 58478  1466629 A  ERRORERROR'
2018-12-26 00:24:26 [DEBUG   ] Got command RPT from MCS: ref #953111
2018-12-26 00:24:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 00:24:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953111  77 58478  1466833 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 00:24:27 [DEBUG   ] Got command RPT from MCS: ref #953114
2018-12-26 00:24:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 00:24:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953114  12 58478  1467037 A  ERRORBš™š'
2018-12-26 00:24:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 00:24:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 00:25:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 00:25:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:25:19 [WARNING ] (13, 1, 'bot')
2018-12-26 00:25:19 [WARNING ] (13, 1, 'bot')
2018-12-26 00:25:19 [WARNING ] (13, 1, 'bot')
2018-12-26 00:25:19 [WARNING ] (13, 1, 'bot')
2018-12-26 00:25:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:25:19 [DEBUG   ] Finished updating board flags in 1.815 seconds
2018-12-26 00:25:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 00:25:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 00:25:58 [DEBUG   ] Got command RPT from MCS: ref #953122
2018-12-26 00:25:58 [DEBUG   ] summary = ERROR
2018-12-26 00:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953122  13 58478  1558521 A  ERRORERROR'
2018-12-26 00:25:58 [DEBUG   ] Got command RPT from MCS: ref #953123
2018-12-26 00:25:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 00:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953123  77 58478  1558522 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 00:26:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 00:26:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:26:19 [WARNING ] (13, 1, 'bot')
2018-12-26 00:26:19 [WARNING ] (13, 1, 'bot')
2018-12-26 00:26:19 [WARNING ] (13, 1, 'bot')
2018-12-26 00:26:19 [WARNING ] (13, 1, 'bot')
2018-12-26 00:26:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:26:19 [DEBUG   ] Finished updating board flags in 1.810 seconds
2018-12-26 00:26:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 00:26:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 00:27:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 00:27:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:27:19 [WARNING ] (13, 1, 'bot')
2018-12-26 00:27:19 [WARNING ] (13, 1, 'bot')
2018-12-26 00:27:19 [WARNING ] (13, 1, 'bot')
2018-12-26 00:27:19 [WARNING ] (13, 1, 'bot')
2018-12-26 00:27:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:27:19 [DEBUG   ] Finished updating board flags in 1.820 seconds
2018-12-26 00:27:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 00:27:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 00:28:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 00:28:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:28:19 [WARNING ] (13, 1, 'bot')
2018-12-26 00:28:19 [WARNING ] (13, 1, 'bot')
2018-12-26 00:28:19 [WARNING ] (13, 1, 'bot')
2018-12-26 00:28:19 [WARNING ] (13, 1, 'bot')
2018-12-26 00:28:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:28:19 [DEBUG   ] Finished updating board flags in 1.864 seconds
2018-12-26 00:28:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 00:28:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 00:29:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 00:29:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:29:19 [WARNING ] (13, 1, 'bot')
2018-12-26 00:29:19 [WARNING ] (13, 1, 'bot')
2018-12-26 00:29:19 [WARNING ] (13, 1, 'bot')
2018-12-26 00:29:19 [WARNING ] (13, 1, 'bot')
2018-12-26 00:29:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:29:19 [DEBUG   ] Finished updating board flags in 1.728 seconds
2018-12-26 00:29:26 [DEBUG   ] Got command RPT from MCS: ref #953143
2018-12-26 00:29:26 [DEBUG   ] summary = ERROR
2018-12-26 00:29:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953143  13 58478  1766309 A  ERRORERROR'
2018-12-26 00:29:26 [DEBUG   ] Got command RPT from MCS: ref #953144
2018-12-26 00:29:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 00:29:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953144  77 58478  1766513 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 00:29:26 [DEBUG   ] Got command RPT from MCS: ref #953145
2018-12-26 00:29:26 [DEBUG   ] summary = ERROR
2018-12-26 00:29:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953145  13 58478  1766717 A  ERRORERROR'
2018-12-26 00:29:26 [DEBUG   ] Got command RPT from MCS: ref #953146
2018-12-26 00:29:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 00:29:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953146  77 58478  1766909 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 00:29:27 [DEBUG   ] Got command RPT from MCS: ref #953147
2018-12-26 00:29:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 00:29:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953147  12 58478  1767113 A  ERRORB™™š'
2018-12-26 00:29:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 00:29:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 00:30:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 00:30:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:30:19 [WARNING ] (13, 1, 'bot')
2018-12-26 00:30:19 [WARNING ] (13, 1, 'bot')
2018-12-26 00:30:19 [WARNING ] (13, 1, 'bot')
2018-12-26 00:30:19 [WARNING ] (13, 1, 'bot')
2018-12-26 00:30:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:30:19 [DEBUG   ] Finished updating board flags in 1.629 seconds
2018-12-26 00:30:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 00:30:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 00:30:58 [DEBUG   ] Got command RPT from MCS: ref #953152
2018-12-26 00:30:58 [DEBUG   ] summary = ERROR
2018-12-26 00:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953152  13 58478  1858521 A  ERRORERROR'
2018-12-26 00:30:58 [DEBUG   ] Got command RPT from MCS: ref #953153
2018-12-26 00:30:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 00:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953153  77 58478  1858522 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 00:31:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 00:31:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:31:19 [WARNING ] (13, 1, 'bot')
2018-12-26 00:31:19 [WARNING ] (13, 1, 'bot')
2018-12-26 00:31:19 [WARNING ] (13, 1, 'bot')
2018-12-26 00:31:19 [WARNING ] (13, 1, 'bot')
2018-12-26 00:31:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:31:19 [DEBUG   ] Finished updating board flags in 1.553 seconds
2018-12-26 00:31:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 00:31:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 00:32:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 00:32:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:32:19 [WARNING ] (13, 1, 'bot')
2018-12-26 00:32:19 [WARNING ] (13, 1, 'bot')
2018-12-26 00:32:19 [WARNING ] (13, 1, 'bot')
2018-12-26 00:32:19 [WARNING ] (13, 1, 'bot')
2018-12-26 00:32:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:32:19 [DEBUG   ] Finished updating board flags in 1.491 seconds
2018-12-26 00:32:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 00:32:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 00:33:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 00:33:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:33:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 00:33:19 [WARNING ] (13, 1, 'bot')
2018-12-26 00:33:19 [WARNING ] (13, 1, 'bot')
2018-12-26 00:33:19 [WARNING ] (13, 1, 'bot')
2018-12-26 00:33:19 [WARNING ] (13, 1, 'bot')
2018-12-26 00:33:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:33:19 [DEBUG   ] Finished updating board flags in 1.583 seconds
2018-12-26 00:33:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 00:33:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 00:34:08 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-26 00:34:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:34:20 [WARNING ] (13, 1, 'bot')
2018-12-26 00:34:20 [WARNING ] (13, 1, 'bot')
2018-12-26 00:34:20 [WARNING ] (13, 1, 'bot')
2018-12-26 00:34:20 [WARNING ] (13, 1, 'bot')
2018-12-26 00:34:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:34:20 [DEBUG   ] Finished updating board flags in 2.237 seconds
2018-12-26 00:34:26 [DEBUG   ] Got command RPT from MCS: ref #953175
2018-12-26 00:34:26 [DEBUG   ] summary = ERROR
2018-12-26 00:34:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953175  13 58478  2066389 A  ERRORERROR'
2018-12-26 00:34:26 [DEBUG   ] Got command RPT from MCS: ref #953176
2018-12-26 00:34:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 00:34:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953176  77 58478  2066593 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 00:34:26 [DEBUG   ] Got command RPT from MCS: ref #953177
2018-12-26 00:34:26 [DEBUG   ] summary = ERROR
2018-12-26 00:34:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953177  13 58478  2066797 A  ERRORERROR'
2018-12-26 00:34:27 [DEBUG   ] Got command RPT from MCS: ref #953179
2018-12-26 00:34:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 00:34:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953179  77 58478  2067001 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 00:34:27 [DEBUG   ] Got command RPT from MCS: ref #953180
2018-12-26 00:34:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 00:34:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953180  12 58478  2067193 A  ERRORB™™š'
2018-12-26 00:34:28 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-26 00:34:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 00:35:08 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 00:35:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:35:20 [WARNING ] (13, 1, 'bot')
2018-12-26 00:35:20 [WARNING ] (13, 1, 'bot')
2018-12-26 00:35:20 [WARNING ] (13, 1, 'bot')
2018-12-26 00:35:20 [WARNING ] (13, 1, 'bot')
2018-12-26 00:35:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:35:20 [DEBUG   ] Finished updating board flags in 2.151 seconds
2018-12-26 00:35:28 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-26 00:35:48 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 00:35:58 [DEBUG   ] Got command RPT from MCS: ref #953185
2018-12-26 00:35:58 [DEBUG   ] summary = ERROR
2018-12-26 00:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953185  13 58478  2158521 A  ERRORERROR'
2018-12-26 00:35:58 [DEBUG   ] Got command RPT from MCS: ref #953186
2018-12-26 00:35:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 00:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953186  77 58478  2158522 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 00:36:08 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 00:36:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:36:20 [WARNING ] (13, 1, 'bot')
2018-12-26 00:36:20 [WARNING ] (13, 1, 'bot')
2018-12-26 00:36:20 [WARNING ] (13, 1, 'bot')
2018-12-26 00:36:20 [WARNING ] (13, 1, 'bot')
2018-12-26 00:36:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:36:20 [DEBUG   ] Finished updating board flags in 1.954 seconds
2018-12-26 00:36:29 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-26 00:36:49 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-26 00:37:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 00:37:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:37:20 [WARNING ] (13, 1, 'bot')
2018-12-26 00:37:20 [WARNING ] (13, 1, 'bot')
2018-12-26 00:37:20 [WARNING ] (13, 1, 'bot')
2018-12-26 00:37:20 [WARNING ] (13, 1, 'bot')
2018-12-26 00:37:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:37:20 [DEBUG   ] Finished updating board flags in 1.811 seconds
2018-12-26 00:37:29 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 00:37:49 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-26 00:38:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 00:38:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:38:20 [WARNING ] (13, 1, 'bot')
2018-12-26 00:38:20 [WARNING ] (13, 1, 'bot')
2018-12-26 00:38:20 [WARNING ] (13, 1, 'bot')
2018-12-26 00:38:20 [WARNING ] (13, 1, 'bot')
2018-12-26 00:38:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:38:20 [DEBUG   ] Finished updating board flags in 1.782 seconds
2018-12-26 00:38:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 00:38:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 00:39:09 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 00:39:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:39:20 [WARNING ] (13, 1, 'bot')
2018-12-26 00:39:20 [WARNING ] (13, 1, 'bot')
2018-12-26 00:39:20 [WARNING ] (13, 1, 'bot')
2018-12-26 00:39:20 [WARNING ] (13, 1, 'bot')
2018-12-26 00:39:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:39:20 [DEBUG   ] Finished updating board flags in 1.654 seconds
2018-12-26 00:39:26 [DEBUG   ] Got command RPT from MCS: ref #953206
2018-12-26 00:39:26 [DEBUG   ] summary = ERROR
2018-12-26 00:39:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953206  13 58478  2366473 A  ERRORERROR'
2018-12-26 00:39:26 [DEBUG   ] Got command RPT from MCS: ref #953207
2018-12-26 00:39:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 00:39:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953207  77 58478  2366677 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 00:39:26 [DEBUG   ] Got command RPT from MCS: ref #953208
2018-12-26 00:39:26 [DEBUG   ] summary = ERROR
2018-12-26 00:39:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953208  13 58478  2366881 A  ERRORERROR'
2018-12-26 00:39:27 [DEBUG   ] Got command RPT from MCS: ref #953209
2018-12-26 00:39:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 00:39:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953209  77 58478  2367073 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 00:39:27 [DEBUG   ] Got command RPT from MCS: ref #953210
2018-12-26 00:39:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 00:39:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953210  12 58478  2367277 A  ERRORB˜™š'
2018-12-26 00:39:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 00:39:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 00:40:09 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 00:40:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:40:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 00:40:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-26 00:40:20 [WARNING ] (13, 1, 'bot')
2018-12-26 00:40:20 [WARNING ] (13, 1, 'bot')
2018-12-26 00:40:20 [WARNING ] (13, 1, 'bot')
2018-12-26 00:40:20 [WARNING ] (13, 1, 'bot')
2018-12-26 00:40:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:40:20 [DEBUG   ] Finished updating board flags in 1.556 seconds
2018-12-26 00:40:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 00:40:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 00:40:58 [DEBUG   ] Got command RPT from MCS: ref #953215
2018-12-26 00:40:58 [DEBUG   ] summary = ERROR
2018-12-26 00:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953215  13 58478  2458517 A  ERRORERROR'
2018-12-26 00:40:58 [DEBUG   ] Got command RPT from MCS: ref #953216
2018-12-26 00:40:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 00:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953216  77 58478  2458518 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 00:41:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 00:41:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:41:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-26 00:41:20 [WARNING ] (13, 1, 'bot')
2018-12-26 00:41:20 [WARNING ] (13, 1, 'bot')
2018-12-26 00:41:20 [WARNING ] (13, 1, 'bot')
2018-12-26 00:41:20 [WARNING ] (13, 1, 'bot')
2018-12-26 00:41:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:41:20 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-12-26 00:41:29 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 00:41:49 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-26 00:42:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 00:42:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:42:20 [WARNING ] (13, 1, 'bot')
2018-12-26 00:42:20 [WARNING ] (13, 1, 'bot')
2018-12-26 00:42:20 [WARNING ] (13, 1, 'bot')
2018-12-26 00:42:20 [WARNING ] (13, 1, 'bot')
2018-12-26 00:42:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:42:20 [DEBUG   ] Finished updating board flags in 1.378 seconds
2018-12-26 00:42:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 00:42:49 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 00:43:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 00:43:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 00:43:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:43:20 [WARNING ] (13, 1, 'bot')
2018-12-26 00:43:20 [WARNING ] (13, 1, 'bot')
2018-12-26 00:43:20 [WARNING ] (13, 1, 'bot')
2018-12-26 00:43:20 [WARNING ] (13, 1, 'bot')
2018-12-26 00:43:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:43:20 [DEBUG   ] Finished updating board flags in 1.551 seconds
2018-12-26 00:43:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 00:43:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 00:44:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 00:44:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:44:21 [WARNING ] (13, 1, 'bot')
2018-12-26 00:44:21 [WARNING ] (13, 1, 'bot')
2018-12-26 00:44:21 [WARNING ] (13, 1, 'bot')
2018-12-26 00:44:21 [WARNING ] (13, 1, 'bot')
2018-12-26 00:44:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:44:21 [DEBUG   ] Finished updating board flags in 2.162 seconds
2018-12-26 00:44:26 [DEBUG   ] Got command RPT from MCS: ref #953238
2018-12-26 00:44:26 [DEBUG   ] summary = ERROR
2018-12-26 00:44:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953238  13 58478  2666557 A  ERRORERROR'
2018-12-26 00:44:26 [DEBUG   ] Got command RPT from MCS: ref #953239
2018-12-26 00:44:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 00:44:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953239  77 58478  2666761 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 00:44:26 [DEBUG   ] Got command RPT from MCS: ref #953240
2018-12-26 00:44:26 [DEBUG   ] summary = ERROR
2018-12-26 00:44:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953240  13 58478  2666965 A  ERRORERROR'
2018-12-26 00:44:27 [DEBUG   ] Got command RPT from MCS: ref #953242
2018-12-26 00:44:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 00:44:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953242  77 58478  2667157 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 00:44:27 [DEBUG   ] Got command RPT from MCS: ref #953244
2018-12-26 00:44:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 00:44:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953244  12 58478  2667361 A  ERRORB™™š'
2018-12-26 00:44:29 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-26 00:44:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 00:45:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 00:45:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:45:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-26 00:45:21 [WARNING ] (13, 1, 'bot')
2018-12-26 00:45:21 [WARNING ] (13, 1, 'bot')
2018-12-26 00:45:21 [WARNING ] (13, 1, 'bot')
2018-12-26 00:45:21 [WARNING ] (13, 1, 'bot')
2018-12-26 00:45:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:45:21 [DEBUG   ] Finished updating board flags in 1.901 seconds
2018-12-26 00:45:29 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 00:45:49 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-26 00:45:58 [DEBUG   ] Got command RPT from MCS: ref #953252
2018-12-26 00:45:58 [DEBUG   ] summary = ERROR
2018-12-26 00:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953252  13 58478  2758521 A  ERRORERROR'
2018-12-26 00:45:58 [DEBUG   ] Got command RPT from MCS: ref #953253
2018-12-26 00:45:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 00:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953253  77 58478  2758522 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 00:46:09 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 00:46:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:46:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 00:46:21 [WARNING ] (13, 1, 'bot')
2018-12-26 00:46:21 [WARNING ] (13, 1, 'bot')
2018-12-26 00:46:21 [WARNING ] (13, 1, 'bot')
2018-12-26 00:46:21 [WARNING ] (13, 1, 'bot')
2018-12-26 00:46:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:46:21 [DEBUG   ] Finished updating board flags in 1.806 seconds
2018-12-26 00:46:30 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-26 00:46:50 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-26 00:47:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 00:47:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:47:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 00:47:21 [WARNING ] (13, 1, 'bot')
2018-12-26 00:47:21 [WARNING ] (13, 1, 'bot')
2018-12-26 00:47:21 [WARNING ] (13, 1, 'bot')
2018-12-26 00:47:21 [WARNING ] (13, 1, 'bot')
2018-12-26 00:47:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:47:21 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-12-26 00:47:30 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 00:47:50 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-26 00:48:10 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-12-26 00:48:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:48:21 [WARNING ] (13, 1, 'bot')
2018-12-26 00:48:21 [WARNING ] (13, 1, 'bot')
2018-12-26 00:48:21 [WARNING ] (13, 1, 'bot')
2018-12-26 00:48:21 [WARNING ] (13, 1, 'bot')
2018-12-26 00:48:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:48:21 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-12-26 00:48:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 00:48:50 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 00:49:10 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 00:49:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:49:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-12-26 00:49:21 [WARNING ] (13, 1, 'bot')
2018-12-26 00:49:21 [WARNING ] (13, 1, 'bot')
2018-12-26 00:49:21 [WARNING ] (13, 1, 'bot')
2018-12-26 00:49:21 [WARNING ] (13, 1, 'bot')
2018-12-26 00:49:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:49:21 [DEBUG   ] Finished updating board flags in 1.775 seconds
2018-12-26 00:49:26 [DEBUG   ] Got command RPT from MCS: ref #953273
2018-12-26 00:49:26 [DEBUG   ] summary = ERROR
2018-12-26 00:49:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953273  13 58478  2966641 A  ERRORERROR'
2018-12-26 00:49:26 [DEBUG   ] Got command RPT from MCS: ref #953274
2018-12-26 00:49:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 00:49:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953274  77 58478  2966845 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 00:49:27 [DEBUG   ] Got command RPT from MCS: ref #953275
2018-12-26 00:49:27 [DEBUG   ] summary = ERROR
2018-12-26 00:49:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953275  13 58478  2967037 A  ERRORERROR'
2018-12-26 00:49:27 [DEBUG   ] Got command RPT from MCS: ref #953276
2018-12-26 00:49:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 00:49:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953276  77 58478  2967241 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 00:49:27 [DEBUG   ] Got command RPT from MCS: ref #953277
2018-12-26 00:49:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 00:49:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953277  12 58478  2967445 A  ERRORBš™š'
2018-12-26 00:49:30 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2018-12-26 00:49:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 00:50:10 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-26 00:50:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:50:21 [WARNING ] (13, 1, 'bot')
2018-12-26 00:50:21 [WARNING ] (13, 1, 'bot')
2018-12-26 00:50:21 [WARNING ] (13, 1, 'bot')
2018-12-26 00:50:21 [WARNING ] (13, 1, 'bot')
2018-12-26 00:50:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:50:21 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-12-26 00:50:30 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 00:50:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 00:50:58 [DEBUG   ] Got command RPT from MCS: ref #953278
2018-12-26 00:50:58 [DEBUG   ] summary = ERROR
2018-12-26 00:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953278  13 58478  3058525 A  ERRORERROR'
2018-12-26 00:50:58 [DEBUG   ] Got command RPT from MCS: ref #953279
2018-12-26 00:50:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 00:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953279  77 58478  3058526 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 00:51:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 00:51:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 00:51:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:51:21 [WARNING ] (13, 1, 'bot')
2018-12-26 00:51:21 [WARNING ] (13, 1, 'bot')
2018-12-26 00:51:21 [WARNING ] (13, 1, 'bot')
2018-12-26 00:51:21 [WARNING ] (13, 1, 'bot')
2018-12-26 00:51:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:51:21 [DEBUG   ] Finished updating board flags in 1.589 seconds
2018-12-26 00:51:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 00:51:50 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 00:52:10 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-26 00:52:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:52:21 [WARNING ] (13, 1, 'bot')
2018-12-26 00:52:21 [WARNING ] (13, 1, 'bot')
2018-12-26 00:52:21 [WARNING ] (13, 1, 'bot')
2018-12-26 00:52:21 [WARNING ] (13, 1, 'bot')
2018-12-26 00:52:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:52:21 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-12-26 00:52:30 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 00:52:51 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-26 00:53:11 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-26 00:53:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:53:21 [WARNING ] (13, 1, 'bot')
2018-12-26 00:53:21 [WARNING ] (13, 1, 'bot')
2018-12-26 00:53:21 [WARNING ] (13, 1, 'bot')
2018-12-26 00:53:21 [WARNING ] (13, 1, 'bot')
2018-12-26 00:53:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:53:21 [DEBUG   ] Finished updating board flags in 1.386 seconds
2018-12-26 00:53:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 00:53:51 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-26 00:54:11 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-26 00:54:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 00:54:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:54:21 [WARNING ] (13, 1, 'bot')
2018-12-26 00:54:21 [WARNING ] (13, 1, 'bot')
2018-12-26 00:54:21 [WARNING ] (13, 1, 'bot')
2018-12-26 00:54:21 [WARNING ] (13, 1, 'bot')
2018-12-26 00:54:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:54:21 [DEBUG   ] Finished updating board flags in 1.363 seconds
2018-12-26 00:54:26 [DEBUG   ] Got command RPT from MCS: ref #953301
2018-12-26 00:54:26 [DEBUG   ] summary = ERROR
2018-12-26 00:54:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953301  13 58478  3266713 A  ERRORERROR'
2018-12-26 00:54:26 [DEBUG   ] Got command RPT from MCS: ref #953302
2018-12-26 00:54:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 00:54:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953302  77 58478  3266917 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 00:54:27 [DEBUG   ] Got command RPT from MCS: ref #953303
2018-12-26 00:54:27 [DEBUG   ] summary = ERROR
2018-12-26 00:54:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953303  13 58478  3267121 A  ERRORERROR'
2018-12-26 00:54:27 [DEBUG   ] Got command RPT from MCS: ref #953305
2018-12-26 00:54:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 00:54:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953305  77 58478  3267325 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 00:54:27 [DEBUG   ] Got command RPT from MCS: ref #953306
2018-12-26 00:54:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 00:54:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953306  12 58478  3267517 A  ERRORB™™š'
2018-12-26 00:54:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 00:54:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 00:55:11 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-12-26 00:55:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:55:22 [WARNING ] (13, 1, 'bot')
2018-12-26 00:55:22 [WARNING ] (13, 1, 'bot')
2018-12-26 00:55:22 [WARNING ] (13, 1, 'bot')
2018-12-26 00:55:22 [WARNING ] (13, 1, 'bot')
2018-12-26 00:55:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:55:22 [DEBUG   ] Finished updating board flags in 2.056 seconds
2018-12-26 00:55:31 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-26 00:55:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 00:55:58 [DEBUG   ] Got command RPT from MCS: ref #953315
2018-12-26 00:55:58 [DEBUG   ] summary = ERROR
2018-12-26 00:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953315  13 58478  3358521 A  ERRORERROR'
2018-12-26 00:55:58 [DEBUG   ] Got command RPT from MCS: ref #953316
2018-12-26 00:55:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 00:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953316  77 58478  3358522 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 00:56:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 00:56:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:56:22 [WARNING ] (13, 1, 'bot')
2018-12-26 00:56:22 [WARNING ] (13, 1, 'bot')
2018-12-26 00:56:22 [WARNING ] (13, 1, 'bot')
2018-12-26 00:56:22 [WARNING ] (13, 1, 'bot')
2018-12-26 00:56:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:56:22 [DEBUG   ] Finished updating board flags in 1.997 seconds
2018-12-26 00:56:31 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-12-26 00:56:51 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-26 00:57:12 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-12-26 00:57:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:57:22 [WARNING ] (13, 1, 'bot')
2018-12-26 00:57:22 [WARNING ] (13, 1, 'bot')
2018-12-26 00:57:22 [WARNING ] (13, 1, 'bot')
2018-12-26 00:57:22 [WARNING ] (13, 1, 'bot')
2018-12-26 00:57:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:57:22 [DEBUG   ] Finished updating board flags in 1.816 seconds
2018-12-26 00:57:31 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-26 00:57:51 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-26 00:58:12 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-12-26 00:58:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 00:58:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:58:22 [WARNING ] (13, 1, 'bot')
2018-12-26 00:58:22 [WARNING ] (13, 1, 'bot')
2018-12-26 00:58:22 [WARNING ] (13, 1, 'bot')
2018-12-26 00:58:22 [WARNING ] (13, 1, 'bot')
2018-12-26 00:58:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:58:22 [DEBUG   ] Finished updating board flags in 1.887 seconds
2018-12-26 00:58:32 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-26 00:58:52 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 00:59:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 00:59:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 00:59:22 [WARNING ] (13, 1, 'bot')
2018-12-26 00:59:22 [WARNING ] (13, 1, 'bot')
2018-12-26 00:59:22 [WARNING ] (13, 1, 'bot')
2018-12-26 00:59:22 [WARNING ] (13, 1, 'bot')
2018-12-26 00:59:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 00:59:22 [DEBUG   ] Finished updating board flags in 1.711 seconds
2018-12-26 00:59:26 [DEBUG   ] Got command RPT from MCS: ref #953336
2018-12-26 00:59:26 [DEBUG   ] summary = ERROR
2018-12-26 00:59:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953336  13 58478  3566793 A  ERRORERROR'
2018-12-26 00:59:26 [DEBUG   ] Got command RPT from MCS: ref #953337
2018-12-26 00:59:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 00:59:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953337  77 58478  3566997 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 00:59:27 [DEBUG   ] Got command RPT from MCS: ref #953338
2018-12-26 00:59:27 [DEBUG   ] summary = ERROR
2018-12-26 00:59:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953338  13 58478  3567201 A  ERRORERROR'
2018-12-26 00:59:27 [DEBUG   ] Got command RPT from MCS: ref #953339
2018-12-26 00:59:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 00:59:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953339  77 58478  3567393 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 00:59:27 [DEBUG   ] Got command RPT from MCS: ref #953340
2018-12-26 00:59:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 00:59:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953340  12 58478  3567597 A  ERRORB™™š'
2018-12-26 00:59:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 00:59:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 01:00:12 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 01:00:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:00:22 [WARNING ] (13, 1, 'bot')
2018-12-26 01:00:22 [WARNING ] (13, 1, 'bot')
2018-12-26 01:00:22 [WARNING ] (13, 1, 'bot')
2018-12-26 01:00:22 [WARNING ] (13, 1, 'bot')
2018-12-26 01:00:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:00:22 [DEBUG   ] Finished updating board flags in 1.629 seconds
2018-12-26 01:00:32 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-26 01:00:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 01:00:58 [DEBUG   ] Got command RPT from MCS: ref #953345
2018-12-26 01:00:58 [DEBUG   ] summary = ERROR
2018-12-26 01:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953345  13 58478  3658521 A  ERRORERROR'
2018-12-26 01:00:58 [DEBUG   ] Got command RPT from MCS: ref #953346
2018-12-26 01:00:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 01:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953346  77 58478  3658522 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 01:01:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 01:01:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:01:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-26 01:01:22 [WARNING ] (13, 1, 'bot')
2018-12-26 01:01:22 [WARNING ] (13, 1, 'bot')
2018-12-26 01:01:22 [WARNING ] (13, 1, 'bot')
2018-12-26 01:01:22 [WARNING ] (13, 1, 'bot')
2018-12-26 01:01:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:01:22 [DEBUG   ] Finished updating board flags in 1.609 seconds
2018-12-26 01:01:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 01:01:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 01:02:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 01:02:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:02:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-12-26 01:02:22 [WARNING ] (13, 1, 'bot')
2018-12-26 01:02:22 [WARNING ] (13, 1, 'bot')
2018-12-26 01:02:22 [WARNING ] (13, 1, 'bot')
2018-12-26 01:02:22 [WARNING ] (13, 1, 'bot')
2018-12-26 01:02:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:02:22 [DEBUG   ] Finished updating board flags in 1.556 seconds
2018-12-26 01:02:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 01:02:52 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 01:03:12 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-26 01:03:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:03:22 [WARNING ] (13, 1, 'bot')
2018-12-26 01:03:22 [WARNING ] (13, 1, 'bot')
2018-12-26 01:03:22 [WARNING ] (13, 1, 'bot')
2018-12-26 01:03:22 [WARNING ] (13, 1, 'bot')
2018-12-26 01:03:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:03:22 [DEBUG   ] Finished updating board flags in 1.436 seconds
2018-12-26 01:03:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 01:03:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 01:04:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 01:04:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-26 01:04:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:04:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 01:04:22 [WARNING ] (13, 1, 'bot')
2018-12-26 01:04:22 [WARNING ] (13, 1, 'bot')
2018-12-26 01:04:22 [WARNING ] (13, 1, 'bot')
2018-12-26 01:04:22 [WARNING ] (13, 1, 'bot')
2018-12-26 01:04:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:04:22 [DEBUG   ] Finished updating board flags in 1.426 seconds
2018-12-26 01:04:26 [DEBUG   ] Got command RPT from MCS: ref #953368
2018-12-26 01:04:26 [DEBUG   ] summary = ERROR
2018-12-26 01:04:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953368  13 58478  3866877 A  ERRORERROR'
2018-12-26 01:04:27 [DEBUG   ] Got command RPT from MCS: ref #953369
2018-12-26 01:04:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 01:04:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953369  77 58478  3867081 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 01:04:27 [DEBUG   ] Got command RPT from MCS: ref #953370
2018-12-26 01:04:27 [DEBUG   ] summary = ERROR
2018-12-26 01:04:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953370  13 58478  3867273 A  ERRORERROR'
2018-12-26 01:04:27 [DEBUG   ] Got command RPT from MCS: ref #953372
2018-12-26 01:04:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 01:04:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953372  77 58478  3867477 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 01:04:27 [DEBUG   ] Got command RPT from MCS: ref #953373
2018-12-26 01:04:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 01:04:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953373  12 58478  3867681 A  ERRORBš™š'
2018-12-26 01:04:32 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2018-12-26 01:04:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 01:05:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 01:05:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 01:05:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:05:22 [WARNING ] (13, 1, 'bot')
2018-12-26 01:05:22 [WARNING ] (13, 1, 'bot')
2018-12-26 01:05:22 [WARNING ] (13, 1, 'bot')
2018-12-26 01:05:22 [WARNING ] (13, 1, 'bot')
2018-12-26 01:05:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:05:22 [DEBUG   ] Finished updating board flags in 1.434 seconds
2018-12-26 01:05:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 01:05:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 01:05:58 [DEBUG   ] Got command RPT from MCS: ref #953378
2018-12-26 01:05:58 [DEBUG   ] summary = ERROR
2018-12-26 01:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953378  13 58478  3958521 A  ERRORERROR'
2018-12-26 01:05:58 [DEBUG   ] Got command RPT from MCS: ref #953379
2018-12-26 01:05:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 01:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953379  77 58478  3958522 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 01:06:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 01:06:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:06:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-12-26 01:06:22 [WARNING ] (13, 1, 'bot')
2018-12-26 01:06:22 [WARNING ] (13, 1, 'bot')
2018-12-26 01:06:22 [WARNING ] (13, 1, 'bot')
2018-12-26 01:06:22 [WARNING ] (13, 1, 'bot')
2018-12-26 01:06:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:06:22 [DEBUG   ] Finished updating board flags in 1.439 seconds
2018-12-26 01:06:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 01:06:52 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 01:07:12 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-26 01:07:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 01:07:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:07:22 [WARNING ] (13, 1, 'bot')
2018-12-26 01:07:22 [WARNING ] (13, 1, 'bot')
2018-12-26 01:07:22 [WARNING ] (13, 1, 'bot')
2018-12-26 01:07:22 [WARNING ] (13, 1, 'bot')
2018-12-26 01:07:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:07:22 [DEBUG   ] Finished updating board flags in 1.471 seconds
2018-12-26 01:07:32 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-26 01:07:52 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 01:08:13 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-26 01:08:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:08:22 [WARNING ] (13, 1, 'bot')
2018-12-26 01:08:22 [WARNING ] (13, 1, 'bot')
2018-12-26 01:08:22 [WARNING ] (13, 1, 'bot')
2018-12-26 01:08:22 [WARNING ] (13, 1, 'bot')
2018-12-26 01:08:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:08:22 [DEBUG   ] Finished updating board flags in 1.481 seconds
2018-12-26 01:08:33 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-26 01:08:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 01:09:13 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 01:09:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:09:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-26 01:09:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:09:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:09:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:09:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:09:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:09:23 [DEBUG   ] Finished updating board flags in 2.175 seconds
2018-12-26 01:09:26 [DEBUG   ] Got command RPT from MCS: ref #953399
2018-12-26 01:09:26 [DEBUG   ] summary = ERROR
2018-12-26 01:09:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953399  13 58478  4166953 A  ERRORERROR'
2018-12-26 01:09:27 [DEBUG   ] Got command RPT from MCS: ref #953400
2018-12-26 01:09:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 01:09:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953400  77 58478  4167157 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 01:09:27 [DEBUG   ] Got command RPT from MCS: ref #953401
2018-12-26 01:09:27 [DEBUG   ] summary = ERROR
2018-12-26 01:09:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953401  13 58478  4167361 A  ERRORERROR'
2018-12-26 01:09:27 [DEBUG   ] Got command RPT from MCS: ref #953402
2018-12-26 01:09:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 01:09:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953402  77 58478  4167565 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 01:09:27 [DEBUG   ] Got command RPT from MCS: ref #953403
2018-12-26 01:09:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 01:09:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953403  12 58478  4167757 A  ERRORBš™š'
2018-12-26 01:09:33 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-26 01:09:53 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-26 01:10:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 01:10:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:10:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:10:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:10:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:10:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:10:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:10:23 [DEBUG   ] Finished updating board flags in 1.961 seconds
2018-12-26 01:10:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 01:10:53 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-26 01:10:58 [DEBUG   ] Got command RPT from MCS: ref #953408
2018-12-26 01:10:58 [DEBUG   ] summary = ERROR
2018-12-26 01:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953408  13 58478  4258521 A  ERRORERROR'
2018-12-26 01:10:58 [DEBUG   ] Got command RPT from MCS: ref #953409
2018-12-26 01:10:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 01:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953409  77 58478  4258522 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 01:11:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 01:11:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:11:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:11:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:11:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:11:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:11:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:11:23 [DEBUG   ] Finished updating board flags in 1.825 seconds
2018-12-26 01:11:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 01:11:53 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 01:12:13 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-26 01:12:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 01:12:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:12:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:12:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:12:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:12:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:12:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:12:23 [DEBUG   ] Finished updating board flags in 1.782 seconds
2018-12-26 01:12:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 01:12:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 01:13:13 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 01:13:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 01:13:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:13:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:13:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:13:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:13:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:13:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:13:23 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-12-26 01:13:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 01:13:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 01:14:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 01:14:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 01:14:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:14:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:14:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:14:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:14:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:14:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:14:23 [DEBUG   ] Finished updating board flags in 1.670 seconds
2018-12-26 01:14:27 [DEBUG   ] Got command RPT from MCS: ref #953431
2018-12-26 01:14:27 [DEBUG   ] summary = ERROR
2018-12-26 01:14:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953431  13 58478  4467033 A  ERRORERROR'
2018-12-26 01:14:27 [DEBUG   ] Got command RPT from MCS: ref #953432
2018-12-26 01:14:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 01:14:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953432  77 58478  4467237 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 01:14:27 [DEBUG   ] Got command RPT from MCS: ref #953433
2018-12-26 01:14:27 [DEBUG   ] summary = ERROR
2018-12-26 01:14:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953433  13 58478  4467441 A  ERRORERROR'
2018-12-26 01:14:27 [DEBUG   ] Got command RPT from MCS: ref #953435
2018-12-26 01:14:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 01:14:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953435  77 58478  4467645 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 01:14:27 [DEBUG   ] Got command RPT from MCS: ref #953436
2018-12-26 01:14:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 01:14:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953436  12 58478  4467837 A  ERRORB™™š'
2018-12-26 01:14:33 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 01:14:53 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-26 01:15:13 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 01:15:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:15:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:15:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:15:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:15:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:15:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:15:23 [DEBUG   ] Finished updating board flags in 1.523 seconds
2018-12-26 01:15:34 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-26 01:15:54 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-26 01:15:58 [DEBUG   ] Got command RPT from MCS: ref #953445
2018-12-26 01:15:58 [DEBUG   ] summary = ERROR
2018-12-26 01:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953445  13 58478  4558533 A  ERRORERROR'
2018-12-26 01:15:58 [DEBUG   ] Got command RPT from MCS: ref #953446
2018-12-26 01:15:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 01:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953446  77 58478  4558534 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 01:16:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 01:16:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:16:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 01:16:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:16:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:16:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:16:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:16:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:16:23 [DEBUG   ] Finished updating board flags in 1.423 seconds
2018-12-26 01:16:34 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-26 01:16:54 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-26 01:17:14 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-26 01:17:22 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 01:17:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:17:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:17:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:17:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:17:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:17:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:17:23 [DEBUG   ] Finished updating board flags in 1.420 seconds
2018-12-26 01:17:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 01:17:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 01:18:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 01:18:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:18:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:18:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:18:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:18:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:18:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:18:23 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-12-26 01:18:34 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-26 01:18:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 01:19:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 01:19:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 01:19:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:19:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-12-26 01:19:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:19:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:19:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:19:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:19:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:19:23 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-12-26 01:19:27 [DEBUG   ] Got command RPT from MCS: ref #953466
2018-12-26 01:19:27 [DEBUG   ] summary = ERROR
2018-12-26 01:19:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953466  13 58478  4767121 A  ERRORERROR'
2018-12-26 01:19:27 [DEBUG   ] Got command RPT from MCS: ref #953467
2018-12-26 01:19:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 01:19:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953467  77 58478  4767325 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 01:19:27 [DEBUG   ] Got command RPT from MCS: ref #953468
2018-12-26 01:19:27 [DEBUG   ] summary = ERROR
2018-12-26 01:19:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953468  13 58478  4767517 A  ERRORERROR'
2018-12-26 01:19:27 [DEBUG   ] Got command RPT from MCS: ref #953469
2018-12-26 01:19:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 01:19:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953469  77 58478  4767721 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 01:19:27 [DEBUG   ] Got command RPT from MCS: ref #953470
2018-12-26 01:19:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 01:19:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953470  12 58478  4767925 A  ERRORB™™š'
2018-12-26 01:19:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 01:19:54 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-26 01:20:14 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-26 01:20:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:20:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:20:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:20:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:20:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:20:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:20:23 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-12-26 01:20:34 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-26 01:20:55 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-12-26 01:20:58 [DEBUG   ] Got command RPT from MCS: ref #953471
2018-12-26 01:20:58 [DEBUG   ] summary = ERROR
2018-12-26 01:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953471  13 58478  4858533 A  ERRORERROR'
2018-12-26 01:20:58 [DEBUG   ] Got command RPT from MCS: ref #953472
2018-12-26 01:20:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 01:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953472  77 58478  4858534 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 01:21:15 [DEBUG   ] Finished updating ant stats in 1.211 seconds
2018-12-26 01:21:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:21:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-26 01:21:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:21:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:21:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:21:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:21:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:21:23 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-12-26 01:21:35 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 01:21:55 [DEBUG   ] Finished updating ant stats in 0.983 seconds
2018-12-26 01:22:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 01:22:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:22:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:22:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:22:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:22:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:22:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:22:23 [DEBUG   ] Finished updating board flags in 1.411 seconds
2018-12-26 01:22:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 01:22:55 [DEBUG   ] Finished updating ant stats in 0.788 seconds
2018-12-26 01:23:15 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-26 01:23:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 01:23:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:23:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:23:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:23:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:23:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:23:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:23:23 [DEBUG   ] Finished updating board flags in 1.412 seconds
2018-12-26 01:23:35 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-12-26 01:23:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 01:24:16 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-26 01:24:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:24:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-26 01:24:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:24:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:24:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:24:23 [WARNING ] (13, 1, 'bot')
2018-12-26 01:24:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:24:23 [DEBUG   ] Finished updating board flags in 1.386 seconds
2018-12-26 01:24:27 [DEBUG   ] Got command RPT from MCS: ref #953494
2018-12-26 01:24:27 [DEBUG   ] summary = ERROR
2018-12-26 01:24:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953494  13 58478  5067193 A  ERRORERROR'
2018-12-26 01:24:27 [DEBUG   ] Got command RPT from MCS: ref #953495
2018-12-26 01:24:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 01:24:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953495  77 58478  5067397 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 01:24:27 [DEBUG   ] Got command RPT from MCS: ref #953496
2018-12-26 01:24:27 [DEBUG   ] summary = ERROR
2018-12-26 01:24:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953496  13 58478  5067601 A  ERRORERROR'
2018-12-26 01:24:27 [DEBUG   ] Got command RPT from MCS: ref #953498
2018-12-26 01:24:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 01:24:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953498  77 58478  5067805 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 01:24:27 [DEBUG   ] Got command RPT from MCS: ref #953500
2018-12-26 01:24:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 01:24:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953500  12 58478  5067997 A  ERRORB™™š'
2018-12-26 01:24:36 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-26 01:24:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 01:25:16 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-26 01:25:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:25:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:25:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:25:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:25:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:25:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:25:24 [DEBUG   ] Finished updating board flags in 2.134 seconds
2018-12-26 01:25:36 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-26 01:25:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 01:25:58 [DEBUG   ] Got command RPT from MCS: ref #953508
2018-12-26 01:25:58 [DEBUG   ] summary = ERROR
2018-12-26 01:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953508  13 58478  5158525 A  ERRORERROR'
2018-12-26 01:25:58 [DEBUG   ] Got command RPT from MCS: ref #953509
2018-12-26 01:25:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 01:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953509  77 58478  5158526 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 01:26:16 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 01:26:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 01:26:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:26:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:26:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:26:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:26:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:26:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:26:24 [DEBUG   ] Finished updating board flags in 1.991 seconds
2018-12-26 01:26:36 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-26 01:26:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 01:27:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 01:27:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 01:27:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:27:24 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 01:27:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:27:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:27:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:27:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:27:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:27:24 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-12-26 01:27:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 01:27:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 01:28:16 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-26 01:28:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:28:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:28:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:28:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:28:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:28:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:28:24 [DEBUG   ] Finished updating board flags in 1.804 seconds
2018-12-26 01:28:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 01:28:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 01:29:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 01:29:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:29:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-26 01:29:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:29:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:29:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:29:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:29:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:29:24 [DEBUG   ] Finished updating board flags in 1.821 seconds
2018-12-26 01:29:27 [DEBUG   ] Got command RPT from MCS: ref #953529
2018-12-26 01:29:27 [DEBUG   ] summary = ERROR
2018-12-26 01:29:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953529  13 58478  5367273 A  ERRORERROR'
2018-12-26 01:29:27 [DEBUG   ] Got command RPT from MCS: ref #953530
2018-12-26 01:29:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 01:29:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953530  77 58478  5367477 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 01:29:27 [DEBUG   ] Got command RPT from MCS: ref #953531
2018-12-26 01:29:27 [DEBUG   ] summary = ERROR
2018-12-26 01:29:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953531  13 58478  5367682 A  ERRORERROR'
2018-12-26 01:29:27 [DEBUG   ] Got command RPT from MCS: ref #953532
2018-12-26 01:29:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 01:29:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953532  77 58478  5367885 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 01:29:28 [DEBUG   ] Got command RPT from MCS: ref #953533
2018-12-26 01:29:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 01:29:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953533  12 58478  5368077 A  ERRORB™™š'
2018-12-26 01:29:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 01:29:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 01:30:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 01:30:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:30:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:30:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:30:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:30:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:30:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:30:24 [DEBUG   ] Finished updating board flags in 1.807 seconds
2018-12-26 01:30:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 01:30:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 01:30:58 [DEBUG   ] Got command RPT from MCS: ref #953538
2018-12-26 01:30:58 [DEBUG   ] summary = ERROR
2018-12-26 01:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953538  13 58478  5458533 A  ERRORERROR'
2018-12-26 01:30:58 [DEBUG   ] Got command RPT from MCS: ref #953539
2018-12-26 01:30:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 01:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953539  77 58478  5458534 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 01:31:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 01:31:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:31:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:31:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:31:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:31:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:31:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:31:24 [DEBUG   ] Finished updating board flags in 1.791 seconds
2018-12-26 01:31:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 01:31:56 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 01:32:16 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-26 01:32:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:32:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 01:32:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:32:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:32:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:32:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:32:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:32:24 [DEBUG   ] Finished updating board flags in 1.580 seconds
2018-12-26 01:32:37 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-26 01:32:57 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-26 01:33:17 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-26 01:33:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 01:33:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:33:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:33:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:33:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:33:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:33:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:33:24 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-12-26 01:33:37 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-26 01:33:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 01:34:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 01:34:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:34:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:34:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:34:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:34:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:34:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:34:24 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-12-26 01:34:27 [DEBUG   ] Got command RPT from MCS: ref #953561
2018-12-26 01:34:27 [DEBUG   ] summary = ERROR
2018-12-26 01:34:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953561  13 58478  5667365 A  ERRORERROR'
2018-12-26 01:34:27 [DEBUG   ] Got command RPT from MCS: ref #953562
2018-12-26 01:34:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 01:34:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953562  77 58478  5667557 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 01:34:27 [DEBUG   ] Got command RPT from MCS: ref #953563
2018-12-26 01:34:27 [DEBUG   ] summary = ERROR
2018-12-26 01:34:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953563  13 58478  5667761 A  ERRORERROR'
2018-12-26 01:34:27 [DEBUG   ] Got command RPT from MCS: ref #953565
2018-12-26 01:34:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 01:34:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953565  77 58478  5667965 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 01:34:28 [DEBUG   ] Got command RPT from MCS: ref #953566
2018-12-26 01:34:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 01:34:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953566  12 58478  5668169 A  ERRORB™™š'
2018-12-26 01:34:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 01:34:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 01:35:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 01:35:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:35:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:35:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:35:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:35:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:35:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:35:24 [DEBUG   ] Finished updating board flags in 1.430 seconds
2018-12-26 01:35:37 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 01:35:57 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-26 01:35:58 [DEBUG   ] Got command RPT from MCS: ref #953571
2018-12-26 01:35:58 [DEBUG   ] summary = ERROR
2018-12-26 01:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953571  13 58478  5758537 A  ERRORERROR'
2018-12-26 01:35:58 [DEBUG   ] Got command RPT from MCS: ref #953572
2018-12-26 01:35:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 01:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953572  77 58478  5758538 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 01:36:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 01:36:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:36:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 01:36:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:36:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:36:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:36:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:36:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:36:24 [DEBUG   ] Finished updating board flags in 1.438 seconds
2018-12-26 01:36:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 01:36:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 01:37:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 01:37:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 01:37:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:37:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 01:37:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:37:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:37:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:37:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:37:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:37:24 [DEBUG   ] Finished updating board flags in 1.464 seconds
2018-12-26 01:37:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 01:37:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 01:38:17 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 01:38:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:38:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 01:38:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:38:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:38:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:38:24 [WARNING ] (13, 1, 'bot')
2018-12-26 01:38:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:38:24 [DEBUG   ] Finished updating board flags in 1.488 seconds
2018-12-26 01:38:37 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-26 01:38:58 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-26 01:39:18 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-26 01:39:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:39:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-26 01:39:25 [WARNING ] (13, 1, 'bot')
2018-12-26 01:39:25 [WARNING ] (13, 1, 'bot')
2018-12-26 01:39:25 [WARNING ] (13, 1, 'bot')
2018-12-26 01:39:25 [WARNING ] (13, 1, 'bot')
2018-12-26 01:39:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:39:25 [DEBUG   ] Finished updating board flags in 2.251 seconds
2018-12-26 01:39:27 [DEBUG   ] Got command RPT from MCS: ref #953592
2018-12-26 01:39:27 [DEBUG   ] summary = ERROR
2018-12-26 01:39:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953592  13 58478  5967437 A  ERRORERROR'
2018-12-26 01:39:27 [DEBUG   ] Got command RPT from MCS: ref #953593
2018-12-26 01:39:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 01:39:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953593  77 58478  5967641 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 01:39:27 [DEBUG   ] Got command RPT from MCS: ref #953594
2018-12-26 01:39:27 [DEBUG   ] summary = ERROR
2018-12-26 01:39:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953594  13 58478  5967845 A  ERRORERROR'
2018-12-26 01:39:28 [DEBUG   ] Got command RPT from MCS: ref #953595
2018-12-26 01:39:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 01:39:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953595  77 58478  5968037 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 01:39:28 [DEBUG   ] Got command RPT from MCS: ref #953596
2018-12-26 01:39:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 01:39:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953596  12 58478  5968241 A  ERRORBš™š'
2018-12-26 01:39:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 01:39:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 01:40:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 01:40:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:40:25 [WARNING ] (13, 1, 'bot')
2018-12-26 01:40:25 [WARNING ] (13, 1, 'bot')
2018-12-26 01:40:25 [WARNING ] (13, 1, 'bot')
2018-12-26 01:40:25 [WARNING ] (13, 1, 'bot')
2018-12-26 01:40:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:40:25 [DEBUG   ] Finished updating board flags in 2.220 seconds
2018-12-26 01:40:38 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 01:40:58 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-26 01:40:58 [DEBUG   ] Got command RPT from MCS: ref #953601
2018-12-26 01:40:58 [DEBUG   ] summary = ERROR
2018-12-26 01:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953601  13 58478  6058533 A  ERRORERROR'
2018-12-26 01:40:58 [DEBUG   ] Got command RPT from MCS: ref #953602
2018-12-26 01:40:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 01:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953602  77 58478  6058534 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 01:41:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 01:41:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:41:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 01:41:25 [WARNING ] (13, 1, 'bot')
2018-12-26 01:41:25 [WARNING ] (13, 1, 'bot')
2018-12-26 01:41:25 [WARNING ] (13, 1, 'bot')
2018-12-26 01:41:25 [WARNING ] (13, 1, 'bot')
2018-12-26 01:41:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:41:25 [DEBUG   ] Finished updating board flags in 2.101 seconds
2018-12-26 01:41:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 01:41:58 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 01:42:18 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-26 01:42:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 01:42:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:42:25 [WARNING ] (13, 1, 'bot')
2018-12-26 01:42:25 [WARNING ] (13, 1, 'bot')
2018-12-26 01:42:25 [WARNING ] (13, 1, 'bot')
2018-12-26 01:42:25 [WARNING ] (13, 1, 'bot')
2018-12-26 01:42:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:42:25 [DEBUG   ] Finished updating board flags in 2.038 seconds
2018-12-26 01:42:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 01:42:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 01:43:18 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 01:43:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:43:25 [WARNING ] (13, 1, 'bot')
2018-12-26 01:43:25 [WARNING ] (13, 1, 'bot')
2018-12-26 01:43:25 [WARNING ] (13, 1, 'bot')
2018-12-26 01:43:25 [WARNING ] (13, 1, 'bot')
2018-12-26 01:43:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:43:25 [DEBUG   ] Finished updating board flags in 1.961 seconds
2018-12-26 01:43:38 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-12-26 01:43:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 01:44:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 01:44:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:44:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 01:44:25 [WARNING ] (13, 1, 'bot')
2018-12-26 01:44:25 [WARNING ] (13, 1, 'bot')
2018-12-26 01:44:25 [WARNING ] (13, 1, 'bot')
2018-12-26 01:44:25 [WARNING ] (13, 1, 'bot')
2018-12-26 01:44:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:44:25 [DEBUG   ] Finished updating board flags in 1.807 seconds
2018-12-26 01:44:27 [DEBUG   ] Got command RPT from MCS: ref #953624
2018-12-26 01:44:27 [DEBUG   ] summary = ERROR
2018-12-26 01:44:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953624  13 58478  6267525 A  ERRORERROR'
2018-12-26 01:44:27 [DEBUG   ] Got command RPT from MCS: ref #953625
2018-12-26 01:44:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 01:44:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953625  77 58478  6267717 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 01:44:27 [DEBUG   ] Got command RPT from MCS: ref #953626
2018-12-26 01:44:27 [DEBUG   ] summary = ERROR
2018-12-26 01:44:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953626  13 58478  6267921 A  ERRORERROR'
2018-12-26 01:44:28 [DEBUG   ] Got command RPT from MCS: ref #953628
2018-12-26 01:44:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 01:44:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953628  77 58478  6268125 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 01:44:28 [DEBUG   ] Got command RPT from MCS: ref #953629
2018-12-26 01:44:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 01:44:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953629  12 58478  6268329 A  ERRORB™™š'
2018-12-26 01:44:38 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 01:44:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 01:45:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 01:45:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:45:25 [WARNING ] (13, 1, 'bot')
2018-12-26 01:45:25 [WARNING ] (13, 1, 'bot')
2018-12-26 01:45:25 [WARNING ] (13, 1, 'bot')
2018-12-26 01:45:25 [WARNING ] (13, 1, 'bot')
2018-12-26 01:45:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:45:25 [DEBUG   ] Finished updating board flags in 1.799 seconds
2018-12-26 01:45:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 01:45:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 01:45:58 [DEBUG   ] Got command RPT from MCS: ref #953638
2018-12-26 01:45:58 [DEBUG   ] summary = ERROR
2018-12-26 01:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953638  13 58478  6358533 A  ERRORERROR'
2018-12-26 01:45:58 [DEBUG   ] Got command RPT from MCS: ref #953639
2018-12-26 01:45:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 01:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953639  77 58478  6358534 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 01:46:18 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-26 01:46:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:46:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-26 01:46:25 [WARNING ] (13, 1, 'bot')
2018-12-26 01:46:25 [WARNING ] (13, 1, 'bot')
2018-12-26 01:46:25 [WARNING ] (13, 1, 'bot')
2018-12-26 01:46:25 [WARNING ] (13, 1, 'bot')
2018-12-26 01:46:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:46:25 [DEBUG   ] Finished updating board flags in 1.689 seconds
2018-12-26 01:46:38 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-26 01:46:59 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-26 01:47:19 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-26 01:47:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:47:25 [WARNING ] (13, 1, 'bot')
2018-12-26 01:47:25 [WARNING ] (13, 1, 'bot')
2018-12-26 01:47:25 [WARNING ] (13, 1, 'bot')
2018-12-26 01:47:25 [WARNING ] (13, 1, 'bot')
2018-12-26 01:47:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:47:25 [DEBUG   ] Finished updating board flags in 1.514 seconds
2018-12-26 01:47:39 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-26 01:47:59 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 01:48:19 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-26 01:48:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:48:25 [WARNING ] (13, 1, 'bot')
2018-12-26 01:48:25 [WARNING ] (13, 1, 'bot')
2018-12-26 01:48:25 [WARNING ] (13, 1, 'bot')
2018-12-26 01:48:25 [WARNING ] (13, 1, 'bot')
2018-12-26 01:48:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:48:25 [DEBUG   ] Finished updating board flags in 1.412 seconds
2018-12-26 01:48:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 01:48:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 01:49:19 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 01:49:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:49:25 [WARNING ] (13, 1, 'bot')
2018-12-26 01:49:25 [WARNING ] (13, 1, 'bot')
2018-12-26 01:49:25 [WARNING ] (13, 1, 'bot')
2018-12-26 01:49:25 [WARNING ] (13, 1, 'bot')
2018-12-26 01:49:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:49:25 [DEBUG   ] Finished updating board flags in 1.398 seconds
2018-12-26 01:49:27 [DEBUG   ] Got command RPT from MCS: ref #953659
2018-12-26 01:49:27 [DEBUG   ] summary = ERROR
2018-12-26 01:49:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953659  13 58478  6567597 A  ERRORERROR'
2018-12-26 01:49:27 [DEBUG   ] Got command RPT from MCS: ref #953660
2018-12-26 01:49:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 01:49:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953660  77 58478  6567801 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 01:49:28 [DEBUG   ] Got command RPT from MCS: ref #953661
2018-12-26 01:49:28 [DEBUG   ] summary = ERROR
2018-12-26 01:49:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953661  13 58478  6568005 A  ERRORERROR'
2018-12-26 01:49:28 [DEBUG   ] Got command RPT from MCS: ref #953662
2018-12-26 01:49:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 01:49:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953662  77 58478  6568197 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 01:49:28 [DEBUG   ] Got command RPT from MCS: ref #953663
2018-12-26 01:49:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 01:49:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953663  12 58478  6568401 A  ERRORB˜™š'
2018-12-26 01:49:39 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-26 01:49:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 01:50:19 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 01:50:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:50:26 [WARNING ] (13, 1, 'bot')
2018-12-26 01:50:26 [WARNING ] (13, 1, 'bot')
2018-12-26 01:50:26 [WARNING ] (13, 1, 'bot')
2018-12-26 01:50:26 [WARNING ] (13, 1, 'bot')
2018-12-26 01:50:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:50:26 [DEBUG   ] Finished updating board flags in 2.211 seconds
2018-12-26 01:50:39 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 01:50:58 [DEBUG   ] Got command RPT from MCS: ref #953664
2018-12-26 01:50:58 [DEBUG   ] summary = ERROR
2018-12-26 01:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953664  13 58478  6658541 A  ERRORERROR'
2018-12-26 01:50:58 [DEBUG   ] Got command RPT from MCS: ref #953665
2018-12-26 01:50:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 01:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953665  77 58478  6658542 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 01:50:59 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-26 01:51:20 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2018-12-26 01:51:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:51:26 [WARNING ] (13, 1, 'bot')
2018-12-26 01:51:26 [WARNING ] (13, 1, 'bot')
2018-12-26 01:51:26 [WARNING ] (13, 1, 'bot')
2018-12-26 01:51:26 [WARNING ] (13, 1, 'bot')
2018-12-26 01:51:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:51:26 [DEBUG   ] Finished updating board flags in 2.182 seconds
2018-12-26 01:51:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 01:52:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 01:52:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 01:52:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:52:26 [WARNING ] (13, 1, 'bot')
2018-12-26 01:52:26 [WARNING ] (13, 1, 'bot')
2018-12-26 01:52:26 [WARNING ] (13, 1, 'bot')
2018-12-26 01:52:26 [WARNING ] (13, 1, 'bot')
2018-12-26 01:52:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:52:26 [DEBUG   ] Finished updating board flags in 2.020 seconds
2018-12-26 01:52:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 01:53:00 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 01:53:20 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-26 01:53:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:53:26 [WARNING ] (13, 1, 'bot')
2018-12-26 01:53:26 [WARNING ] (13, 1, 'bot')
2018-12-26 01:53:26 [WARNING ] (13, 1, 'bot')
2018-12-26 01:53:26 [WARNING ] (13, 1, 'bot')
2018-12-26 01:53:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:53:26 [DEBUG   ] Finished updating board flags in 2.094 seconds
2018-12-26 01:53:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 01:54:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 01:54:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 01:54:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:54:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-26 01:54:26 [WARNING ] (13, 1, 'bot')
2018-12-26 01:54:26 [WARNING ] (13, 1, 'bot')
2018-12-26 01:54:26 [WARNING ] (13, 1, 'bot')
2018-12-26 01:54:26 [WARNING ] (13, 1, 'bot')
2018-12-26 01:54:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:54:26 [DEBUG   ] Finished updating board flags in 1.891 seconds
2018-12-26 01:54:27 [DEBUG   ] Got command RPT from MCS: ref #953687
2018-12-26 01:54:27 [DEBUG   ] summary = ERROR
2018-12-26 01:54:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953687  13 58478  6867677 A  ERRORERROR'
2018-12-26 01:54:27 [DEBUG   ] Got command RPT from MCS: ref #953688
2018-12-26 01:54:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 01:54:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953688  77 58478  6867881 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 01:54:28 [DEBUG   ] Got command RPT from MCS: ref #953689
2018-12-26 01:54:28 [DEBUG   ] summary = ERROR
2018-12-26 01:54:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953689  13 58478  6868085 A  ERRORERROR'
2018-12-26 01:54:28 [DEBUG   ] Got command RPT from MCS: ref #953691
2018-12-26 01:54:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 01:54:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953691  77 58478  6868277 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 01:54:28 [DEBUG   ] Got command RPT from MCS: ref #953692
2018-12-26 01:54:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 01:54:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953692  12 58478  6868481 A  ERRORB™™š'
2018-12-26 01:54:40 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-26 01:55:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 01:55:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 01:55:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-26 01:55:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:55:26 [WARNING ] (13, 1, 'bot')
2018-12-26 01:55:26 [WARNING ] (13, 1, 'bot')
2018-12-26 01:55:26 [WARNING ] (13, 1, 'bot')
2018-12-26 01:55:26 [WARNING ] (13, 1, 'bot')
2018-12-26 01:55:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:55:26 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-12-26 01:55:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 01:55:58 [DEBUG   ] Got command RPT from MCS: ref #953701
2018-12-26 01:55:58 [DEBUG   ] summary = ERROR
2018-12-26 01:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953701  13 58478  6958533 A  ERRORERROR'
2018-12-26 01:55:58 [DEBUG   ] Got command RPT from MCS: ref #953702
2018-12-26 01:55:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 01:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953702  77 58478  6958534 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 01:56:00 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-26 01:56:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 01:56:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:56:26 [WARNING ] (13, 1, 'bot')
2018-12-26 01:56:26 [WARNING ] (13, 1, 'bot')
2018-12-26 01:56:26 [WARNING ] (13, 1, 'bot')
2018-12-26 01:56:26 [WARNING ] (13, 1, 'bot')
2018-12-26 01:56:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:56:26 [DEBUG   ] Finished updating board flags in 1.781 seconds
2018-12-26 01:56:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 01:57:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 01:57:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 01:57:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:57:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 01:57:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-26 01:57:26 [WARNING ] (13, 1, 'bot')
2018-12-26 01:57:26 [WARNING ] (13, 1, 'bot')
2018-12-26 01:57:26 [WARNING ] (13, 1, 'bot')
2018-12-26 01:57:26 [WARNING ] (13, 1, 'bot')
2018-12-26 01:57:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:57:26 [DEBUG   ] Finished updating board flags in 1.637 seconds
2018-12-26 01:57:40 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-26 01:58:00 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 01:58:20 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-26 01:58:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:58:26 [WARNING ] (13, 1, 'bot')
2018-12-26 01:58:26 [WARNING ] (13, 1, 'bot')
2018-12-26 01:58:26 [WARNING ] (13, 1, 'bot')
2018-12-26 01:58:26 [WARNING ] (13, 1, 'bot')
2018-12-26 01:58:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:58:26 [DEBUG   ] Finished updating board flags in 1.569 seconds
2018-12-26 01:58:41 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-12-26 01:59:01 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-26 01:59:21 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-26 01:59:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 01:59:26 [WARNING ] (13, 1, 'bot')
2018-12-26 01:59:26 [WARNING ] (13, 1, 'bot')
2018-12-26 01:59:26 [WARNING ] (13, 1, 'bot')
2018-12-26 01:59:26 [WARNING ] (13, 1, 'bot')
2018-12-26 01:59:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 01:59:26 [DEBUG   ] Finished updating board flags in 1.429 seconds
2018-12-26 01:59:27 [DEBUG   ] Got command RPT from MCS: ref #953722
2018-12-26 01:59:27 [DEBUG   ] summary = ERROR
2018-12-26 01:59:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953722  13 58478  7167761 A  ERRORERROR'
2018-12-26 01:59:27 [DEBUG   ] Got command RPT from MCS: ref #953723
2018-12-26 01:59:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 01:59:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953723  77 58478  7167965 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 01:59:28 [DEBUG   ] Got command RPT from MCS: ref #953724
2018-12-26 01:59:28 [DEBUG   ] summary = ERROR
2018-12-26 01:59:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953724  13 58478  7168169 A  ERRORERROR'
2018-12-26 01:59:28 [DEBUG   ] Got command RPT from MCS: ref #953725
2018-12-26 01:59:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 01:59:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953725  77 58478  7168361 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 01:59:28 [DEBUG   ] Got command RPT from MCS: ref #953726
2018-12-26 01:59:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 01:59:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953726  12 58478  7168565 A  ERRORB™™š'
2018-12-26 01:59:41 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-26 02:00:01 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 02:00:21 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2018-12-26 02:00:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 02:00:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:00:26 [WARNING ] (13, 1, 'bot')
2018-12-26 02:00:26 [WARNING ] (13, 1, 'bot')
2018-12-26 02:00:26 [WARNING ] (13, 1, 'bot')
2018-12-26 02:00:26 [WARNING ] (13, 1, 'bot')
2018-12-26 02:00:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:00:26 [DEBUG   ] Finished updating board flags in 1.429 seconds
2018-12-26 02:00:41 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-12-26 02:00:58 [DEBUG   ] Got command RPT from MCS: ref #953731
2018-12-26 02:00:58 [DEBUG   ] summary = ERROR
2018-12-26 02:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953731  13 58478  7258541 A  ERRORERROR'
2018-12-26 02:00:58 [DEBUG   ] Got command RPT from MCS: ref #953732
2018-12-26 02:00:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 02:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953732  77 58478  7258542 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 02:01:01 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-26 02:01:21 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-26 02:01:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:01:26 [WARNING ] (13, 1, 'bot')
2018-12-26 02:01:26 [WARNING ] (13, 1, 'bot')
2018-12-26 02:01:26 [WARNING ] (13, 1, 'bot')
2018-12-26 02:01:26 [WARNING ] (13, 1, 'bot')
2018-12-26 02:01:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:01:26 [DEBUG   ] Finished updating board flags in 1.428 seconds
2018-12-26 02:01:42 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-12-26 02:02:01 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-12-26 02:02:21 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-12-26 02:02:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:02:26 [WARNING ] (13, 1, 'bot')
2018-12-26 02:02:26 [WARNING ] (13, 1, 'bot')
2018-12-26 02:02:26 [WARNING ] (13, 1, 'bot')
2018-12-26 02:02:26 [WARNING ] (13, 1, 'bot')
2018-12-26 02:02:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:02:26 [DEBUG   ] Finished updating board flags in 1.427 seconds
2018-12-26 02:02:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 02:03:02 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 02:03:22 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-26 02:03:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:03:26 [WARNING ] (13, 1, 'bot')
2018-12-26 02:03:26 [WARNING ] (13, 1, 'bot')
2018-12-26 02:03:26 [WARNING ] (13, 1, 'bot')
2018-12-26 02:03:26 [WARNING ] (13, 1, 'bot')
2018-12-26 02:03:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:03:26 [DEBUG   ] Finished updating board flags in 1.430 seconds
2018-12-26 02:03:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 02:04:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 02:04:22 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 02:04:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:04:26 [WARNING ] (13, 1, 'bot')
2018-12-26 02:04:26 [WARNING ] (13, 1, 'bot')
2018-12-26 02:04:26 [WARNING ] (13, 1, 'bot')
2018-12-26 02:04:26 [WARNING ] (13, 1, 'bot')
2018-12-26 02:04:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:04:26 [DEBUG   ] Finished updating board flags in 1.431 seconds
2018-12-26 02:04:27 [DEBUG   ] Got command RPT from MCS: ref #953754
2018-12-26 02:04:27 [DEBUG   ] summary = ERROR
2018-12-26 02:04:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953754  13 58478  7467845 A  ERRORERROR'
2018-12-26 02:04:28 [DEBUG   ] Got command RPT from MCS: ref #953755
2018-12-26 02:04:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 02:04:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953755  77 58478  7468049 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 02:04:28 [DEBUG   ] Got command RPT from MCS: ref #953756
2018-12-26 02:04:28 [DEBUG   ] summary = ERROR
2018-12-26 02:04:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953756  13 58478  7468241 A  ERRORERROR'
2018-12-26 02:04:28 [DEBUG   ] Got command RPT from MCS: ref #953758
2018-12-26 02:04:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 02:04:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953758  77 58478  7468445 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 02:04:28 [DEBUG   ] Got command RPT from MCS: ref #953760
2018-12-26 02:04:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 02:04:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953760  12 58478  7468649 A  ERRORB˜™š'
2018-12-26 02:04:42 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-26 02:05:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 02:05:22 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 02:05:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:05:26 [WARNING ] (13, 1, 'bot')
2018-12-26 02:05:26 [WARNING ] (13, 1, 'bot')
2018-12-26 02:05:26 [WARNING ] (13, 1, 'bot')
2018-12-26 02:05:26 [WARNING ] (13, 1, 'bot')
2018-12-26 02:05:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:05:26 [DEBUG   ] Finished updating board flags in 1.433 seconds
2018-12-26 02:05:42 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 02:05:58 [DEBUG   ] Got command RPT from MCS: ref #953764
2018-12-26 02:05:58 [DEBUG   ] summary = ERROR
2018-12-26 02:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953764  13 58478  7558541 A  ERRORERROR'
2018-12-26 02:05:58 [DEBUG   ] Got command RPT from MCS: ref #953765
2018-12-26 02:05:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 02:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953765  77 58478  7558542 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 02:06:02 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-26 02:06:22 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 02:06:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:06:26 [WARNING ] (13, 1, 'bot')
2018-12-26 02:06:26 [WARNING ] (13, 1, 'bot')
2018-12-26 02:06:26 [WARNING ] (13, 1, 'bot')
2018-12-26 02:06:26 [WARNING ] (13, 1, 'bot')
2018-12-26 02:06:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:06:26 [DEBUG   ] Finished updating board flags in 1.430 seconds
2018-12-26 02:06:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 02:07:02 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 02:07:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 02:07:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-26 02:07:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:07:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:07:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:07:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:07:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:07:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:07:27 [DEBUG   ] Finished updating board flags in 2.194 seconds
2018-12-26 02:07:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 02:08:02 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 02:08:22 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-26 02:08:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:08:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:08:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:08:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:08:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:08:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:08:27 [DEBUG   ] Finished updating board flags in 1.988 seconds
2018-12-26 02:08:42 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-12-26 02:09:03 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-26 02:09:23 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-26 02:09:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:09:27 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 02:09:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:09:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:09:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:09:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:09:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:09:27 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-12-26 02:09:27 [DEBUG   ] Got command RPT from MCS: ref #953785
2018-12-26 02:09:27 [DEBUG   ] summary = ERROR
2018-12-26 02:09:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953785  13 58478  7767921 A  ERRORERROR'
2018-12-26 02:09:28 [DEBUG   ] Got command RPT from MCS: ref #953786
2018-12-26 02:09:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 02:09:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953786  77 58478  7768125 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 02:09:28 [DEBUG   ] Got command RPT from MCS: ref #953787
2018-12-26 02:09:28 [DEBUG   ] summary = ERROR
2018-12-26 02:09:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953787  13 58478  7768329 A  ERRORERROR'
2018-12-26 02:09:28 [DEBUG   ] Got command RPT from MCS: ref #953788
2018-12-26 02:09:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 02:09:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953788  77 58478  7768521 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 02:09:28 [DEBUG   ] Got command RPT from MCS: ref #953789
2018-12-26 02:09:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 02:09:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953789  12 58478  7768725 A  ERRORBš™š'
2018-12-26 02:09:43 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-26 02:10:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 02:10:23 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 02:10:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:10:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:10:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:10:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:10:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:10:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:10:27 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-12-26 02:10:43 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-26 02:10:58 [DEBUG   ] Got command RPT from MCS: ref #953794
2018-12-26 02:10:58 [DEBUG   ] summary = ERROR
2018-12-26 02:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953794  13 58478  7858537 A  ERRORERROR'
2018-12-26 02:10:58 [DEBUG   ] Got command RPT from MCS: ref #953795
2018-12-26 02:10:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 02:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953795  77 58478  7858538 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 02:11:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 02:11:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 02:11:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:11:27 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 02:11:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:11:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:11:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:11:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:11:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:11:27 [DEBUG   ] Finished updating board flags in 1.788 seconds
2018-12-26 02:11:43 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 02:12:03 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-26 02:12:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 02:12:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:12:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 02:12:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:12:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:12:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:12:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:12:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:12:27 [DEBUG   ] Finished updating board flags in 1.600 seconds
2018-12-26 02:12:43 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 02:13:03 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 02:13:23 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-26 02:13:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:13:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:13:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:13:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:13:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:13:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:13:27 [DEBUG   ] Finished updating board flags in 1.622 seconds
2018-12-26 02:13:43 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-26 02:14:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 02:14:23 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 02:14:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:14:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-12-26 02:14:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:14:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:14:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:14:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:14:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:14:27 [DEBUG   ] Finished updating board flags in 1.577 seconds
2018-12-26 02:14:28 [DEBUG   ] Got command RPT from MCS: ref #953817
2018-12-26 02:14:28 [DEBUG   ] summary = ERROR
2018-12-26 02:14:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953817  13 58478  8068005 A  ERRORERROR'
2018-12-26 02:14:28 [DEBUG   ] Got command RPT from MCS: ref #953818
2018-12-26 02:14:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 02:14:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953818  77 58478  8068209 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 02:14:28 [DEBUG   ] Got command RPT from MCS: ref #953819
2018-12-26 02:14:28 [DEBUG   ] summary = ERROR
2018-12-26 02:14:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953819  13 58478  8068401 A  ERRORERROR'
2018-12-26 02:14:28 [DEBUG   ] Got command RPT from MCS: ref #953821
2018-12-26 02:14:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 02:14:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953821  77 58478  8068605 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 02:14:28 [DEBUG   ] Got command RPT from MCS: ref #953822
2018-12-26 02:14:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 02:14:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953822  12 58478  8068809 A  ERRORB™™š'
2018-12-26 02:14:43 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-26 02:15:04 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-26 02:15:24 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-26 02:15:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:15:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:15:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:15:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:15:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:15:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:15:27 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-12-26 02:15:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 02:15:58 [DEBUG   ] Got command RPT from MCS: ref #953831
2018-12-26 02:15:58 [DEBUG   ] summary = ERROR
2018-12-26 02:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953831  13 58478  8158541 A  ERRORERROR'
2018-12-26 02:15:58 [DEBUG   ] Got command RPT from MCS: ref #953832
2018-12-26 02:15:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 02:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953832  77 58478  8158542 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 02:16:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 02:16:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 02:16:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:16:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:16:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:16:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:16:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:16:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:16:27 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-12-26 02:16:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 02:17:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 02:17:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 02:17:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:17:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:17:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:17:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:17:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:17:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:17:27 [DEBUG   ] Finished updating board flags in 1.466 seconds
2018-12-26 02:17:44 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-26 02:18:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-26 02:18:24 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-26 02:18:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:18:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:18:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:18:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:18:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:18:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:18:27 [DEBUG   ] Finished updating board flags in 1.507 seconds
2018-12-26 02:18:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 02:19:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 02:19:24 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 02:19:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 02:19:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:19:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:19:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:19:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:19:27 [WARNING ] (13, 1, 'bot')
2018-12-26 02:19:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:19:27 [DEBUG   ] Finished updating board flags in 1.512 seconds
2018-12-26 02:19:28 [DEBUG   ] Got command RPT from MCS: ref #953852
2018-12-26 02:19:28 [DEBUG   ] summary = ERROR
2018-12-26 02:19:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953852  13 58478  8368089 A  ERRORERROR'
2018-12-26 02:19:28 [DEBUG   ] Got command RPT from MCS: ref #953853
2018-12-26 02:19:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 02:19:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953853  77 58478  8368281 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 02:19:28 [DEBUG   ] Got command RPT from MCS: ref #953854
2018-12-26 02:19:28 [DEBUG   ] summary = ERROR
2018-12-26 02:19:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953854  13 58478  8368485 A  ERRORERROR'
2018-12-26 02:19:28 [DEBUG   ] Got command RPT from MCS: ref #953855
2018-12-26 02:19:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 02:19:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953855  77 58478  8368689 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 02:19:28 [DEBUG   ] Got command RPT from MCS: ref #953856
2018-12-26 02:19:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 02:19:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953856  12 58478  8368894 A  ERRORB˜™š'
2018-12-26 02:19:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 02:20:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 02:20:24 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 02:20:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-12-26 02:20:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:20:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 02:20:28 [WARNING ] (13, 1, 'bot')
2018-12-26 02:20:28 [WARNING ] (13, 1, 'bot')
2018-12-26 02:20:28 [WARNING ] (13, 1, 'bot')
2018-12-26 02:20:28 [WARNING ] (13, 1, 'bot')
2018-12-26 02:20:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:20:28 [DEBUG   ] Finished updating board flags in 2.216 seconds
2018-12-26 02:20:44 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-26 02:20:58 [DEBUG   ] Got command RPT from MCS: ref #953857
2018-12-26 02:20:58 [DEBUG   ] summary = ERROR
2018-12-26 02:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953857  13 58478  8458545 A  ERRORERROR'
2018-12-26 02:20:58 [DEBUG   ] Got command RPT from MCS: ref #953858
2018-12-26 02:20:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 02:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953858  77 58478  8458546 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 02:21:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 02:21:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 02:21:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:21:28 [WARNING ] (13, 1, 'bot')
2018-12-26 02:21:28 [WARNING ] (13, 1, 'bot')
2018-12-26 02:21:28 [WARNING ] (13, 1, 'bot')
2018-12-26 02:21:28 [WARNING ] (13, 1, 'bot')
2018-12-26 02:21:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:21:28 [DEBUG   ] Finished updating board flags in 2.092 seconds
2018-12-26 02:21:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 02:22:04 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 02:22:24 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-26 02:22:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:22:28 [WARNING ] (13, 1, 'bot')
2018-12-26 02:22:28 [WARNING ] (13, 1, 'bot')
2018-12-26 02:22:28 [WARNING ] (13, 1, 'bot')
2018-12-26 02:22:28 [WARNING ] (13, 1, 'bot')
2018-12-26 02:22:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:22:28 [DEBUG   ] Finished updating board flags in 2.007 seconds
2018-12-26 02:22:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 02:23:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 02:23:24 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 02:23:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:23:28 [WARNING ] (13, 1, 'bot')
2018-12-26 02:23:28 [WARNING ] (13, 1, 'bot')
2018-12-26 02:23:28 [WARNING ] (13, 1, 'bot')
2018-12-26 02:23:28 [WARNING ] (13, 1, 'bot')
2018-12-26 02:23:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:23:28 [DEBUG   ] Finished updating board flags in 2.015 seconds
2018-12-26 02:23:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 02:24:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 02:24:24 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 02:24:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:24:28 [DEBUG   ] Got command RPT from MCS: ref #953880
2018-12-26 02:24:28 [DEBUG   ] summary = ERROR
2018-12-26 02:24:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953880  13 58478  8668166 A  ERRORERROR'
2018-12-26 02:24:28 [DEBUG   ] Got command RPT from MCS: ref #953881
2018-12-26 02:24:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 02:24:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953881  77 58478  8668361 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 02:24:28 [DEBUG   ] Got command RPT from MCS: ref #953882
2018-12-26 02:24:28 [DEBUG   ] summary = ERROR
2018-12-26 02:24:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953882  13 58478  8668565 A  ERRORERROR'
2018-12-26 02:24:28 [WARNING ] (13, 1, 'bot')
2018-12-26 02:24:28 [WARNING ] (13, 1, 'bot')
2018-12-26 02:24:28 [WARNING ] (13, 1, 'bot')
2018-12-26 02:24:28 [WARNING ] (13, 1, 'bot')
2018-12-26 02:24:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:24:28 [DEBUG   ] Finished updating board flags in 1.997 seconds
2018-12-26 02:24:28 [DEBUG   ] Got command RPT from MCS: ref #953884
2018-12-26 02:24:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 02:24:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953884  77 58478  8668769 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 02:24:28 [DEBUG   ] Got command RPT from MCS: ref #953885
2018-12-26 02:24:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 02:24:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953885  12 58478  8668973 A  ERRORB™™š'
2018-12-26 02:24:44 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-26 02:25:05 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-26 02:25:25 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-26 02:25:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:25:28 [WARNING ] (13, 1, 'bot')
2018-12-26 02:25:28 [WARNING ] (13, 1, 'bot')
2018-12-26 02:25:28 [WARNING ] (13, 1, 'bot')
2018-12-26 02:25:28 [WARNING ] (13, 1, 'bot')
2018-12-26 02:25:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:25:28 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-12-26 02:25:45 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 02:25:58 [DEBUG   ] Got command RPT from MCS: ref #953894
2018-12-26 02:25:58 [DEBUG   ] summary = ERROR
2018-12-26 02:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953894  13 58478  8758537 A  ERRORERROR'
2018-12-26 02:25:58 [DEBUG   ] Got command RPT from MCS: ref #953895
2018-12-26 02:25:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 02:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953895  77 58478  8758538 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 02:26:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 02:26:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 02:26:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:26:28 [WARNING ] (13, 1, 'bot')
2018-12-26 02:26:28 [WARNING ] (13, 1, 'bot')
2018-12-26 02:26:28 [WARNING ] (13, 1, 'bot')
2018-12-26 02:26:28 [WARNING ] (13, 1, 'bot')
2018-12-26 02:26:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:26:28 [DEBUG   ] Finished updating board flags in 1.774 seconds
2018-12-26 02:26:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 02:27:05 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-26 02:27:25 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-26 02:27:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:27:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-26 02:27:28 [WARNING ] (13, 1, 'bot')
2018-12-26 02:27:28 [WARNING ] (13, 1, 'bot')
2018-12-26 02:27:28 [WARNING ] (13, 1, 'bot')
2018-12-26 02:27:28 [WARNING ] (13, 1, 'bot')
2018-12-26 02:27:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:27:28 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-12-26 02:27:45 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-26 02:28:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 02:28:25 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 02:28:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:28:28 [WARNING ] (13, 1, 'bot')
2018-12-26 02:28:28 [WARNING ] (13, 1, 'bot')
2018-12-26 02:28:28 [WARNING ] (13, 1, 'bot')
2018-12-26 02:28:28 [WARNING ] (13, 1, 'bot')
2018-12-26 02:28:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:28:28 [DEBUG   ] Finished updating board flags in 1.578 seconds
2018-12-26 02:28:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 02:29:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 02:29:25 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 02:29:27 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 02:29:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:29:28 [DEBUG   ] Got command RPT from MCS: ref #953915
2018-12-26 02:29:28 [DEBUG   ] summary = ERROR
2018-12-26 02:29:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953915  13 58478  8968245 A  ERRORERROR'
2018-12-26 02:29:28 [DEBUG   ] Got command RPT from MCS: ref #953916
2018-12-26 02:29:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 02:29:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953916  77 58478  8968453 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 02:29:28 [DEBUG   ] Got command RPT from MCS: ref #953917
2018-12-26 02:29:28 [DEBUG   ] summary = ERROR
2018-12-26 02:29:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953917  13 58478  8968653 A  ERRORERROR'
2018-12-26 02:29:28 [WARNING ] (13, 1, 'bot')
2018-12-26 02:29:28 [WARNING ] (13, 1, 'bot')
2018-12-26 02:29:28 [WARNING ] (13, 1, 'bot')
2018-12-26 02:29:28 [WARNING ] (13, 1, 'bot')
2018-12-26 02:29:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:29:28 [DEBUG   ] Finished updating board flags in 1.519 seconds
2018-12-26 02:29:28 [DEBUG   ] Got command RPT from MCS: ref #953918
2018-12-26 02:29:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 02:29:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953918  77 58478  8968845 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 02:29:29 [DEBUG   ] Got command RPT from MCS: ref #953919
2018-12-26 02:29:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 02:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953919  12 58478  8969049 A  ERRORB™™š'
2018-12-26 02:29:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-26 02:30:05 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-26 02:30:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 02:30:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:30:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-26 02:30:28 [WARNING ] (13, 1, 'bot')
2018-12-26 02:30:28 [WARNING ] (13, 1, 'bot')
2018-12-26 02:30:28 [WARNING ] (13, 1, 'bot')
2018-12-26 02:30:28 [WARNING ] (13, 1, 'bot')
2018-12-26 02:30:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:30:28 [DEBUG   ] Finished updating board flags in 1.513 seconds
2018-12-26 02:30:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 02:30:58 [DEBUG   ] Got command RPT from MCS: ref #953924
2018-12-26 02:30:58 [DEBUG   ] summary = ERROR
2018-12-26 02:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953924  13 58478  9058541 A  ERRORERROR'
2018-12-26 02:30:58 [DEBUG   ] Got command RPT from MCS: ref #953925
2018-12-26 02:30:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 02:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953925  77 58478  9058542 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 02:31:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 02:31:25 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-26 02:31:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:31:29 [WARNING ] (13, 1, 'bot')
2018-12-26 02:31:29 [WARNING ] (13, 1, 'bot')
2018-12-26 02:31:29 [WARNING ] (13, 1, 'bot')
2018-12-26 02:31:29 [WARNING ] (13, 1, 'bot')
2018-12-26 02:31:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:31:29 [DEBUG   ] Finished updating board flags in 2.282 seconds
2018-12-26 02:31:46 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-12-26 02:32:06 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-26 02:32:26 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-26 02:32:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:32:29 [WARNING ] (13, 1, 'bot')
2018-12-26 02:32:29 [WARNING ] (13, 1, 'bot')
2018-12-26 02:32:29 [WARNING ] (13, 1, 'bot')
2018-12-26 02:32:29 [WARNING ] (13, 1, 'bot')
2018-12-26 02:32:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:32:29 [DEBUG   ] Finished updating board flags in 2.092 seconds
2018-12-26 02:32:46 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-26 02:33:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 02:33:26 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 02:33:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:33:29 [WARNING ] (13, 1, 'bot')
2018-12-26 02:33:29 [WARNING ] (13, 1, 'bot')
2018-12-26 02:33:29 [WARNING ] (13, 1, 'bot')
2018-12-26 02:33:29 [WARNING ] (13, 1, 'bot')
2018-12-26 02:33:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:33:29 [DEBUG   ] Finished updating board flags in 2.022 seconds
2018-12-26 02:33:46 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-26 02:34:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 02:34:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 02:34:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 02:34:28 [DEBUG   ] Got command RPT from MCS: ref #953947
2018-12-26 02:34:28 [DEBUG   ] summary = ERROR
2018-12-26 02:34:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953947  13 58478  9268333 A  ERRORERROR'
2018-12-26 02:34:28 [DEBUG   ] Got command RPT from MCS: ref #953948
2018-12-26 02:34:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 02:34:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953948  77 58478  9268525 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 02:34:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:34:28 [DEBUG   ] Got command RPT from MCS: ref #953949
2018-12-26 02:34:28 [DEBUG   ] summary = ERROR
2018-12-26 02:34:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953949  13 58478  9268729 A  ERRORERROR'
2018-12-26 02:34:28 [DEBUG   ] Got command RPT from MCS: ref #953951
2018-12-26 02:34:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 02:34:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953951  77 58478  9268933 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 02:34:29 [DEBUG   ] Got command RPT from MCS: ref #953952
2018-12-26 02:34:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 02:34:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953952  12 58478  9269130 A  ERRORB’™š'
2018-12-26 02:34:29 [WARNING ] (13, 1, 'bot')
2018-12-26 02:34:29 [WARNING ] (13, 1, 'bot')
2018-12-26 02:34:29 [WARNING ] (13, 1, 'bot')
2018-12-26 02:34:29 [WARNING ] (13, 1, 'bot')
2018-12-26 02:34:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:34:29 [DEBUG   ] Finished updating board flags in 1.987 seconds
2018-12-26 02:34:46 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 02:35:06 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-26 02:35:26 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-26 02:35:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:35:29 [WARNING ] (13, 1, 'bot')
2018-12-26 02:35:29 [WARNING ] (13, 1, 'bot')
2018-12-26 02:35:29 [WARNING ] (13, 1, 'bot')
2018-12-26 02:35:29 [WARNING ] (13, 1, 'bot')
2018-12-26 02:35:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:35:29 [DEBUG   ] Finished updating board flags in 1.815 seconds
2018-12-26 02:35:47 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-26 02:35:58 [DEBUG   ] Got command RPT from MCS: ref #953957
2018-12-26 02:35:58 [DEBUG   ] summary = ERROR
2018-12-26 02:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953957  13 58478  9358549 A  ERRORERROR'
2018-12-26 02:35:58 [DEBUG   ] Got command RPT from MCS: ref #953958
2018-12-26 02:35:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 02:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953958  77 58478  9358550 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 02:36:07 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-26 02:36:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 02:36:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:36:29 [WARNING ] (13, 1, 'bot')
2018-12-26 02:36:29 [WARNING ] (13, 1, 'bot')
2018-12-26 02:36:29 [WARNING ] (13, 1, 'bot')
2018-12-26 02:36:29 [WARNING ] (13, 1, 'bot')
2018-12-26 02:36:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:36:29 [DEBUG   ] Finished updating board flags in 1.791 seconds
2018-12-26 02:36:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 02:37:07 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-26 02:37:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 02:37:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:37:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-12-26 02:37:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 02:37:29 [WARNING ] (13, 1, 'bot')
2018-12-26 02:37:29 [WARNING ] (13, 1, 'bot')
2018-12-26 02:37:29 [WARNING ] (13, 1, 'bot')
2018-12-26 02:37:29 [WARNING ] (13, 1, 'bot')
2018-12-26 02:37:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:37:29 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-12-26 02:37:47 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 02:38:07 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-26 02:38:27 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-26 02:38:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:38:29 [WARNING ] (13, 1, 'bot')
2018-12-26 02:38:29 [WARNING ] (13, 1, 'bot')
2018-12-26 02:38:29 [WARNING ] (13, 1, 'bot')
2018-12-26 02:38:29 [WARNING ] (13, 1, 'bot')
2018-12-26 02:38:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:38:29 [DEBUG   ] Finished updating board flags in 1.605 seconds
2018-12-26 02:38:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 02:39:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 02:39:27 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 02:39:28 [DEBUG   ] Got command RPT from MCS: ref #953978
2018-12-26 02:39:28 [DEBUG   ] summary = ERROR
2018-12-26 02:39:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953978  13 58478  9568409 A  ERRORERROR'
2018-12-26 02:39:28 [DEBUG   ] Got command RPT from MCS: ref #953979
2018-12-26 02:39:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 02:39:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953979  77 58478  9568601 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 02:39:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:39:28 [DEBUG   ] Got command RPT from MCS: ref #953980
2018-12-26 02:39:28 [DEBUG   ] summary = ERROR
2018-12-26 02:39:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953980  13 58478  9568805 A  ERRORERROR'
2018-12-26 02:39:29 [DEBUG   ] Got command RPT from MCS: ref #953981
2018-12-26 02:39:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 02:39:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953981  77 58478  9569009 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 02:39:29 [DEBUG   ] Got command RPT from MCS: ref #953982
2018-12-26 02:39:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 02:39:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953982  12 58478  9569218 A  ERRORB“™š'
2018-12-26 02:39:29 [WARNING ] (13, 1, 'bot')
2018-12-26 02:39:29 [WARNING ] (13, 1, 'bot')
2018-12-26 02:39:29 [WARNING ] (13, 1, 'bot')
2018-12-26 02:39:29 [WARNING ] (13, 1, 'bot')
2018-12-26 02:39:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:39:29 [DEBUG   ] Finished updating board flags in 1.591 seconds
2018-12-26 02:39:47 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-26 02:40:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 02:40:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 02:40:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-12-26 02:40:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:40:29 [WARNING ] (13, 1, 'bot')
2018-12-26 02:40:29 [WARNING ] (13, 1, 'bot')
2018-12-26 02:40:29 [WARNING ] (13, 1, 'bot')
2018-12-26 02:40:29 [WARNING ] (13, 1, 'bot')
2018-12-26 02:40:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:40:29 [DEBUG   ] Finished updating board flags in 1.407 seconds
2018-12-26 02:40:47 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 02:40:58 [DEBUG   ] Got command RPT from MCS: ref #953987
2018-12-26 02:40:58 [DEBUG   ] summary = ERROR
2018-12-26 02:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953987  13 58478  9658541 A  ERRORERROR'
2018-12-26 02:40:58 [DEBUG   ] Got command RPT from MCS: ref #953988
2018-12-26 02:40:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 02:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   953988  77 58478  9658542 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 02:41:07 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-26 02:41:27 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 02:41:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:41:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-26 02:41:29 [WARNING ] (13, 1, 'bot')
2018-12-26 02:41:29 [WARNING ] (13, 1, 'bot')
2018-12-26 02:41:29 [WARNING ] (13, 1, 'bot')
2018-12-26 02:41:29 [WARNING ] (13, 1, 'bot')
2018-12-26 02:41:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:41:29 [DEBUG   ] Finished updating board flags in 1.399 seconds
2018-12-26 02:41:47 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 02:42:08 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-12-26 02:42:28 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-26 02:42:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:42:29 [WARNING ] (13, 1, 'bot')
2018-12-26 02:42:29 [WARNING ] (13, 1, 'bot')
2018-12-26 02:42:29 [WARNING ] (13, 1, 'bot')
2018-12-26 02:42:29 [WARNING ] (13, 1, 'bot')
2018-12-26 02:42:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:42:29 [DEBUG   ] Finished updating board flags in 1.346 seconds
2018-12-26 02:42:48 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 02:43:08 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-26 02:43:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 02:43:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 02:43:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:43:30 [WARNING ] (13, 1, 'bot')
2018-12-26 02:43:30 [WARNING ] (13, 1, 'bot')
2018-12-26 02:43:30 [WARNING ] (13, 1, 'bot')
2018-12-26 02:43:30 [WARNING ] (13, 1, 'bot')
2018-12-26 02:43:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:43:30 [DEBUG   ] Finished updating board flags in 2.065 seconds
2018-12-26 02:43:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 02:44:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 02:44:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 02:44:28 [DEBUG   ] Got command RPT from MCS: ref #954010
2018-12-26 02:44:28 [DEBUG   ] summary = ERROR
2018-12-26 02:44:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954010  13 58478  9868489 A  ERRORERROR'
2018-12-26 02:44:28 [DEBUG   ] Got command RPT from MCS: ref #954011
2018-12-26 02:44:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 02:44:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954011  77 58478  9868681 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 02:44:28 [DEBUG   ] Got command RPT from MCS: ref #954012
2018-12-26 02:44:28 [DEBUG   ] summary = ERROR
2018-12-26 02:44:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954012  13 58478  9868885 A  ERRORERROR'
2018-12-26 02:44:29 [DEBUG   ] Got command RPT from MCS: ref #954013
2018-12-26 02:44:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 02:44:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954013  77 58478  9869089 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 02:44:29 [DEBUG   ] Got command RPT from MCS: ref #954015
2018-12-26 02:44:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 02:44:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954015  12 58478  9869297 A  ERRORB„ÌÍ'
2018-12-26 02:44:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:44:30 [WARNING ] (13, 1, 'bot')
2018-12-26 02:44:30 [WARNING ] (13, 1, 'bot')
2018-12-26 02:44:30 [WARNING ] (13, 1, 'bot')
2018-12-26 02:44:30 [WARNING ] (13, 1, 'bot')
2018-12-26 02:44:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:44:30 [DEBUG   ] Finished updating board flags in 2.016 seconds
2018-12-26 02:44:48 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-26 02:45:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 02:45:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 02:45:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:45:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 02:45:30 [WARNING ] (13, 1, 'bot')
2018-12-26 02:45:30 [WARNING ] (13, 1, 'bot')
2018-12-26 02:45:30 [WARNING ] (13, 1, 'bot')
2018-12-26 02:45:30 [WARNING ] (13, 1, 'bot')
2018-12-26 02:45:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:45:30 [DEBUG   ] Finished updating board flags in 1.981 seconds
2018-12-26 02:45:48 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 02:45:58 [DEBUG   ] Got command RPT from MCS: ref #954024
2018-12-26 02:45:58 [DEBUG   ] summary = ERROR
2018-12-26 02:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954024  13 58478  9958545 A  ERRORERROR'
2018-12-26 02:45:58 [DEBUG   ] Got command RPT from MCS: ref #954025
2018-12-26 02:45:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 02:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954025  77 58478  9958546 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 02:46:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 02:46:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 02:46:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:46:30 [WARNING ] (13, 1, 'bot')
2018-12-26 02:46:30 [WARNING ] (13, 1, 'bot')
2018-12-26 02:46:30 [WARNING ] (13, 1, 'bot')
2018-12-26 02:46:30 [WARNING ] (13, 1, 'bot')
2018-12-26 02:46:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:46:30 [DEBUG   ] Finished updating board flags in 1.811 seconds
2018-12-26 02:46:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 02:47:08 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-12-26 02:47:28 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-26 02:47:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:47:30 [WARNING ] (13, 1, 'bot')
2018-12-26 02:47:30 [WARNING ] (13, 1, 'bot')
2018-12-26 02:47:30 [WARNING ] (13, 1, 'bot')
2018-12-26 02:47:30 [WARNING ] (13, 1, 'bot')
2018-12-26 02:47:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:47:30 [DEBUG   ] Finished updating board flags in 1.872 seconds
2018-12-26 02:47:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 02:48:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 02:48:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 02:48:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:48:30 [WARNING ] (13, 1, 'bot')
2018-12-26 02:48:30 [WARNING ] (13, 1, 'bot')
2018-12-26 02:48:30 [WARNING ] (13, 1, 'bot')
2018-12-26 02:48:30 [WARNING ] (13, 1, 'bot')
2018-12-26 02:48:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:48:30 [DEBUG   ] Finished updating board flags in 1.806 seconds
2018-12-26 02:48:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 02:49:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 02:49:28 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 02:49:28 [DEBUG   ] Got command RPT from MCS: ref #954045
2018-12-26 02:49:28 [DEBUG   ] summary = ERROR
2018-12-26 02:49:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954045  13 58478 10168569 A  ERRORERROR'
2018-12-26 02:49:28 [DEBUG   ] Got command RPT from MCS: ref #954046
2018-12-26 02:49:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 02:49:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954046  77 58478 10168773 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 02:49:28 [DEBUG   ] Got command RPT from MCS: ref #954047
2018-12-26 02:49:28 [DEBUG   ] summary = ERROR
2018-12-26 02:49:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954047  13 58478 10168965 A  ERRORERROR'
2018-12-26 02:49:29 [DEBUG   ] Got command RPT from MCS: ref #954048
2018-12-26 02:49:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 02:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954048  77 58478 10169169 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 02:49:29 [DEBUG   ] Got command RPT from MCS: ref #954049
2018-12-26 02:49:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 02:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954049  12 58478 10169373 A  ERRORB„ÌÍ'
2018-12-26 02:49:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:49:30 [WARNING ] (13, 1, 'bot')
2018-12-26 02:49:30 [WARNING ] (13, 1, 'bot')
2018-12-26 02:49:30 [WARNING ] (13, 1, 'bot')
2018-12-26 02:49:30 [WARNING ] (13, 1, 'bot')
2018-12-26 02:49:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:49:30 [DEBUG   ] Finished updating board flags in 1.737 seconds
2018-12-26 02:49:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 02:50:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 02:50:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 02:50:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:50:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 02:50:30 [WARNING ] (13, 1, 'bot')
2018-12-26 02:50:30 [WARNING ] (13, 1, 'bot')
2018-12-26 02:50:30 [WARNING ] (13, 1, 'bot')
2018-12-26 02:50:30 [WARNING ] (13, 1, 'bot')
2018-12-26 02:50:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:50:30 [DEBUG   ] Finished updating board flags in 1.633 seconds
2018-12-26 02:50:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 02:50:58 [DEBUG   ] Got command RPT from MCS: ref #954050
2018-12-26 02:50:58 [DEBUG   ] summary = ERROR
2018-12-26 02:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954050  13 58478 10258553 A  ERRORERROR'
2018-12-26 02:50:58 [DEBUG   ] Got command RPT from MCS: ref #954051
2018-12-26 02:50:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 02:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954051  77 58478 10258554 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 02:51:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 02:51:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 02:51:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:51:30 [WARNING ] (13, 1, 'bot')
2018-12-26 02:51:30 [WARNING ] (13, 1, 'bot')
2018-12-26 02:51:30 [WARNING ] (13, 1, 'bot')
2018-12-26 02:51:30 [WARNING ] (13, 1, 'bot')
2018-12-26 02:51:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:51:30 [DEBUG   ] Finished updating board flags in 1.556 seconds
2018-12-26 02:51:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 02:52:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 02:52:28 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 02:52:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 02:52:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:52:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 02:52:30 [WARNING ] (13, 1, 'bot')
2018-12-26 02:52:30 [WARNING ] (13, 1, 'bot')
2018-12-26 02:52:30 [WARNING ] (13, 1, 'bot')
2018-12-26 02:52:30 [WARNING ] (13, 1, 'bot')
2018-12-26 02:52:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:52:30 [DEBUG   ] Finished updating board flags in 1.502 seconds
2018-12-26 02:52:48 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-26 02:53:08 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 02:53:29 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-12-26 02:53:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:53:30 [WARNING ] (13, 1, 'bot')
2018-12-26 02:53:30 [WARNING ] (13, 1, 'bot')
2018-12-26 02:53:30 [WARNING ] (13, 1, 'bot')
2018-12-26 02:53:30 [WARNING ] (13, 1, 'bot')
2018-12-26 02:53:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:53:30 [DEBUG   ] Finished updating board flags in 1.498 seconds
2018-12-26 02:53:48 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-26 02:54:08 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-26 02:54:28 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 02:54:28 [DEBUG   ] Got command RPT from MCS: ref #954073
2018-12-26 02:54:28 [DEBUG   ] summary = ERROR
2018-12-26 02:54:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954073  13 58478 10468645 A  ERRORERROR'
2018-12-26 02:54:28 [DEBUG   ] Got command RPT from MCS: ref #954074
2018-12-26 02:54:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 02:54:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954074  77 58478 10468849 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 02:54:29 [DEBUG   ] Got command RPT from MCS: ref #954075
2018-12-26 02:54:29 [DEBUG   ] summary = ERROR
2018-12-26 02:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954075  13 58478 10469053 A  ERRORERROR'
2018-12-26 02:54:29 [DEBUG   ] Got command RPT from MCS: ref #954077
2018-12-26 02:54:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 02:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954077  77 58478 10469245 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 02:54:29 [DEBUG   ] Got command RPT from MCS: ref #954078
2018-12-26 02:54:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 02:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954078  12 58478 10469449 A  ERRORB™™š'
2018-12-26 02:54:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:54:31 [WARNING ] (13, 1, 'bot')
2018-12-26 02:54:31 [WARNING ] (13, 1, 'bot')
2018-12-26 02:54:31 [WARNING ] (13, 1, 'bot')
2018-12-26 02:54:31 [WARNING ] (13, 1, 'bot')
2018-12-26 02:54:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:54:31 [DEBUG   ] Finished updating board flags in 2.280 seconds
2018-12-26 02:54:48 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-26 02:55:08 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-12-26 02:55:29 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-12-26 02:55:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:55:31 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 02:55:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-26 02:55:31 [WARNING ] (13, 1, 'bot')
2018-12-26 02:55:31 [WARNING ] (13, 1, 'bot')
2018-12-26 02:55:31 [WARNING ] (13, 1, 'bot')
2018-12-26 02:55:31 [WARNING ] (13, 1, 'bot')
2018-12-26 02:55:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:55:31 [DEBUG   ] Finished updating board flags in 2.120 seconds
2018-12-26 02:55:49 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-26 02:55:58 [DEBUG   ] Got command RPT from MCS: ref #954087
2018-12-26 02:55:58 [DEBUG   ] summary = ERROR
2018-12-26 02:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954087  13 58478 10558553 A  ERRORERROR'
2018-12-26 02:55:58 [DEBUG   ] Got command RPT from MCS: ref #954088
2018-12-26 02:55:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 02:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954088  77 58478 10558554 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 02:56:09 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 02:56:29 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-26 02:56:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 02:56:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:56:31 [WARNING ] (13, 1, 'bot')
2018-12-26 02:56:31 [WARNING ] (13, 1, 'bot')
2018-12-26 02:56:31 [WARNING ] (13, 1, 'bot')
2018-12-26 02:56:31 [WARNING ] (13, 1, 'bot')
2018-12-26 02:56:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:56:31 [DEBUG   ] Finished updating board flags in 1.995 seconds
2018-12-26 02:56:49 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2018-12-26 02:57:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 02:57:29 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 02:57:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 02:57:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:57:31 [WARNING ] (13, 1, 'bot')
2018-12-26 02:57:31 [WARNING ] (13, 1, 'bot')
2018-12-26 02:57:31 [WARNING ] (13, 1, 'bot')
2018-12-26 02:57:31 [WARNING ] (13, 1, 'bot')
2018-12-26 02:57:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:57:31 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-12-26 02:57:49 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-26 02:58:09 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-26 02:58:30 [DEBUG   ] Finished updating ant stats in 1.342 seconds
2018-12-26 02:58:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:58:31 [WARNING ] (13, 1, 'bot')
2018-12-26 02:58:31 [WARNING ] (13, 1, 'bot')
2018-12-26 02:58:31 [WARNING ] (13, 1, 'bot')
2018-12-26 02:58:31 [WARNING ] (13, 1, 'bot')
2018-12-26 02:58:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:58:31 [DEBUG   ] Finished updating board flags in 1.784 seconds
2018-12-26 02:58:50 [DEBUG   ] Finished updating ant stats in 1.153 seconds
2018-12-26 02:59:10 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 02:59:28 [DEBUG   ] Got command RPT from MCS: ref #954108
2018-12-26 02:59:28 [DEBUG   ] summary = ERROR
2018-12-26 02:59:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954108  13 58478 10768725 A  ERRORERROR'
2018-12-26 02:59:28 [DEBUG   ] Got command RPT from MCS: ref #954109
2018-12-26 02:59:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 02:59:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954109  77 58478 10768929 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 02:59:29 [DEBUG   ] Got command RPT from MCS: ref #954110
2018-12-26 02:59:29 [DEBUG   ] summary = ERROR
2018-12-26 02:59:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954110  13 58478 10769133 A  ERRORERROR'
2018-12-26 02:59:29 [DEBUG   ] Got command RPT from MCS: ref #954111
2018-12-26 02:59:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 02:59:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954111  77 58478 10769325 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 02:59:29 [DEBUG   ] Got command RPT from MCS: ref #954112
2018-12-26 02:59:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 02:59:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954112  12 58478 10769530 A  ERRORB™™š'
2018-12-26 02:59:30 [DEBUG   ] Finished updating ant stats in 1.049 seconds
2018-12-26 02:59:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 02:59:31 [WARNING ] (13, 1, 'bot')
2018-12-26 02:59:31 [WARNING ] (13, 1, 'bot')
2018-12-26 02:59:31 [WARNING ] (13, 1, 'bot')
2018-12-26 02:59:31 [WARNING ] (13, 1, 'bot')
2018-12-26 02:59:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 02:59:31 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-12-26 02:59:50 [DEBUG   ] Finished updating ant stats in 0.956 seconds
2018-12-26 03:00:10 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-26 03:00:30 [DEBUG   ] Finished updating ant stats in 0.649 seconds
2018-12-26 03:00:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:00:31 [WARNING ] (13, 1, 'bot')
2018-12-26 03:00:31 [WARNING ] (13, 1, 'bot')
2018-12-26 03:00:31 [WARNING ] (13, 1, 'bot')
2018-12-26 03:00:31 [WARNING ] (13, 1, 'bot')
2018-12-26 03:00:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:00:31 [DEBUG   ] Finished updating board flags in 1.586 seconds
2018-12-26 03:00:50 [DEBUG   ] Finished updating ant stats in 0.556 seconds
2018-12-26 03:00:58 [DEBUG   ] Got command RPT from MCS: ref #954117
2018-12-26 03:00:58 [DEBUG   ] summary = ERROR
2018-12-26 03:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954117  13 58478 10858557 A  ERRORERROR'
2018-12-26 03:00:58 [DEBUG   ] Got command RPT from MCS: ref #954118
2018-12-26 03:00:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 03:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954118  77 58478 10858558 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 03:01:10 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-26 03:01:30 [DEBUG   ] Finished updating ant stats in 0.445 seconds
2018-12-26 03:01:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:01:31 [WARNING ] (13, 1, 'bot')
2018-12-26 03:01:31 [WARNING ] (13, 1, 'bot')
2018-12-26 03:01:31 [WARNING ] (13, 1, 'bot')
2018-12-26 03:01:31 [WARNING ] (13, 1, 'bot')
2018-12-26 03:01:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:01:31 [DEBUG   ] Finished updating board flags in 1.421 seconds
2018-12-26 03:01:51 [DEBUG   ] Finished updating ant stats in 1.308 seconds
2018-12-26 03:02:11 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-26 03:02:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 03:02:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:02:31 [DEBUG   ] Finished updating ant stats in 1.048 seconds
2018-12-26 03:02:31 [WARNING ] (13, 1, 'bot')
2018-12-26 03:02:31 [WARNING ] (13, 1, 'bot')
2018-12-26 03:02:31 [WARNING ] (13, 1, 'bot')
2018-12-26 03:02:31 [WARNING ] (13, 1, 'bot')
2018-12-26 03:02:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:02:31 [DEBUG   ] Finished updating board flags in 1.446 seconds
2018-12-26 03:02:51 [DEBUG   ] Finished updating ant stats in 0.958 seconds
2018-12-26 03:03:11 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-12-26 03:03:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 03:03:31 [DEBUG   ] Finished updating ant stats in 0.845 seconds
2018-12-26 03:03:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:03:32 [WARNING ] (13, 1, 'bot')
2018-12-26 03:03:32 [WARNING ] (13, 1, 'bot')
2018-12-26 03:03:32 [WARNING ] (13, 1, 'bot')
2018-12-26 03:03:32 [WARNING ] (13, 1, 'bot')
2018-12-26 03:03:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:03:32 [DEBUG   ] Finished updating board flags in 2.355 seconds
2018-12-26 03:03:51 [DEBUG   ] Finished updating ant stats in 0.754 seconds
2018-12-26 03:04:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 03:04:28 [DEBUG   ] Got command RPT from MCS: ref #954140
2018-12-26 03:04:28 [DEBUG   ] summary = ERROR
2018-12-26 03:04:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954140  13 58478 11068813 A  ERRORERROR'
2018-12-26 03:04:29 [DEBUG   ] Got command RPT from MCS: ref #954141
2018-12-26 03:04:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 03:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954141  77 58478 11069005 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 03:04:29 [DEBUG   ] Got command RPT from MCS: ref #954142
2018-12-26 03:04:29 [DEBUG   ] summary = ERROR
2018-12-26 03:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954142  13 58478 11069209 A  ERRORERROR'
2018-12-26 03:04:29 [DEBUG   ] Got command RPT from MCS: ref #954144
2018-12-26 03:04:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 03:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954144  77 58478 11069413 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 03:04:29 [DEBUG   ] Got command RPT from MCS: ref #954146
2018-12-26 03:04:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 03:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954146  12 58478 11069617 A  ERRORB™™š'
2018-12-26 03:04:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:04:31 [DEBUG   ] Finished updating ant stats in 0.647 seconds
2018-12-26 03:04:31 [WARNING ] (13, 1, 'bot')
2018-12-26 03:04:31 [WARNING ] (13, 1, 'bot')
2018-12-26 03:04:31 [WARNING ] (13, 1, 'bot')
2018-12-26 03:04:31 [WARNING ] (13, 1, 'bot')
2018-12-26 03:04:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:04:31 [DEBUG   ] Finished updating board flags in 1.408 seconds
2018-12-26 03:04:51 [DEBUG   ] Finished updating ant stats in 0.559 seconds
2018-12-26 03:05:11 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 03:05:31 [DEBUG   ] Finished updating ant stats in 0.448 seconds
2018-12-26 03:05:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:05:32 [WARNING ] (13, 1, 'bot')
2018-12-26 03:05:32 [WARNING ] (13, 1, 'bot')
2018-12-26 03:05:32 [WARNING ] (13, 1, 'bot')
2018-12-26 03:05:32 [WARNING ] (13, 1, 'bot')
2018-12-26 03:05:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:05:32 [DEBUG   ] Finished updating board flags in 2.205 seconds
2018-12-26 03:05:52 [DEBUG   ] Finished updating ant stats in 1.355 seconds
2018-12-26 03:05:58 [DEBUG   ] Got command RPT from MCS: ref #954150
2018-12-26 03:05:58 [DEBUG   ] summary = ERROR
2018-12-26 03:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954150  13 58478 11158557 A  ERRORERROR'
2018-12-26 03:05:58 [DEBUG   ] Got command RPT from MCS: ref #954151
2018-12-26 03:05:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 03:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954151  77 58478 11158558 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 03:06:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 03:06:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:06:32 [DEBUG   ] Finished updating ant stats in 1.249 seconds
2018-12-26 03:06:32 [WARNING ] (13, 1, 'bot')
2018-12-26 03:06:32 [WARNING ] (13, 1, 'bot')
2018-12-26 03:06:32 [WARNING ] (13, 1, 'bot')
2018-12-26 03:06:32 [WARNING ] (13, 1, 'bot')
2018-12-26 03:06:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:06:32 [DEBUG   ] Finished updating board flags in 2.253 seconds
2018-12-26 03:06:52 [DEBUG   ] Finished updating ant stats in 1.155 seconds
2018-12-26 03:07:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 03:07:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:07:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-26 03:07:32 [DEBUG   ] Finished updating ant stats in 1.046 seconds
2018-12-26 03:07:32 [WARNING ] (13, 1, 'bot')
2018-12-26 03:07:32 [WARNING ] (13, 1, 'bot')
2018-12-26 03:07:32 [WARNING ] (13, 1, 'bot')
2018-12-26 03:07:32 [WARNING ] (13, 1, 'bot')
2018-12-26 03:07:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:07:32 [DEBUG   ] Finished updating board flags in 2.191 seconds
2018-12-26 03:07:52 [DEBUG   ] Finished updating ant stats in 0.959 seconds
2018-12-26 03:08:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 03:08:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:08:32 [DEBUG   ] Finished updating ant stats in 0.847 seconds
2018-12-26 03:08:32 [WARNING ] (13, 1, 'bot')
2018-12-26 03:08:32 [WARNING ] (13, 1, 'bot')
2018-12-26 03:08:32 [WARNING ] (13, 1, 'bot')
2018-12-26 03:08:32 [WARNING ] (13, 1, 'bot')
2018-12-26 03:08:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:08:32 [DEBUG   ] Finished updating board flags in 2.018 seconds
2018-12-26 03:08:52 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2018-12-26 03:09:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 03:09:28 [DEBUG   ] Got command RPT from MCS: ref #954171
2018-12-26 03:09:28 [DEBUG   ] summary = ERROR
2018-12-26 03:09:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954171  13 58478 11368893 A  ERRORERROR'
2018-12-26 03:09:29 [DEBUG   ] Got command RPT from MCS: ref #954172
2018-12-26 03:09:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 03:09:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954172  77 58478 11369085 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 03:09:29 [DEBUG   ] Got command RPT from MCS: ref #954173
2018-12-26 03:09:29 [DEBUG   ] summary = ERROR
2018-12-26 03:09:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954173  13 58478 11369289 A  ERRORERROR'
2018-12-26 03:09:29 [DEBUG   ] Got command RPT from MCS: ref #954174
2018-12-26 03:09:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 03:09:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954174  77 58478 11369493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 03:09:29 [DEBUG   ] Got command RPT from MCS: ref #954175
2018-12-26 03:09:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 03:09:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954175  12 58478 11369697 A  ERRORB™™š'
2018-12-26 03:09:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 03:09:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:09:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-26 03:09:32 [DEBUG   ] Finished updating ant stats in 0.648 seconds
2018-12-26 03:09:32 [WARNING ] (13, 1, 'bot')
2018-12-26 03:09:32 [WARNING ] (13, 1, 'bot')
2018-12-26 03:09:32 [WARNING ] (13, 1, 'bot')
2018-12-26 03:09:32 [WARNING ] (13, 1, 'bot')
2018-12-26 03:09:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:09:32 [DEBUG   ] Finished updating board flags in 2.014 seconds
2018-12-26 03:09:52 [DEBUG   ] Finished updating ant stats in 0.554 seconds
2018-12-26 03:10:12 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-26 03:10:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:10:32 [DEBUG   ] Finished updating ant stats in 0.446 seconds
2018-12-26 03:10:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-26 03:10:32 [WARNING ] (13, 1, 'bot')
2018-12-26 03:10:32 [WARNING ] (13, 1, 'bot')
2018-12-26 03:10:32 [WARNING ] (13, 1, 'bot')
2018-12-26 03:10:32 [WARNING ] (13, 1, 'bot')
2018-12-26 03:10:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:10:32 [DEBUG   ] Finished updating board flags in 1.975 seconds
2018-12-26 03:10:53 [DEBUG   ] Finished updating ant stats in 1.359 seconds
2018-12-26 03:10:58 [DEBUG   ] Got command RPT from MCS: ref #954180
2018-12-26 03:10:58 [DEBUG   ] summary = ERROR
2018-12-26 03:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954180  13 58478 11458553 A  ERRORERROR'
2018-12-26 03:10:58 [DEBUG   ] Got command RPT from MCS: ref #954181
2018-12-26 03:10:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 03:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954181  77 58478 11458554 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 03:11:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 03:11:31 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 03:11:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:11:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 03:11:32 [WARNING ] (13, 1, 'bot')
2018-12-26 03:11:32 [WARNING ] (13, 1, 'bot')
2018-12-26 03:11:32 [WARNING ] (13, 1, 'bot')
2018-12-26 03:11:32 [WARNING ] (13, 1, 'bot')
2018-12-26 03:11:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:11:32 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-12-26 03:11:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 03:11:53 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 03:12:13 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-26 03:12:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:12:32 [WARNING ] (13, 1, 'bot')
2018-12-26 03:12:32 [WARNING ] (13, 1, 'bot')
2018-12-26 03:12:32 [WARNING ] (13, 1, 'bot')
2018-12-26 03:12:32 [WARNING ] (13, 1, 'bot')
2018-12-26 03:12:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:12:32 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-12-26 03:12:33 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-26 03:12:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 03:13:13 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 03:13:31 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 03:13:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:13:32 [WARNING ] (13, 1, 'bot')
2018-12-26 03:13:32 [WARNING ] (13, 1, 'bot')
2018-12-26 03:13:32 [WARNING ] (13, 1, 'bot')
2018-12-26 03:13:32 [WARNING ] (13, 1, 'bot')
2018-12-26 03:13:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:13:32 [DEBUG   ] Finished updating board flags in 1.778 seconds
2018-12-26 03:13:33 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-26 03:13:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 03:14:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 03:14:28 [DEBUG   ] Got command RPT from MCS: ref #954203
2018-12-26 03:14:28 [DEBUG   ] summary = ERROR
2018-12-26 03:14:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954203  13 58478 11668973 A  ERRORERROR'
2018-12-26 03:14:29 [DEBUG   ] Got command RPT from MCS: ref #954204
2018-12-26 03:14:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 03:14:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954204  77 58478 11669165 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 03:14:29 [DEBUG   ] Got command RPT from MCS: ref #954205
2018-12-26 03:14:29 [DEBUG   ] summary = ERROR
2018-12-26 03:14:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954205  13 58478 11669369 A  ERRORERROR'
2018-12-26 03:14:29 [DEBUG   ] Got command RPT from MCS: ref #954207
2018-12-26 03:14:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 03:14:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954207  77 58478 11669573 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 03:14:29 [DEBUG   ] Got command RPT from MCS: ref #954208
2018-12-26 03:14:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 03:14:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954208  12 58478 11669777 A  ERRORB˜™š'
2018-12-26 03:14:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:14:32 [WARNING ] (13, 1, 'bot')
2018-12-26 03:14:32 [WARNING ] (13, 1, 'bot')
2018-12-26 03:14:32 [WARNING ] (13, 1, 'bot')
2018-12-26 03:14:32 [WARNING ] (13, 1, 'bot')
2018-12-26 03:14:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:14:32 [DEBUG   ] Finished updating board flags in 1.594 seconds
2018-12-26 03:14:33 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 03:14:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 03:15:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 03:15:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:15:32 [WARNING ] (13, 1, 'bot')
2018-12-26 03:15:32 [WARNING ] (13, 1, 'bot')
2018-12-26 03:15:32 [WARNING ] (13, 1, 'bot')
2018-12-26 03:15:32 [WARNING ] (13, 1, 'bot')
2018-12-26 03:15:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:15:32 [DEBUG   ] Finished updating board flags in 1.382 seconds
2018-12-26 03:15:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 03:15:53 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 03:15:58 [DEBUG   ] Got command RPT from MCS: ref #954217
2018-12-26 03:15:58 [DEBUG   ] summary = ERROR
2018-12-26 03:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954217  13 58478 11758557 A  ERRORERROR'
2018-12-26 03:15:58 [DEBUG   ] Got command RPT from MCS: ref #954218
2018-12-26 03:15:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 03:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954218  77 58478 11758558 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 03:16:13 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-26 03:16:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:16:33 [WARNING ] (13, 1, 'bot')
2018-12-26 03:16:33 [WARNING ] (13, 1, 'bot')
2018-12-26 03:16:33 [WARNING ] (13, 1, 'bot')
2018-12-26 03:16:33 [WARNING ] (13, 1, 'bot')
2018-12-26 03:16:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:16:33 [DEBUG   ] Finished updating board flags in 2.237 seconds
2018-12-26 03:16:34 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-12-26 03:16:54 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-26 03:17:14 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-26 03:17:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-26 03:17:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:17:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 03:17:33 [WARNING ] (13, 1, 'bot')
2018-12-26 03:17:33 [WARNING ] (13, 1, 'bot')
2018-12-26 03:17:33 [WARNING ] (13, 1, 'bot')
2018-12-26 03:17:33 [WARNING ] (13, 1, 'bot')
2018-12-26 03:17:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:17:33 [DEBUG   ] Finished updating board flags in 2.237 seconds
2018-12-26 03:17:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 03:17:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 03:18:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 03:18:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:18:33 [WARNING ] (13, 1, 'bot')
2018-12-26 03:18:33 [WARNING ] (13, 1, 'bot')
2018-12-26 03:18:33 [WARNING ] (13, 1, 'bot')
2018-12-26 03:18:33 [WARNING ] (13, 1, 'bot')
2018-12-26 03:18:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:18:33 [DEBUG   ] Finished updating board flags in 2.165 seconds
2018-12-26 03:18:34 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-12-26 03:18:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 03:19:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 03:19:29 [DEBUG   ] Got command RPT from MCS: ref #954238
2018-12-26 03:19:29 [DEBUG   ] summary = ERROR
2018-12-26 03:19:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954238  13 58478 11969053 A  ERRORERROR'
2018-12-26 03:19:29 [DEBUG   ] Got command RPT from MCS: ref #954239
2018-12-26 03:19:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 03:19:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954239  77 58478 11969257 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 03:19:29 [DEBUG   ] Got command RPT from MCS: ref #954240
2018-12-26 03:19:29 [DEBUG   ] summary = ERROR
2018-12-26 03:19:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954240  13 58478 11969449 A  ERRORERROR'
2018-12-26 03:19:29 [DEBUG   ] Got command RPT from MCS: ref #954241
2018-12-26 03:19:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 03:19:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954241  77 58478 11969653 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 03:19:29 [DEBUG   ] Got command RPT from MCS: ref #954242
2018-12-26 03:19:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 03:19:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954242  12 58478 11969857 A  ERRORBš™š'
2018-12-26 03:19:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:19:33 [WARNING ] (13, 1, 'bot')
2018-12-26 03:19:33 [WARNING ] (13, 1, 'bot')
2018-12-26 03:19:33 [WARNING ] (13, 1, 'bot')
2018-12-26 03:19:33 [WARNING ] (13, 1, 'bot')
2018-12-26 03:19:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:19:33 [DEBUG   ] Finished updating board flags in 2.000 seconds
2018-12-26 03:19:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 03:19:54 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-26 03:20:14 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-26 03:20:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:20:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 03:20:33 [WARNING ] (13, 1, 'bot')
2018-12-26 03:20:33 [WARNING ] (13, 1, 'bot')
2018-12-26 03:20:33 [WARNING ] (13, 1, 'bot')
2018-12-26 03:20:33 [WARNING ] (13, 1, 'bot')
2018-12-26 03:20:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:20:33 [DEBUG   ] Finished updating board flags in 1.786 seconds
2018-12-26 03:20:34 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-26 03:20:54 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-12-26 03:20:58 [DEBUG   ] Got command RPT from MCS: ref #954243
2018-12-26 03:20:58 [DEBUG   ] summary = ERROR
2018-12-26 03:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954243  13 58478 12058549 A  ERRORERROR'
2018-12-26 03:20:58 [DEBUG   ] Got command RPT from MCS: ref #954244
2018-12-26 03:20:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 03:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954244  77 58478 12058550 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 03:21:15 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2018-12-26 03:21:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:21:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 03:21:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-26 03:21:33 [WARNING ] (13, 1, 'bot')
2018-12-26 03:21:33 [WARNING ] (13, 1, 'bot')
2018-12-26 03:21:33 [WARNING ] (13, 1, 'bot')
2018-12-26 03:21:33 [WARNING ] (13, 1, 'bot')
2018-12-26 03:21:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:21:33 [DEBUG   ] Finished updating board flags in 1.594 seconds
2018-12-26 03:21:35 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-26 03:21:55 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-26 03:22:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 03:22:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:22:33 [WARNING ] (13, 1, 'bot')
2018-12-26 03:22:33 [WARNING ] (13, 1, 'bot')
2018-12-26 03:22:33 [WARNING ] (13, 1, 'bot')
2018-12-26 03:22:33 [WARNING ] (13, 1, 'bot')
2018-12-26 03:22:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:22:33 [DEBUG   ] Finished updating board flags in 1.382 seconds
2018-12-26 03:22:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 03:22:55 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-12-26 03:23:15 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-26 03:23:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:23:34 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 03:23:34 [WARNING ] (13, 1, 'bot')
2018-12-26 03:23:34 [WARNING ] (13, 1, 'bot')
2018-12-26 03:23:34 [WARNING ] (13, 1, 'bot')
2018-12-26 03:23:34 [WARNING ] (13, 1, 'bot')
2018-12-26 03:23:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:23:34 [DEBUG   ] Finished updating board flags in 2.287 seconds
2018-12-26 03:23:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 03:23:55 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 03:24:15 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 03:24:29 [DEBUG   ] Got command RPT from MCS: ref #954266
2018-12-26 03:24:29 [DEBUG   ] summary = ERROR
2018-12-26 03:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954266  13 58478 12269129 A  ERRORERROR'
2018-12-26 03:24:29 [DEBUG   ] Got command RPT from MCS: ref #954267
2018-12-26 03:24:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 03:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954267  77 58478 12269333 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 03:24:29 [DEBUG   ] Got command RPT from MCS: ref #954268
2018-12-26 03:24:29 [DEBUG   ] summary = ERROR
2018-12-26 03:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954268  13 58478 12269537 A  ERRORERROR'
2018-12-26 03:24:29 [DEBUG   ] Got command RPT from MCS: ref #954270
2018-12-26 03:24:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 03:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954270  77 58478 12269729 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 03:24:29 [DEBUG   ] Got command RPT from MCS: ref #954272
2018-12-26 03:24:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 03:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954272  12 58478 12269933 A  ERRORB™™š'
2018-12-26 03:24:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:24:34 [WARNING ] (13, 1, 'bot')
2018-12-26 03:24:34 [WARNING ] (13, 1, 'bot')
2018-12-26 03:24:34 [WARNING ] (13, 1, 'bot')
2018-12-26 03:24:34 [WARNING ] (13, 1, 'bot')
2018-12-26 03:24:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:24:34 [DEBUG   ] Finished updating board flags in 2.133 seconds
2018-12-26 03:24:35 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-26 03:24:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 03:25:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 03:25:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:25:34 [WARNING ] (13, 1, 'bot')
2018-12-26 03:25:34 [WARNING ] (13, 1, 'bot')
2018-12-26 03:25:34 [WARNING ] (13, 1, 'bot')
2018-12-26 03:25:34 [WARNING ] (13, 1, 'bot')
2018-12-26 03:25:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:25:34 [DEBUG   ] Finished updating board flags in 2.005 seconds
2018-12-26 03:25:35 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-12-26 03:25:55 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-26 03:25:58 [DEBUG   ] Got command RPT from MCS: ref #954280
2018-12-26 03:25:58 [DEBUG   ] summary = ERROR
2018-12-26 03:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954280  13 58478 12358553 A  ERRORERROR'
2018-12-26 03:25:58 [DEBUG   ] Got command RPT from MCS: ref #954281
2018-12-26 03:25:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 03:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954281  77 58478 12358554 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 03:26:15 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 03:26:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:26:34 [WARNING ] (13, 1, 'bot')
2018-12-26 03:26:34 [WARNING ] (13, 1, 'bot')
2018-12-26 03:26:34 [WARNING ] (13, 1, 'bot')
2018-12-26 03:26:34 [WARNING ] (13, 1, 'bot')
2018-12-26 03:26:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:26:34 [DEBUG   ] Finished updating board flags in 1.959 seconds
2018-12-26 03:26:36 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-26 03:26:55 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-26 03:27:16 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-12-26 03:27:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:27:34 [WARNING ] (13, 1, 'bot')
2018-12-26 03:27:34 [WARNING ] (13, 1, 'bot')
2018-12-26 03:27:34 [WARNING ] (13, 1, 'bot')
2018-12-26 03:27:34 [WARNING ] (13, 1, 'bot')
2018-12-26 03:27:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:27:34 [DEBUG   ] Finished updating board flags in 1.861 seconds
2018-12-26 03:27:36 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-26 03:27:56 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 03:28:16 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-26 03:28:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:28:34 [WARNING ] (13, 1, 'bot')
2018-12-26 03:28:34 [WARNING ] (13, 1, 'bot')
2018-12-26 03:28:34 [WARNING ] (13, 1, 'bot')
2018-12-26 03:28:34 [WARNING ] (13, 1, 'bot')
2018-12-26 03:28:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:28:34 [DEBUG   ] Finished updating board flags in 1.743 seconds
2018-12-26 03:28:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 03:28:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 03:29:16 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 03:29:29 [DEBUG   ] Got command RPT from MCS: ref #954301
2018-12-26 03:29:29 [DEBUG   ] summary = ERROR
2018-12-26 03:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954301  13 58478 12569209 A  ERRORERROR'
2018-12-26 03:29:29 [DEBUG   ] Got command RPT from MCS: ref #954302
2018-12-26 03:29:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 03:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954302  77 58478 12569413 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 03:29:29 [DEBUG   ] Got command RPT from MCS: ref #954303
2018-12-26 03:29:29 [DEBUG   ] summary = ERROR
2018-12-26 03:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954303  13 58478 12569617 A  ERRORERROR'
2018-12-26 03:29:29 [DEBUG   ] Got command RPT from MCS: ref #954304
2018-12-26 03:29:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 03:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954304  77 58478 12569809 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 03:29:30 [DEBUG   ] Got command RPT from MCS: ref #954305
2018-12-26 03:29:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 03:29:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954305  12 58478 12570013 A  ERRORB™™š'
2018-12-26 03:29:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:29:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 03:29:34 [WARNING ] (13, 1, 'bot')
2018-12-26 03:29:34 [WARNING ] (13, 1, 'bot')
2018-12-26 03:29:34 [WARNING ] (13, 1, 'bot')
2018-12-26 03:29:34 [WARNING ] (13, 1, 'bot')
2018-12-26 03:29:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:29:34 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-12-26 03:29:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 03:29:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 03:30:16 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 03:30:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:30:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-12-26 03:30:34 [WARNING ] (13, 1, 'bot')
2018-12-26 03:30:34 [WARNING ] (13, 1, 'bot')
2018-12-26 03:30:34 [WARNING ] (13, 1, 'bot')
2018-12-26 03:30:34 [WARNING ] (13, 1, 'bot')
2018-12-26 03:30:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:30:34 [DEBUG   ] Finished updating board flags in 1.591 seconds
2018-12-26 03:30:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 03:30:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 03:30:58 [DEBUG   ] Got command RPT from MCS: ref #954310
2018-12-26 03:30:58 [DEBUG   ] summary = ERROR
2018-12-26 03:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954310  13 58478 12658561 A  ERRORERROR'
2018-12-26 03:30:58 [DEBUG   ] Got command RPT from MCS: ref #954311
2018-12-26 03:30:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 03:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954311  77 58478 12658562 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 03:31:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 03:31:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:31:34 [WARNING ] (13, 1, 'bot')
2018-12-26 03:31:34 [WARNING ] (13, 1, 'bot')
2018-12-26 03:31:34 [WARNING ] (13, 1, 'bot')
2018-12-26 03:31:34 [WARNING ] (13, 1, 'bot')
2018-12-26 03:31:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:31:34 [DEBUG   ] Finished updating board flags in 1.482 seconds
2018-12-26 03:31:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 03:31:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 03:32:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 03:32:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:32:34 [WARNING ] (13, 1, 'bot')
2018-12-26 03:32:34 [WARNING ] (13, 1, 'bot')
2018-12-26 03:32:34 [WARNING ] (13, 1, 'bot')
2018-12-26 03:32:34 [WARNING ] (13, 1, 'bot')
2018-12-26 03:32:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:32:34 [DEBUG   ] Finished updating board flags in 1.477 seconds
2018-12-26 03:32:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 03:32:56 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-26 03:33:16 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 03:33:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:33:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:33:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:33:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:33:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:33:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:33:35 [DEBUG   ] Finished updating board flags in 1.610 seconds
2018-12-26 03:33:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 03:33:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 03:34:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 03:34:29 [DEBUG   ] Got command RPT from MCS: ref #954333
2018-12-26 03:34:29 [DEBUG   ] summary = ERROR
2018-12-26 03:34:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954333  13 58478 12869289 A  ERRORERROR'
2018-12-26 03:34:29 [DEBUG   ] Got command RPT from MCS: ref #954334
2018-12-26 03:34:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 03:34:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954334  77 58478 12869493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 03:34:29 [DEBUG   ] Got command RPT from MCS: ref #954335
2018-12-26 03:34:29 [DEBUG   ] summary = ERROR
2018-12-26 03:34:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954335  13 58478 12869697 A  ERRORERROR'
2018-12-26 03:34:29 [DEBUG   ] Got command RPT from MCS: ref #954337
2018-12-26 03:34:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 03:34:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954337  77 58478 12869889 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 03:34:30 [DEBUG   ] Got command RPT from MCS: ref #954338
2018-12-26 03:34:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 03:34:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954338  12 58478 12870093 A  ERRORB™™š'
2018-12-26 03:34:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 03:34:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:34:34 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 03:34:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:34:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:34:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:34:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:34:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:34:35 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-12-26 03:34:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 03:34:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 03:35:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 03:35:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:35:34 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 03:35:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:35:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:35:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:35:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:35:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:35:35 [DEBUG   ] Finished updating board flags in 1.633 seconds
2018-12-26 03:35:36 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 03:35:56 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-26 03:35:58 [DEBUG   ] Got command RPT from MCS: ref #954343
2018-12-26 03:35:58 [DEBUG   ] summary = ERROR
2018-12-26 03:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954343  13 58478 12958561 A  ERRORERROR'
2018-12-26 03:35:58 [DEBUG   ] Got command RPT from MCS: ref #954344
2018-12-26 03:35:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 03:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954344  77 58478 12958562 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 03:36:16 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-26 03:36:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:36:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:36:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:36:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:36:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:36:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:36:35 [DEBUG   ] Finished updating board flags in 1.627 seconds
2018-12-26 03:36:36 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-26 03:36:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 03:37:16 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-26 03:37:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:37:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:37:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:37:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:37:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:37:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:37:35 [DEBUG   ] Finished updating board flags in 2.321 seconds
2018-12-26 03:37:36 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-12-26 03:37:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 03:38:17 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 03:38:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:38:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 03:38:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-26 03:38:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:38:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:38:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:38:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:38:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:38:35 [DEBUG   ] Finished updating board flags in 2.065 seconds
2018-12-26 03:38:37 [DEBUG   ] Finished updating ant stats in 1.183 seconds
2018-12-26 03:38:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 03:39:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 03:39:29 [DEBUG   ] Got command RPT from MCS: ref #954364
2018-12-26 03:39:29 [DEBUG   ] summary = ERROR
2018-12-26 03:39:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954364  13 58478 13169377 A  ERRORERROR'
2018-12-26 03:39:29 [DEBUG   ] Got command RPT from MCS: ref #954365
2018-12-26 03:39:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 03:39:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954365  77 58478 13169569 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 03:39:29 [DEBUG   ] Got command RPT from MCS: ref #954366
2018-12-26 03:39:29 [DEBUG   ] summary = ERROR
2018-12-26 03:39:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954366  13 58478 13169773 A  ERRORERROR'
2018-12-26 03:39:29 [DEBUG   ] Got command RPT from MCS: ref #954367
2018-12-26 03:39:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 03:39:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954367  77 58478 13169977 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 03:39:30 [DEBUG   ] Got command RPT from MCS: ref #954368
2018-12-26 03:39:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 03:39:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954368  12 58478 13170181 A  ERRORB™™š'
2018-12-26 03:39:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:39:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:39:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:39:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:39:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:39:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:39:35 [DEBUG   ] Finished updating board flags in 2.010 seconds
2018-12-26 03:39:37 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 03:39:57 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-26 03:40:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 03:40:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:40:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:40:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:40:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:40:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:40:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:40:35 [DEBUG   ] Finished updating board flags in 1.980 seconds
2018-12-26 03:40:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 03:40:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 03:40:58 [DEBUG   ] Got command RPT from MCS: ref #954373
2018-12-26 03:40:58 [DEBUG   ] summary = ERROR
2018-12-26 03:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954373  13 58478 13258561 A  ERRORERROR'
2018-12-26 03:40:58 [DEBUG   ] Got command RPT from MCS: ref #954374
2018-12-26 03:40:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 03:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954374  77 58478 13258562 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 03:41:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 03:41:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:41:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 03:41:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:41:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:41:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:41:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:41:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:41:35 [DEBUG   ] Finished updating board flags in 1.821 seconds
2018-12-26 03:41:37 [DEBUG   ] Finished updating ant stats in 0.790 seconds
2018-12-26 03:41:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 03:42:17 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 03:42:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:42:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:42:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:42:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:42:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:42:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:42:35 [DEBUG   ] Finished updating board flags in 1.778 seconds
2018-12-26 03:42:37 [DEBUG   ] Finished updating ant stats in 0.583 seconds
2018-12-26 03:42:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 03:43:17 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-26 03:43:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:43:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:43:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:43:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:43:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:43:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:43:35 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-12-26 03:43:38 [DEBUG   ] Finished updating ant stats in 1.373 seconds
2018-12-26 03:43:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 03:44:18 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 03:44:29 [DEBUG   ] Got command RPT from MCS: ref #954396
2018-12-26 03:44:29 [DEBUG   ] summary = ERROR
2018-12-26 03:44:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954396  13 58478 13469450 A  ERRORERROR'
2018-12-26 03:44:29 [DEBUG   ] Got command RPT from MCS: ref #954397
2018-12-26 03:44:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 03:44:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954397  77 58478 13469653 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 03:44:29 [DEBUG   ] Got command RPT from MCS: ref #954398
2018-12-26 03:44:29 [DEBUG   ] summary = ERROR
2018-12-26 03:44:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954398  13 58478 13469858 A  ERRORERROR'
2018-12-26 03:44:30 [DEBUG   ] Got command RPT from MCS: ref #954400
2018-12-26 03:44:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 03:44:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954400  77 58478 13470061 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 03:44:30 [DEBUG   ] Got command RPT from MCS: ref #954402
2018-12-26 03:44:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 03:44:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954402  12 58478 13470254 A  ERRORB™™š'
2018-12-26 03:44:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-26 03:44:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:44:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-12-26 03:44:35 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-26 03:44:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:44:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:44:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:44:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:44:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:44:35 [DEBUG   ] Finished updating board flags in 1.604 seconds
2018-12-26 03:44:38 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 03:44:58 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-26 03:45:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 03:45:34 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-26 03:45:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:45:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:45:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:45:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:45:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:45:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:45:35 [DEBUG   ] Finished updating board flags in 1.596 seconds
2018-12-26 03:45:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 03:45:58 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 03:45:58 [DEBUG   ] Got command RPT from MCS: ref #954410
2018-12-26 03:45:58 [DEBUG   ] summary = ERROR
2018-12-26 03:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954410  13 58478 13558561 A  ERRORERROR'
2018-12-26 03:45:58 [DEBUG   ] Got command RPT from MCS: ref #954411
2018-12-26 03:45:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 03:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954411  77 58478 13558562 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 03:46:18 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-26 03:46:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:46:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:46:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:46:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:46:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:46:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:46:35 [DEBUG   ] Finished updating board flags in 1.406 seconds
2018-12-26 03:46:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 03:46:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 03:47:18 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 03:47:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 03:47:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:47:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:47:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:47:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:47:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:47:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:47:35 [DEBUG   ] Finished updating board flags in 1.407 seconds
2018-12-26 03:47:38 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-26 03:47:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 03:48:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 03:48:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:48:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:48:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:48:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:48:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:48:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:48:35 [DEBUG   ] Finished updating board flags in 1.406 seconds
2018-12-26 03:48:38 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-26 03:48:59 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-26 03:49:19 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-26 03:49:29 [DEBUG   ] Got command RPT from MCS: ref #954431
2018-12-26 03:49:29 [DEBUG   ] summary = ERROR
2018-12-26 03:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954431  13 58478 13769541 A  ERRORERROR'
2018-12-26 03:49:29 [DEBUG   ] Got command RPT from MCS: ref #954432
2018-12-26 03:49:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 03:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954432  77 58478 13769733 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 03:49:29 [DEBUG   ] Got command RPT from MCS: ref #954433
2018-12-26 03:49:29 [DEBUG   ] summary = ERROR
2018-12-26 03:49:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954433  13 58478 13769937 A  ERRORERROR'
2018-12-26 03:49:30 [DEBUG   ] Got command RPT from MCS: ref #954434
2018-12-26 03:49:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 03:49:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954434  77 58478 13770141 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 03:49:30 [DEBUG   ] Got command RPT from MCS: ref #954435
2018-12-26 03:49:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 03:49:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954435  12 58478 13770345 A  ERRORBš™š'
2018-12-26 03:49:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:49:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:49:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:49:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:49:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:49:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:49:35 [DEBUG   ] Finished updating board flags in 1.390 seconds
2018-12-26 03:49:39 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-26 03:49:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 03:50:19 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 03:50:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:50:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:50:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:50:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:50:35 [WARNING ] (13, 1, 'bot')
2018-12-26 03:50:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:50:35 [DEBUG   ] Finished updating board flags in 1.359 seconds
2018-12-26 03:50:39 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-26 03:50:58 [DEBUG   ] Got command RPT from MCS: ref #954436
2018-12-26 03:50:58 [DEBUG   ] summary = ERROR
2018-12-26 03:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954436  13 58478 13858565 A  ERRORERROR'
2018-12-26 03:50:58 [DEBUG   ] Got command RPT from MCS: ref #954437
2018-12-26 03:50:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 03:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954437  77 58478 13858566 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 03:50:59 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-26 03:51:19 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-26 03:51:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:51:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 03:51:36 [WARNING ] (13, 1, 'bot')
2018-12-26 03:51:36 [WARNING ] (13, 1, 'bot')
2018-12-26 03:51:36 [WARNING ] (13, 1, 'bot')
2018-12-26 03:51:36 [WARNING ] (13, 1, 'bot')
2018-12-26 03:51:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:51:36 [DEBUG   ] Finished updating board flags in 2.058 seconds
2018-12-26 03:51:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 03:51:59 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-12-26 03:52:19 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-26 03:52:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:52:36 [WARNING ] (13, 1, 'bot')
2018-12-26 03:52:36 [WARNING ] (13, 1, 'bot')
2018-12-26 03:52:36 [WARNING ] (13, 1, 'bot')
2018-12-26 03:52:36 [WARNING ] (13, 1, 'bot')
2018-12-26 03:52:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:52:36 [DEBUG   ] Finished updating board flags in 1.989 seconds
2018-12-26 03:52:39 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-26 03:52:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 03:53:19 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-12-26 03:53:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:53:36 [WARNING ] (13, 1, 'bot')
2018-12-26 03:53:36 [WARNING ] (13, 1, 'bot')
2018-12-26 03:53:36 [WARNING ] (13, 1, 'bot')
2018-12-26 03:53:36 [WARNING ] (13, 1, 'bot')
2018-12-26 03:53:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:53:36 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-12-26 03:53:39 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-26 03:53:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 03:54:20 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-26 03:54:29 [DEBUG   ] Got command RPT from MCS: ref #954459
2018-12-26 03:54:29 [DEBUG   ] summary = ERROR
2018-12-26 03:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954459  13 58478 14069613 A  ERRORERROR'
2018-12-26 03:54:29 [DEBUG   ] Got command RPT from MCS: ref #954460
2018-12-26 03:54:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 03:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954460  77 58478 14069817 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 03:54:30 [DEBUG   ] Got command RPT from MCS: ref #954461
2018-12-26 03:54:30 [DEBUG   ] summary = ERROR
2018-12-26 03:54:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954461  13 58478 14070021 A  ERRORERROR'
2018-12-26 03:54:30 [DEBUG   ] Got command RPT from MCS: ref #954463
2018-12-26 03:54:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 03:54:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954463  77 58478 14070225 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 03:54:30 [DEBUG   ] Got command RPT from MCS: ref #954464
2018-12-26 03:54:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 03:54:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954464  12 58478 14070417 A  ERRORB˜™š'
2018-12-26 03:54:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 03:54:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:54:36 [WARNING ] (13, 1, 'bot')
2018-12-26 03:54:36 [WARNING ] (13, 1, 'bot')
2018-12-26 03:54:36 [WARNING ] (13, 1, 'bot')
2018-12-26 03:54:36 [WARNING ] (13, 1, 'bot')
2018-12-26 03:54:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:54:36 [DEBUG   ] Finished updating board flags in 1.810 seconds
2018-12-26 03:54:40 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-26 03:55:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 03:55:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 03:55:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:55:36 [WARNING ] (13, 1, 'bot')
2018-12-26 03:55:36 [WARNING ] (13, 1, 'bot')
2018-12-26 03:55:36 [WARNING ] (13, 1, 'bot')
2018-12-26 03:55:36 [WARNING ] (13, 1, 'bot')
2018-12-26 03:55:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:55:36 [DEBUG   ] Finished updating board flags in 1.787 seconds
2018-12-26 03:55:40 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-26 03:55:58 [DEBUG   ] Got command RPT from MCS: ref #954473
2018-12-26 03:55:58 [DEBUG   ] summary = ERROR
2018-12-26 03:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954473  13 58478 14158565 A  ERRORERROR'
2018-12-26 03:55:58 [DEBUG   ] Got command RPT from MCS: ref #954474
2018-12-26 03:55:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 03:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954474  77 58478 14158566 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 03:56:00 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-26 03:56:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 03:56:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:56:36 [WARNING ] (13, 1, 'bot')
2018-12-26 03:56:36 [WARNING ] (13, 1, 'bot')
2018-12-26 03:56:36 [WARNING ] (13, 1, 'bot')
2018-12-26 03:56:36 [WARNING ] (13, 1, 'bot')
2018-12-26 03:56:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:56:36 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-12-26 03:56:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 03:57:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 03:57:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 03:57:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:57:36 [WARNING ] (13, 1, 'bot')
2018-12-26 03:57:36 [WARNING ] (13, 1, 'bot')
2018-12-26 03:57:36 [WARNING ] (13, 1, 'bot')
2018-12-26 03:57:36 [WARNING ] (13, 1, 'bot')
2018-12-26 03:57:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:57:36 [DEBUG   ] Finished updating board flags in 1.601 seconds
2018-12-26 03:57:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 03:58:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 03:58:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 03:58:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-26 03:58:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:58:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-12-26 03:58:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-12-26 03:58:36 [WARNING ] (13, 1, 'bot')
2018-12-26 03:58:36 [WARNING ] (13, 1, 'bot')
2018-12-26 03:58:36 [WARNING ] (13, 1, 'bot')
2018-12-26 03:58:36 [WARNING ] (13, 1, 'bot')
2018-12-26 03:58:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:58:36 [DEBUG   ] Finished updating board flags in 1.624 seconds
2018-12-26 03:58:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 03:59:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 03:59:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 03:59:29 [DEBUG   ] Got command RPT from MCS: ref #954494
2018-12-26 03:59:29 [DEBUG   ] summary = ERROR
2018-12-26 03:59:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954494  13 58478 14369701 A  ERRORERROR'
2018-12-26 03:59:29 [DEBUG   ] Got command RPT from MCS: ref #954495
2018-12-26 03:59:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 03:59:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954495  77 58478 14369893 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 03:59:30 [DEBUG   ] Got command RPT from MCS: ref #954496
2018-12-26 03:59:30 [DEBUG   ] summary = ERROR
2018-12-26 03:59:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954496  13 58478 14370097 A  ERRORERROR'
2018-12-26 03:59:30 [DEBUG   ] Got command RPT from MCS: ref #954497
2018-12-26 03:59:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 03:59:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954497  77 58478 14370301 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 03:59:30 [DEBUG   ] Got command RPT from MCS: ref #954498
2018-12-26 03:59:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 03:59:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954498  12 58478 14370505 A  ERRORB™™š'
2018-12-26 03:59:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 03:59:36 [WARNING ] (13, 1, 'bot')
2018-12-26 03:59:36 [WARNING ] (13, 1, 'bot')
2018-12-26 03:59:36 [WARNING ] (13, 1, 'bot')
2018-12-26 03:59:36 [WARNING ] (13, 1, 'bot')
2018-12-26 03:59:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 03:59:36 [DEBUG   ] Finished updating board flags in 1.565 seconds
2018-12-26 03:59:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 04:00:00 [DEBUG   ] Finished updating ant stats in 0.786 seconds
2018-12-26 04:00:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 04:00:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:00:36 [WARNING ] (13, 1, 'bot')
2018-12-26 04:00:36 [WARNING ] (13, 1, 'bot')
2018-12-26 04:00:36 [WARNING ] (13, 1, 'bot')
2018-12-26 04:00:36 [WARNING ] (13, 1, 'bot')
2018-12-26 04:00:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:00:36 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-12-26 04:00:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 04:00:58 [DEBUG   ] Got command RPT from MCS: ref #954503
2018-12-26 04:00:58 [DEBUG   ] summary = ERROR
2018-12-26 04:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954503  13 58478 14458561 A  ERRORERROR'
2018-12-26 04:00:58 [DEBUG   ] Got command RPT from MCS: ref #954504
2018-12-26 04:00:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 04:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954504  77 58478 14458562 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 04:01:00 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 04:01:20 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-26 04:01:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:01:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 04:01:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-26 04:01:36 [WARNING ] (13, 1, 'bot')
2018-12-26 04:01:36 [WARNING ] (13, 1, 'bot')
2018-12-26 04:01:36 [WARNING ] (13, 1, 'bot')
2018-12-26 04:01:36 [WARNING ] (13, 1, 'bot')
2018-12-26 04:01:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:01:36 [DEBUG   ] Finished updating board flags in 1.411 seconds
2018-12-26 04:01:40 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 04:02:00 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-26 04:02:21 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-12-26 04:02:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:02:36 [WARNING ] (13, 1, 'bot')
2018-12-26 04:02:36 [WARNING ] (13, 1, 'bot')
2018-12-26 04:02:36 [WARNING ] (13, 1, 'bot')
2018-12-26 04:02:36 [WARNING ] (13, 1, 'bot')
2018-12-26 04:02:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:02:36 [DEBUG   ] Finished updating board flags in 1.383 seconds
2018-12-26 04:02:41 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-26 04:03:01 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-26 04:03:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-26 04:03:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:03:36 [WARNING ] (13, 1, 'bot')
2018-12-26 04:03:36 [WARNING ] (13, 1, 'bot')
2018-12-26 04:03:36 [WARNING ] (13, 1, 'bot')
2018-12-26 04:03:36 [WARNING ] (13, 1, 'bot')
2018-12-26 04:03:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:03:36 [DEBUG   ] Finished updating board flags in 1.372 seconds
2018-12-26 04:03:41 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-26 04:04:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 04:04:21 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 04:04:29 [DEBUG   ] Got command RPT from MCS: ref #954526
2018-12-26 04:04:29 [DEBUG   ] summary = ERROR
2018-12-26 04:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954526  13 58478 14669777 A  ERRORERROR'
2018-12-26 04:04:29 [DEBUG   ] Got command RPT from MCS: ref #954527
2018-12-26 04:04:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 04:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954527  77 58478 14669981 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 04:04:30 [DEBUG   ] Got command RPT from MCS: ref #954528
2018-12-26 04:04:30 [DEBUG   ] summary = ERROR
2018-12-26 04:04:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954528  13 58478 14670185 A  ERRORERROR'
2018-12-26 04:04:30 [DEBUG   ] Got command RPT from MCS: ref #954530
2018-12-26 04:04:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 04:04:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954530  77 58478 14670377 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 04:04:30 [DEBUG   ] Got command RPT from MCS: ref #954532
2018-12-26 04:04:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 04:04:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954532  12 58478 14670581 A  ERRORB™™š'
2018-12-26 04:04:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:04:37 [WARNING ] (13, 1, 'bot')
2018-12-26 04:04:37 [WARNING ] (13, 1, 'bot')
2018-12-26 04:04:37 [WARNING ] (13, 1, 'bot')
2018-12-26 04:04:37 [WARNING ] (13, 1, 'bot')
2018-12-26 04:04:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:04:37 [DEBUG   ] Finished updating board flags in 2.040 seconds
2018-12-26 04:04:41 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 04:05:01 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-26 04:05:21 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-26 04:05:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:05:37 [WARNING ] (13, 1, 'bot')
2018-12-26 04:05:37 [WARNING ] (13, 1, 'bot')
2018-12-26 04:05:37 [WARNING ] (13, 1, 'bot')
2018-12-26 04:05:37 [WARNING ] (13, 1, 'bot')
2018-12-26 04:05:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:05:37 [DEBUG   ] Finished updating board flags in 2.003 seconds
2018-12-26 04:05:42 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-26 04:05:58 [DEBUG   ] Got command RPT from MCS: ref #954536
2018-12-26 04:05:58 [DEBUG   ] summary = ERROR
2018-12-26 04:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954536  13 58478 14758565 A  ERRORERROR'
2018-12-26 04:05:58 [DEBUG   ] Got command RPT from MCS: ref #954537
2018-12-26 04:05:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 04:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954537  77 58478 14758566 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 04:06:01 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-12-26 04:06:22 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-12-26 04:06:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:06:37 [WARNING ] (13, 1, 'bot')
2018-12-26 04:06:37 [WARNING ] (13, 1, 'bot')
2018-12-26 04:06:37 [WARNING ] (13, 1, 'bot')
2018-12-26 04:06:37 [WARNING ] (13, 1, 'bot')
2018-12-26 04:06:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:06:37 [DEBUG   ] Finished updating board flags in 1.997 seconds
2018-12-26 04:06:42 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-26 04:07:02 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 04:07:22 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-26 04:07:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:07:37 [WARNING ] (13, 1, 'bot')
2018-12-26 04:07:37 [WARNING ] (13, 1, 'bot')
2018-12-26 04:07:37 [WARNING ] (13, 1, 'bot')
2018-12-26 04:07:37 [WARNING ] (13, 1, 'bot')
2018-12-26 04:07:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:07:37 [DEBUG   ] Finished updating board flags in 1.804 seconds
2018-12-26 04:07:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 04:08:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 04:08:22 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 04:08:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 04:08:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:08:37 [WARNING ] (13, 1, 'bot')
2018-12-26 04:08:37 [WARNING ] (13, 1, 'bot')
2018-12-26 04:08:37 [WARNING ] (13, 1, 'bot')
2018-12-26 04:08:37 [WARNING ] (13, 1, 'bot')
2018-12-26 04:08:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:08:37 [DEBUG   ] Finished updating board flags in 1.799 seconds
2018-12-26 04:08:42 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-26 04:09:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 04:09:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 04:09:29 [DEBUG   ] Got command RPT from MCS: ref #954557
2018-12-26 04:09:29 [DEBUG   ] summary = ERROR
2018-12-26 04:09:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954557  13 58478 14969857 A  ERRORERROR'
2018-12-26 04:09:30 [DEBUG   ] Got command RPT from MCS: ref #954558
2018-12-26 04:09:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 04:09:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954558  77 58478 14970061 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 04:09:30 [DEBUG   ] Got command RPT from MCS: ref #954559
2018-12-26 04:09:30 [DEBUG   ] summary = ERROR
2018-12-26 04:09:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954559  13 58478 14970265 A  ERRORERROR'
2018-12-26 04:09:30 [DEBUG   ] Got command RPT from MCS: ref #954560
2018-12-26 04:09:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 04:09:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954560  77 58478 14970457 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 04:09:30 [DEBUG   ] Got command RPT from MCS: ref #954561
2018-12-26 04:09:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 04:09:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954561  12 58478 14970661 A  ERRORB˜™š'
2018-12-26 04:09:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:09:37 [WARNING ] (13, 1, 'bot')
2018-12-26 04:09:37 [WARNING ] (13, 1, 'bot')
2018-12-26 04:09:37 [WARNING ] (13, 1, 'bot')
2018-12-26 04:09:37 [WARNING ] (13, 1, 'bot')
2018-12-26 04:09:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:09:37 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-12-26 04:09:42 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 04:10:02 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-12-26 04:10:22 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-26 04:10:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:10:37 [WARNING ] (13, 1, 'bot')
2018-12-26 04:10:37 [WARNING ] (13, 1, 'bot')
2018-12-26 04:10:37 [WARNING ] (13, 1, 'bot')
2018-12-26 04:10:37 [WARNING ] (13, 1, 'bot')
2018-12-26 04:10:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:10:37 [DEBUG   ] Finished updating board flags in 1.588 seconds
2018-12-26 04:10:43 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-26 04:10:58 [DEBUG   ] Got command RPT from MCS: ref #954566
2018-12-26 04:10:58 [DEBUG   ] summary = ERROR
2018-12-26 04:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954566  13 58478 15058565 A  ERRORERROR'
2018-12-26 04:10:58 [DEBUG   ] Got command RPT from MCS: ref #954567
2018-12-26 04:10:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 04:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954567  77 58478 15058566 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 04:11:03 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-26 04:11:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 04:11:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:11:37 [WARNING ] (13, 1, 'bot')
2018-12-26 04:11:37 [WARNING ] (13, 1, 'bot')
2018-12-26 04:11:37 [WARNING ] (13, 1, 'bot')
2018-12-26 04:11:37 [WARNING ] (13, 1, 'bot')
2018-12-26 04:11:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:11:37 [DEBUG   ] Finished updating board flags in 1.412 seconds
2018-12-26 04:11:43 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-26 04:12:03 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-26 04:12:23 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-26 04:12:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:12:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-12-26 04:12:37 [WARNING ] (13, 1, 'bot')
2018-12-26 04:12:37 [WARNING ] (13, 1, 'bot')
2018-12-26 04:12:37 [WARNING ] (13, 1, 'bot')
2018-12-26 04:12:37 [WARNING ] (13, 1, 'bot')
2018-12-26 04:12:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:12:37 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-12-26 04:12:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 04:13:03 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 04:13:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 04:13:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:13:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 04:13:37 [WARNING ] (13, 1, 'bot')
2018-12-26 04:13:37 [WARNING ] (13, 1, 'bot')
2018-12-26 04:13:37 [WARNING ] (13, 1, 'bot')
2018-12-26 04:13:37 [WARNING ] (13, 1, 'bot')
2018-12-26 04:13:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:13:37 [DEBUG   ] Finished updating board flags in 1.507 seconds
2018-12-26 04:13:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 04:14:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 04:14:23 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 04:14:29 [DEBUG   ] Got command RPT from MCS: ref #954589
2018-12-26 04:14:29 [DEBUG   ] summary = ERROR
2018-12-26 04:14:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954589  13 58478 15269937 A  ERRORERROR'
2018-12-26 04:14:30 [DEBUG   ] Got command RPT from MCS: ref #954590
2018-12-26 04:14:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 04:14:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954590  77 58478 15270141 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 04:14:30 [DEBUG   ] Got command RPT from MCS: ref #954591
2018-12-26 04:14:30 [DEBUG   ] summary = ERROR
2018-12-26 04:14:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954591  13 58478 15270345 A  ERRORERROR'
2018-12-26 04:14:30 [DEBUG   ] Got command RPT from MCS: ref #954593
2018-12-26 04:14:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 04:14:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954593  77 58478 15270537 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 04:14:30 [DEBUG   ] Got command RPT from MCS: ref #954594
2018-12-26 04:14:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 04:14:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954594  12 58478 15270741 A  ERRORB™™š'
2018-12-26 04:14:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:14:37 [WARNING ] (13, 1, 'bot')
2018-12-26 04:14:37 [WARNING ] (13, 1, 'bot')
2018-12-26 04:14:37 [WARNING ] (13, 1, 'bot')
2018-12-26 04:14:37 [WARNING ] (13, 1, 'bot')
2018-12-26 04:14:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:14:37 [DEBUG   ] Finished updating board flags in 1.511 seconds
2018-12-26 04:14:43 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-26 04:15:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 04:15:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 04:15:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:15:38 [WARNING ] (13, 1, 'bot')
2018-12-26 04:15:38 [WARNING ] (13, 1, 'bot')
2018-12-26 04:15:38 [WARNING ] (13, 1, 'bot')
2018-12-26 04:15:38 [WARNING ] (13, 1, 'bot')
2018-12-26 04:15:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:15:38 [DEBUG   ] Finished updating board flags in 2.274 seconds
2018-12-26 04:15:43 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 04:15:58 [DEBUG   ] Got command RPT from MCS: ref #954603
2018-12-26 04:15:58 [DEBUG   ] summary = ERROR
2018-12-26 04:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954603  13 58478 15358561 A  ERRORERROR'
2018-12-26 04:15:58 [DEBUG   ] Got command RPT from MCS: ref #954604
2018-12-26 04:15:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 04:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954604  77 58478 15358562 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 04:16:03 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-26 04:16:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 04:16:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:16:38 [WARNING ] (13, 1, 'bot')
2018-12-26 04:16:38 [WARNING ] (13, 1, 'bot')
2018-12-26 04:16:38 [WARNING ] (13, 1, 'bot')
2018-12-26 04:16:38 [WARNING ] (13, 1, 'bot')
2018-12-26 04:16:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:16:38 [DEBUG   ] Finished updating board flags in 2.099 seconds
2018-12-26 04:16:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 04:17:03 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 04:17:23 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-26 04:17:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:17:38 [WARNING ] (13, 1, 'bot')
2018-12-26 04:17:38 [WARNING ] (13, 1, 'bot')
2018-12-26 04:17:38 [WARNING ] (13, 1, 'bot')
2018-12-26 04:17:38 [WARNING ] (13, 1, 'bot')
2018-12-26 04:17:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:17:38 [DEBUG   ] Finished updating board flags in 2.032 seconds
2018-12-26 04:17:44 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-26 04:18:04 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-26 04:18:24 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-26 04:18:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:18:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 04:18:38 [WARNING ] (13, 1, 'bot')
2018-12-26 04:18:38 [WARNING ] (13, 1, 'bot')
2018-12-26 04:18:38 [WARNING ] (13, 1, 'bot')
2018-12-26 04:18:38 [WARNING ] (13, 1, 'bot')
2018-12-26 04:18:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:18:38 [DEBUG   ] Finished updating board flags in 1.988 seconds
2018-12-26 04:18:44 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-26 04:19:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 04:19:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 04:19:30 [DEBUG   ] Got command RPT from MCS: ref #954624
2018-12-26 04:19:30 [DEBUG   ] summary = ERROR
2018-12-26 04:19:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954624  13 58478 15570021 A  ERRORERROR'
2018-12-26 04:19:30 [DEBUG   ] Got command RPT from MCS: ref #954625
2018-12-26 04:19:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 04:19:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954625  77 58478 15570213 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 04:19:30 [DEBUG   ] Got command RPT from MCS: ref #954626
2018-12-26 04:19:30 [DEBUG   ] summary = ERROR
2018-12-26 04:19:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954626  13 58478 15570417 A  ERRORERROR'
2018-12-26 04:19:30 [DEBUG   ] Got command RPT from MCS: ref #954627
2018-12-26 04:19:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 04:19:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954627  77 58478 15570621 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 04:19:30 [DEBUG   ] Got command RPT from MCS: ref #954628
2018-12-26 04:19:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 04:19:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954628  12 58478 15570825 A  ERRORB˜™š'
2018-12-26 04:19:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:19:38 [WARNING ] (13, 1, 'bot')
2018-12-26 04:19:38 [WARNING ] (13, 1, 'bot')
2018-12-26 04:19:38 [WARNING ] (13, 1, 'bot')
2018-12-26 04:19:38 [WARNING ] (13, 1, 'bot')
2018-12-26 04:19:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:19:38 [DEBUG   ] Finished updating board flags in 1.787 seconds
2018-12-26 04:19:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 04:20:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 04:20:24 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 04:20:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 04:20:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:20:38 [WARNING ] (13, 1, 'bot')
2018-12-26 04:20:38 [WARNING ] (13, 1, 'bot')
2018-12-26 04:20:38 [WARNING ] (13, 1, 'bot')
2018-12-26 04:20:38 [WARNING ] (13, 1, 'bot')
2018-12-26 04:20:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:20:38 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-12-26 04:20:44 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-26 04:20:58 [DEBUG   ] Got command RPT from MCS: ref #954629
2018-12-26 04:20:58 [DEBUG   ] summary = ERROR
2018-12-26 04:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954629  13 58478 15658569 A  ERRORERROR'
2018-12-26 04:20:58 [DEBUG   ] Got command RPT from MCS: ref #954630
2018-12-26 04:20:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 04:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954630  77 58478 15658570 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 04:21:04 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-26 04:21:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 04:21:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 04:21:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:21:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-12-26 04:21:38 [WARNING ] (13, 1, 'bot')
2018-12-26 04:21:38 [WARNING ] (13, 1, 'bot')
2018-12-26 04:21:38 [WARNING ] (13, 1, 'bot')
2018-12-26 04:21:38 [WARNING ] (13, 1, 'bot')
2018-12-26 04:21:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:21:38 [DEBUG   ] Finished updating board flags in 1.586 seconds
2018-12-26 04:21:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 04:22:04 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 04:22:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 04:22:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:22:38 [WARNING ] (13, 1, 'bot')
2018-12-26 04:22:38 [WARNING ] (13, 1, 'bot')
2018-12-26 04:22:38 [WARNING ] (13, 1, 'bot')
2018-12-26 04:22:38 [WARNING ] (13, 1, 'bot')
2018-12-26 04:22:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:22:38 [DEBUG   ] Finished updating board flags in 1.405 seconds
2018-12-26 04:22:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 04:23:04 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-12-26 04:23:24 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-26 04:23:37 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 04:23:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:23:38 [WARNING ] (13, 1, 'bot')
2018-12-26 04:23:38 [WARNING ] (13, 1, 'bot')
2018-12-26 04:23:38 [WARNING ] (13, 1, 'bot')
2018-12-26 04:23:38 [WARNING ] (13, 1, 'bot')
2018-12-26 04:23:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:23:38 [DEBUG   ] Finished updating board flags in 1.389 seconds
2018-12-26 04:23:44 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-26 04:24:04 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 04:24:25 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-26 04:24:30 [DEBUG   ] Got command RPT from MCS: ref #954652
2018-12-26 04:24:30 [DEBUG   ] summary = ERROR
2018-12-26 04:24:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954652  13 58478 15870093 A  ERRORERROR'
2018-12-26 04:24:30 [DEBUG   ] Got command RPT from MCS: ref #954653
2018-12-26 04:24:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 04:24:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954653  77 58478 15870297 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 04:24:30 [DEBUG   ] Got command RPT from MCS: ref #954654
2018-12-26 04:24:30 [DEBUG   ] summary = ERROR
2018-12-26 04:24:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954654  13 58478 15870501 A  ERRORERROR'
2018-12-26 04:24:30 [DEBUG   ] Got command RPT from MCS: ref #954656
2018-12-26 04:24:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 04:24:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954656  77 58478 15870693 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 04:24:30 [DEBUG   ] Got command RPT from MCS: ref #954658
2018-12-26 04:24:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 04:24:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954658  12 58478 15870897 A  ERRORB™™š'
2018-12-26 04:24:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:24:38 [WARNING ] (13, 1, 'bot')
2018-12-26 04:24:38 [WARNING ] (13, 1, 'bot')
2018-12-26 04:24:38 [WARNING ] (13, 1, 'bot')
2018-12-26 04:24:38 [WARNING ] (13, 1, 'bot')
2018-12-26 04:24:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:24:38 [DEBUG   ] Finished updating board flags in 1.376 seconds
2018-12-26 04:24:45 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-26 04:25:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 04:25:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 04:25:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:25:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 04:25:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:25:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:25:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:25:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:25:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:25:39 [DEBUG   ] Finished updating board flags in 2.048 seconds
2018-12-26 04:25:45 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 04:25:58 [DEBUG   ] Got command RPT from MCS: ref #954666
2018-12-26 04:25:58 [DEBUG   ] summary = ERROR
2018-12-26 04:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954666  13 58478 15958565 A  ERRORERROR'
2018-12-26 04:25:58 [DEBUG   ] Got command RPT from MCS: ref #954667
2018-12-26 04:25:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 04:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954667  77 58478 15958566 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 04:26:05 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 04:26:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 04:26:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2018-12-26 04:26:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:26:39 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 04:26:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:26:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:26:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:26:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:26:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:26:39 [DEBUG   ] Finished updating board flags in 2.094 seconds
2018-12-26 04:26:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 04:27:05 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 04:27:25 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-26 04:27:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 04:27:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:27:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:27:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:27:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:27:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:27:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:27:39 [DEBUG   ] Finished updating board flags in 2.013 seconds
2018-12-26 04:27:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 04:28:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 04:28:25 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-12-26 04:28:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:28:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 04:28:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:28:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:28:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:28:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:28:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:28:39 [DEBUG   ] Finished updating board flags in 1.888 seconds
2018-12-26 04:28:45 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-26 04:29:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 04:29:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 04:29:30 [DEBUG   ] Got command RPT from MCS: ref #954687
2018-12-26 04:29:30 [DEBUG   ] summary = ERROR
2018-12-26 04:29:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954687  13 58478 16170177 A  ERRORERROR'
2018-12-26 04:29:30 [DEBUG   ] Got command RPT from MCS: ref #954688
2018-12-26 04:29:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 04:29:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954688  77 58478 16170381 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 04:29:30 [DEBUG   ] Got command RPT from MCS: ref #954689
2018-12-26 04:29:30 [DEBUG   ] summary = ERROR
2018-12-26 04:29:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954689  13 58478 16170573 A  ERRORERROR'
2018-12-26 04:29:30 [DEBUG   ] Got command RPT from MCS: ref #954690
2018-12-26 04:29:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 04:29:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954690  77 58478 16170777 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 04:29:30 [DEBUG   ] Got command RPT from MCS: ref #954691
2018-12-26 04:29:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 04:29:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954691  12 58478 16170981 A  ERRORB˜™š'
2018-12-26 04:29:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:29:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:29:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:29:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:29:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:29:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:29:39 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-12-26 04:29:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 04:30:05 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-26 04:30:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 04:30:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:30:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:30:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:30:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:30:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:30:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:30:39 [DEBUG   ] Finished updating board flags in 1.791 seconds
2018-12-26 04:30:45 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-26 04:30:58 [DEBUG   ] Got command RPT from MCS: ref #954696
2018-12-26 04:30:58 [DEBUG   ] summary = ERROR
2018-12-26 04:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954696  13 58478 16258573 A  ERRORERROR'
2018-12-26 04:30:58 [DEBUG   ] Got command RPT from MCS: ref #954697
2018-12-26 04:30:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 04:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954697  77 58478 16258574 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 04:31:05 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-26 04:31:26 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-12-26 04:31:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:31:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:31:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:31:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:31:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:31:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:31:39 [DEBUG   ] Finished updating board flags in 1.608 seconds
2018-12-26 04:31:46 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-26 04:32:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 04:32:26 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-12-26 04:32:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 04:32:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:32:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:32:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:32:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:32:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:32:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:32:39 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-12-26 04:32:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 04:33:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 04:33:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 04:33:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:33:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:33:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:33:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:33:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:33:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:33:39 [DEBUG   ] Finished updating board flags in 1.582 seconds
2018-12-26 04:33:46 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-26 04:34:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 04:34:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 04:34:30 [DEBUG   ] Got command RPT from MCS: ref #954719
2018-12-26 04:34:30 [DEBUG   ] summary = ERROR
2018-12-26 04:34:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954719  13 58478 16470261 A  ERRORERROR'
2018-12-26 04:34:30 [DEBUG   ] Got command RPT from MCS: ref #954720
2018-12-26 04:34:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 04:34:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954720  77 58478 16470453 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 04:34:30 [DEBUG   ] Got command RPT from MCS: ref #954721
2018-12-26 04:34:30 [DEBUG   ] summary = ERROR
2018-12-26 04:34:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954721  13 58478 16470657 A  ERRORERROR'
2018-12-26 04:34:30 [DEBUG   ] Got command RPT from MCS: ref #954723
2018-12-26 04:34:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 04:34:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954723  77 58478 16470861 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 04:34:31 [DEBUG   ] Got command RPT from MCS: ref #954724
2018-12-26 04:34:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 04:34:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954724  12 58478 16471065 A  ERRORB–™š'
2018-12-26 04:34:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:34:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 04:34:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:34:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:34:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:34:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:34:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:34:39 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-12-26 04:34:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 04:35:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 04:35:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 04:35:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 04:35:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:35:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:35:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:35:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:35:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:35:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:35:39 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-12-26 04:35:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 04:35:58 [DEBUG   ] Got command RPT from MCS: ref #954729
2018-12-26 04:35:58 [DEBUG   ] summary = ERROR
2018-12-26 04:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954729  13 58478 16558565 A  ERRORERROR'
2018-12-26 04:35:58 [DEBUG   ] Got command RPT from MCS: ref #954730
2018-12-26 04:35:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 04:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954730  77 58478 16558566 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 04:36:06 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 04:36:26 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-26 04:36:38 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 04:36:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:36:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:36:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:36:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:36:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:36:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:36:39 [DEBUG   ] Finished updating board flags in 1.374 seconds
2018-12-26 04:36:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 04:37:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 04:37:26 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 04:37:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:37:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:37:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:37:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:37:39 [WARNING ] (13, 1, 'bot')
2018-12-26 04:37:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:37:39 [DEBUG   ] Finished updating board flags in 1.386 seconds
2018-12-26 04:37:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 04:38:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 04:38:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 04:38:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:38:40 [WARNING ] (13, 1, 'bot')
2018-12-26 04:38:40 [WARNING ] (13, 1, 'bot')
2018-12-26 04:38:40 [WARNING ] (13, 1, 'bot')
2018-12-26 04:38:40 [WARNING ] (13, 1, 'bot')
2018-12-26 04:38:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:38:40 [DEBUG   ] Finished updating board flags in 2.124 seconds
2018-12-26 04:38:46 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 04:39:06 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-26 04:39:26 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 04:39:30 [DEBUG   ] Got command RPT from MCS: ref #954750
2018-12-26 04:39:30 [DEBUG   ] summary = ERROR
2018-12-26 04:39:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954750  13 58478 16770345 A  ERRORERROR'
2018-12-26 04:39:30 [DEBUG   ] Got command RPT from MCS: ref #954751
2018-12-26 04:39:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 04:39:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954751  77 58478 16770537 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 04:39:30 [DEBUG   ] Got command RPT from MCS: ref #954752
2018-12-26 04:39:30 [DEBUG   ] summary = ERROR
2018-12-26 04:39:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954752  13 58478 16770741 A  ERRORERROR'
2018-12-26 04:39:30 [DEBUG   ] Got command RPT from MCS: ref #954753
2018-12-26 04:39:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 04:39:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954753  77 58478 16770945 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 04:39:31 [DEBUG   ] Got command RPT from MCS: ref #954754
2018-12-26 04:39:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 04:39:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954754  12 58478 16771137 A  ERRORB˜™š'
2018-12-26 04:39:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:39:40 [WARNING ] (13, 1, 'bot')
2018-12-26 04:39:40 [WARNING ] (13, 1, 'bot')
2018-12-26 04:39:40 [WARNING ] (13, 1, 'bot')
2018-12-26 04:39:40 [WARNING ] (13, 1, 'bot')
2018-12-26 04:39:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:39:40 [DEBUG   ] Finished updating board flags in 2.006 seconds
2018-12-26 04:39:46 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-26 04:40:07 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-26 04:40:27 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-26 04:40:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:40:40 [WARNING ] (13, 1, 'bot')
2018-12-26 04:40:40 [WARNING ] (13, 1, 'bot')
2018-12-26 04:40:40 [WARNING ] (13, 1, 'bot')
2018-12-26 04:40:40 [WARNING ] (13, 1, 'bot')
2018-12-26 04:40:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:40:40 [DEBUG   ] Finished updating board flags in 1.889 seconds
2018-12-26 04:40:47 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-26 04:40:58 [DEBUG   ] Got command RPT from MCS: ref #954759
2018-12-26 04:40:58 [DEBUG   ] summary = ERROR
2018-12-26 04:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954759  13 58478 16858569 A  ERRORERROR'
2018-12-26 04:40:58 [DEBUG   ] Got command RPT from MCS: ref #954760
2018-12-26 04:40:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 04:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954760  77 58478 16858570 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 04:41:07 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-26 04:41:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-26 04:41:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 04:41:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:41:40 [WARNING ] (13, 1, 'bot')
2018-12-26 04:41:40 [WARNING ] (13, 1, 'bot')
2018-12-26 04:41:40 [WARNING ] (13, 1, 'bot')
2018-12-26 04:41:40 [WARNING ] (13, 1, 'bot')
2018-12-26 04:41:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:41:40 [DEBUG   ] Finished updating board flags in 1.808 seconds
2018-12-26 04:41:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 04:42:07 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 04:42:27 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-26 04:42:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:42:40 [WARNING ] (13, 1, 'bot')
2018-12-26 04:42:40 [WARNING ] (13, 1, 'bot')
2018-12-26 04:42:40 [WARNING ] (13, 1, 'bot')
2018-12-26 04:42:40 [WARNING ] (13, 1, 'bot')
2018-12-26 04:42:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:42:40 [DEBUG   ] Finished updating board flags in 1.816 seconds
2018-12-26 04:42:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 04:43:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 04:43:27 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 04:43:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:43:40 [WARNING ] (13, 1, 'bot')
2018-12-26 04:43:40 [WARNING ] (13, 1, 'bot')
2018-12-26 04:43:40 [WARNING ] (13, 1, 'bot')
2018-12-26 04:43:40 [WARNING ] (13, 1, 'bot')
2018-12-26 04:43:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:43:40 [DEBUG   ] Finished updating board flags in 1.790 seconds
2018-12-26 04:43:47 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-26 04:44:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 04:44:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 04:44:30 [DEBUG   ] Got command RPT from MCS: ref #954782
2018-12-26 04:44:30 [DEBUG   ] summary = ERROR
2018-12-26 04:44:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954782  13 58478 17070421 A  ERRORERROR'
2018-12-26 04:44:30 [DEBUG   ] Got command RPT from MCS: ref #954783
2018-12-26 04:44:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 04:44:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954783  77 58478 17070625 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 04:44:30 [DEBUG   ] Got command RPT from MCS: ref #954784
2018-12-26 04:44:30 [DEBUG   ] summary = ERROR
2018-12-26 04:44:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954784  13 58478 17070817 A  ERRORERROR'
2018-12-26 04:44:31 [DEBUG   ] Got command RPT from MCS: ref #954786
2018-12-26 04:44:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 04:44:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954786  77 58478 17071021 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 04:44:31 [DEBUG   ] Got command RPT from MCS: ref #954787
2018-12-26 04:44:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 04:44:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954787  12 58478 17071225 A  ERRORB—™š'
2018-12-26 04:44:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:44:40 [WARNING ] (13, 1, 'bot')
2018-12-26 04:44:40 [WARNING ] (13, 1, 'bot')
2018-12-26 04:44:40 [WARNING ] (13, 1, 'bot')
2018-12-26 04:44:40 [WARNING ] (13, 1, 'bot')
2018-12-26 04:44:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:44:40 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-12-26 04:44:47 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 04:45:07 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-26 04:45:27 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 04:45:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:45:40 [WARNING ] (13, 1, 'bot')
2018-12-26 04:45:40 [WARNING ] (13, 1, 'bot')
2018-12-26 04:45:40 [WARNING ] (13, 1, 'bot')
2018-12-26 04:45:40 [WARNING ] (13, 1, 'bot')
2018-12-26 04:45:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:45:40 [DEBUG   ] Finished updating board flags in 1.588 seconds
2018-12-26 04:45:48 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-26 04:45:58 [DEBUG   ] Got command RPT from MCS: ref #954796
2018-12-26 04:45:58 [DEBUG   ] summary = ERROR
2018-12-26 04:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954796  13 58478 17158569 A  ERRORERROR'
2018-12-26 04:45:58 [DEBUG   ] Got command RPT from MCS: ref #954797
2018-12-26 04:45:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 04:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954797  77 58478 17158570 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 04:46:08 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-26 04:46:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 04:46:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:46:40 [WARNING ] (13, 1, 'bot')
2018-12-26 04:46:40 [WARNING ] (13, 1, 'bot')
2018-12-26 04:46:40 [WARNING ] (13, 1, 'bot')
2018-12-26 04:46:40 [WARNING ] (13, 1, 'bot')
2018-12-26 04:46:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:46:40 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-12-26 04:46:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 04:47:08 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 04:47:28 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-26 04:47:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:47:40 [WARNING ] (13, 1, 'bot')
2018-12-26 04:47:40 [WARNING ] (13, 1, 'bot')
2018-12-26 04:47:40 [WARNING ] (13, 1, 'bot')
2018-12-26 04:47:40 [WARNING ] (13, 1, 'bot')
2018-12-26 04:47:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:47:40 [DEBUG   ] Finished updating board flags in 1.434 seconds
2018-12-26 04:47:48 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-26 04:48:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 04:48:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 04:48:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 04:48:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-26 04:48:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:48:40 [WARNING ] (13, 1, 'bot')
2018-12-26 04:48:40 [WARNING ] (13, 1, 'bot')
2018-12-26 04:48:40 [WARNING ] (13, 1, 'bot')
2018-12-26 04:48:40 [WARNING ] (13, 1, 'bot')
2018-12-26 04:48:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:48:40 [DEBUG   ] Finished updating board flags in 1.357 seconds
2018-12-26 04:48:48 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-26 04:49:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 04:49:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 04:49:30 [DEBUG   ] Got command RPT from MCS: ref #954817
2018-12-26 04:49:30 [DEBUG   ] summary = ERROR
2018-12-26 04:49:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954817  13 58478 17370493 A  ERRORERROR'
2018-12-26 04:49:30 [DEBUG   ] Got command RPT from MCS: ref #954818
2018-12-26 04:49:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 04:49:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954818  77 58478 17370697 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 04:49:30 [DEBUG   ] Got command RPT from MCS: ref #954819
2018-12-26 04:49:30 [DEBUG   ] summary = ERROR
2018-12-26 04:49:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954819  13 58478 17370901 A  ERRORERROR'
2018-12-26 04:49:31 [DEBUG   ] Got command RPT from MCS: ref #954820
2018-12-26 04:49:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 04:49:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954820  77 58478 17371105 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 04:49:31 [DEBUG   ] Got command RPT from MCS: ref #954821
2018-12-26 04:49:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 04:49:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954821  12 58478 17371297 A  ERRORB˜™š'
2018-12-26 04:49:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:49:40 [WARNING ] (13, 1, 'bot')
2018-12-26 04:49:40 [WARNING ] (13, 1, 'bot')
2018-12-26 04:49:40 [WARNING ] (13, 1, 'bot')
2018-12-26 04:49:40 [WARNING ] (13, 1, 'bot')
2018-12-26 04:49:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:49:40 [DEBUG   ] Finished updating board flags in 1.372 seconds
2018-12-26 04:49:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 04:50:08 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-26 04:50:28 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 04:50:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:50:41 [WARNING ] (13, 1, 'bot')
2018-12-26 04:50:41 [WARNING ] (13, 1, 'bot')
2018-12-26 04:50:41 [WARNING ] (13, 1, 'bot')
2018-12-26 04:50:41 [WARNING ] (13, 1, 'bot')
2018-12-26 04:50:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:50:41 [DEBUG   ] Finished updating board flags in 2.045 seconds
2018-12-26 04:50:49 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-26 04:50:58 [DEBUG   ] Got command RPT from MCS: ref #954822
2018-12-26 04:50:58 [DEBUG   ] summary = ERROR
2018-12-26 04:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954822  13 58478 17458573 A  ERRORERROR'
2018-12-26 04:50:58 [DEBUG   ] Got command RPT from MCS: ref #954823
2018-12-26 04:50:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 04:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954823  77 58478 17458574 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 04:51:08 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-26 04:51:29 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-12-26 04:51:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:51:41 [WARNING ] (13, 1, 'bot')
2018-12-26 04:51:41 [WARNING ] (13, 1, 'bot')
2018-12-26 04:51:41 [WARNING ] (13, 1, 'bot')
2018-12-26 04:51:41 [WARNING ] (13, 1, 'bot')
2018-12-26 04:51:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:51:41 [DEBUG   ] Finished updating board flags in 2.011 seconds
2018-12-26 04:51:49 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-26 04:52:09 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 04:52:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 04:52:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:52:41 [WARNING ] (13, 1, 'bot')
2018-12-26 04:52:41 [WARNING ] (13, 1, 'bot')
2018-12-26 04:52:41 [WARNING ] (13, 1, 'bot')
2018-12-26 04:52:41 [WARNING ] (13, 1, 'bot')
2018-12-26 04:52:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:52:41 [DEBUG   ] Finished updating board flags in 1.981 seconds
2018-12-26 04:52:49 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-26 04:53:09 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 04:53:29 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 04:53:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:53:41 [WARNING ] (13, 1, 'bot')
2018-12-26 04:53:41 [WARNING ] (13, 1, 'bot')
2018-12-26 04:53:41 [WARNING ] (13, 1, 'bot')
2018-12-26 04:53:41 [WARNING ] (13, 1, 'bot')
2018-12-26 04:53:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:53:41 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-12-26 04:53:49 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-26 04:54:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 04:54:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 04:54:30 [DEBUG   ] Got command RPT from MCS: ref #954845
2018-12-26 04:54:30 [DEBUG   ] summary = ERROR
2018-12-26 04:54:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954845  13 58478 17670573 A  ERRORERROR'
2018-12-26 04:54:30 [DEBUG   ] Got command RPT from MCS: ref #954846
2018-12-26 04:54:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 04:54:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954846  77 58478 17670777 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 04:54:30 [DEBUG   ] Got command RPT from MCS: ref #954847
2018-12-26 04:54:30 [DEBUG   ] summary = ERROR
2018-12-26 04:54:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954847  13 58478 17670981 A  ERRORERROR'
2018-12-26 04:54:31 [DEBUG   ] Got command RPT from MCS: ref #954849
2018-12-26 04:54:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 04:54:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954849  77 58478 17671185 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 04:54:31 [DEBUG   ] Got command RPT from MCS: ref #954850
2018-12-26 04:54:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 04:54:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954850  12 58478 17671377 A  ERRORB˜™š'
2018-12-26 04:54:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:54:41 [WARNING ] (13, 1, 'bot')
2018-12-26 04:54:41 [WARNING ] (13, 1, 'bot')
2018-12-26 04:54:41 [WARNING ] (13, 1, 'bot')
2018-12-26 04:54:41 [WARNING ] (13, 1, 'bot')
2018-12-26 04:54:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:54:41 [DEBUG   ] Finished updating board flags in 1.796 seconds
2018-12-26 04:54:49 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 04:55:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 04:55:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 04:55:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:55:41 [WARNING ] (13, 1, 'bot')
2018-12-26 04:55:41 [WARNING ] (13, 1, 'bot')
2018-12-26 04:55:41 [WARNING ] (13, 1, 'bot')
2018-12-26 04:55:41 [WARNING ] (13, 1, 'bot')
2018-12-26 04:55:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:55:41 [DEBUG   ] Finished updating board flags in 1.639 seconds
2018-12-26 04:55:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 04:55:58 [DEBUG   ] Got command RPT from MCS: ref #954859
2018-12-26 04:55:58 [DEBUG   ] summary = ERROR
2018-12-26 04:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954859  13 58478 17758577 A  ERRORERROR'
2018-12-26 04:55:58 [DEBUG   ] Got command RPT from MCS: ref #954860
2018-12-26 04:55:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 04:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954860  77 58478 17758578 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 04:56:09 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-12-26 04:56:29 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-26 04:56:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:56:41 [WARNING ] (13, 1, 'bot')
2018-12-26 04:56:41 [WARNING ] (13, 1, 'bot')
2018-12-26 04:56:41 [WARNING ] (13, 1, 'bot')
2018-12-26 04:56:41 [WARNING ] (13, 1, 'bot')
2018-12-26 04:56:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:56:41 [DEBUG   ] Finished updating board flags in 1.579 seconds
2018-12-26 04:56:49 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-26 04:57:10 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-26 04:57:30 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-26 04:57:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:57:42 [WARNING ] (13, 1, 'bot')
2018-12-26 04:57:42 [WARNING ] (13, 1, 'bot')
2018-12-26 04:57:42 [WARNING ] (13, 1, 'bot')
2018-12-26 04:57:42 [WARNING ] (13, 1, 'bot')
2018-12-26 04:57:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:57:42 [DEBUG   ] Finished updating board flags in 1.788 seconds
2018-12-26 04:57:50 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-26 04:58:10 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 04:58:30 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 04:58:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:58:41 [WARNING ] (13, 1, 'bot')
2018-12-26 04:58:41 [WARNING ] (13, 1, 'bot')
2018-12-26 04:58:41 [WARNING ] (13, 1, 'bot')
2018-12-26 04:58:41 [WARNING ] (13, 1, 'bot')
2018-12-26 04:58:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:58:41 [DEBUG   ] Finished updating board flags in 1.327 seconds
2018-12-26 04:58:50 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-26 04:59:10 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 04:59:30 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 04:59:30 [DEBUG   ] Got command RPT from MCS: ref #954880
2018-12-26 04:59:30 [DEBUG   ] summary = ERROR
2018-12-26 04:59:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954880  13 58478 17970661 A  ERRORERROR'
2018-12-26 04:59:30 [DEBUG   ] Got command RPT from MCS: ref #954881
2018-12-26 04:59:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 04:59:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954881  77 58478 17970853 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 04:59:31 [DEBUG   ] Got command RPT from MCS: ref #954882
2018-12-26 04:59:31 [DEBUG   ] summary = ERROR
2018-12-26 04:59:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954882  13 58478 17971057 A  ERRORERROR'
2018-12-26 04:59:31 [DEBUG   ] Got command RPT from MCS: ref #954883
2018-12-26 04:59:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 04:59:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954883  77 58478 17971261 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 04:59:31 [DEBUG   ] Got command RPT from MCS: ref #954884
2018-12-26 04:59:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 04:59:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954884  12 58478 17971465 A  ERRORB–™š'
2018-12-26 04:59:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 04:59:42 [WARNING ] (13, 1, 'bot')
2018-12-26 04:59:42 [WARNING ] (13, 1, 'bot')
2018-12-26 04:59:42 [WARNING ] (13, 1, 'bot')
2018-12-26 04:59:42 [WARNING ] (13, 1, 'bot')
2018-12-26 04:59:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 04:59:42 [DEBUG   ] Finished updating board flags in 2.092 seconds
2018-12-26 04:59:50 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 05:00:10 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-26 05:00:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 05:00:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:00:42 [WARNING ] (13, 1, 'bot')
2018-12-26 05:00:42 [WARNING ] (13, 1, 'bot')
2018-12-26 05:00:42 [WARNING ] (13, 1, 'bot')
2018-12-26 05:00:42 [WARNING ] (13, 1, 'bot')
2018-12-26 05:00:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:00:42 [DEBUG   ] Finished updating board flags in 1.990 seconds
2018-12-26 05:00:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 05:00:58 [DEBUG   ] Got command RPT from MCS: ref #954889
2018-12-26 05:00:58 [DEBUG   ] summary = ERROR
2018-12-26 05:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954889  13 58478 18058581 A  ERRORERROR'
2018-12-26 05:00:58 [DEBUG   ] Got command RPT from MCS: ref #954890
2018-12-26 05:00:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 05:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954890  77 58478 18058582 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 05:01:10 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-26 05:01:30 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-12-26 05:01:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:01:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-26 05:01:42 [WARNING ] (13, 1, 'bot')
2018-12-26 05:01:42 [WARNING ] (13, 1, 'bot')
2018-12-26 05:01:42 [WARNING ] (13, 1, 'bot')
2018-12-26 05:01:42 [WARNING ] (13, 1, 'bot')
2018-12-26 05:01:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:01:42 [DEBUG   ] Finished updating board flags in 1.851 seconds
2018-12-26 05:01:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 05:02:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 05:02:30 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-12-26 05:02:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:02:42 [WARNING ] (13, 1, 'bot')
2018-12-26 05:02:42 [WARNING ] (13, 1, 'bot')
2018-12-26 05:02:42 [WARNING ] (13, 1, 'bot')
2018-12-26 05:02:42 [WARNING ] (13, 1, 'bot')
2018-12-26 05:02:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:02:42 [DEBUG   ] Finished updating board flags in 1.749 seconds
2018-12-26 05:02:50 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-26 05:03:10 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-26 05:03:31 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-26 05:03:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:03:42 [WARNING ] (13, 1, 'bot')
2018-12-26 05:03:42 [WARNING ] (13, 1, 'bot')
2018-12-26 05:03:42 [WARNING ] (13, 1, 'bot')
2018-12-26 05:03:42 [WARNING ] (13, 1, 'bot')
2018-12-26 05:03:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:03:42 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-12-26 05:03:51 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-26 05:04:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 05:04:30 [DEBUG   ] Got command RPT from MCS: ref #954912
2018-12-26 05:04:30 [DEBUG   ] summary = ERROR
2018-12-26 05:04:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954912  13 58478 18270733 A  ERRORERROR'
2018-12-26 05:04:30 [DEBUG   ] Got command RPT from MCS: ref #954913
2018-12-26 05:04:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 05:04:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954913  77 58478 18270937 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 05:04:31 [DEBUG   ] Got command RPT from MCS: ref #954914
2018-12-26 05:04:31 [DEBUG   ] summary = ERROR
2018-12-26 05:04:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954914  13 58478 18271141 A  ERRORERROR'
2018-12-26 05:04:31 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 05:04:31 [DEBUG   ] Got command RPT from MCS: ref #954916
2018-12-26 05:04:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 05:04:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954916  77 58478 18271333 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 05:04:31 [DEBUG   ] Got command RPT from MCS: ref #954917
2018-12-26 05:04:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 05:04:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954917  12 58478 18271537 A  ERRORB—™š'
2018-12-26 05:04:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:04:42 [WARNING ] (13, 1, 'bot')
2018-12-26 05:04:42 [WARNING ] (13, 1, 'bot')
2018-12-26 05:04:42 [WARNING ] (13, 1, 'bot')
2018-12-26 05:04:42 [WARNING ] (13, 1, 'bot')
2018-12-26 05:04:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:04:42 [DEBUG   ] Finished updating board flags in 1.589 seconds
2018-12-26 05:04:51 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-26 05:05:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 05:05:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 05:05:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:05:42 [WARNING ] (13, 1, 'bot')
2018-12-26 05:05:42 [WARNING ] (13, 1, 'bot')
2018-12-26 05:05:42 [WARNING ] (13, 1, 'bot')
2018-12-26 05:05:42 [WARNING ] (13, 1, 'bot')
2018-12-26 05:05:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:05:42 [DEBUG   ] Finished updating board flags in 1.412 seconds
2018-12-26 05:05:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 05:05:58 [DEBUG   ] Got command RPT from MCS: ref #954922
2018-12-26 05:05:58 [DEBUG   ] summary = ERROR
2018-12-26 05:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954922  13 58478 18358581 A  ERRORERROR'
2018-12-26 05:05:58 [DEBUG   ] Got command RPT from MCS: ref #954923
2018-12-26 05:05:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 05:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954923  77 58478 18358582 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 05:06:11 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-26 05:06:31 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-12-26 05:06:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:06:42 [WARNING ] (13, 1, 'bot')
2018-12-26 05:06:42 [WARNING ] (13, 1, 'bot')
2018-12-26 05:06:42 [WARNING ] (13, 1, 'bot')
2018-12-26 05:06:42 [WARNING ] (13, 1, 'bot')
2018-12-26 05:06:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:06:42 [DEBUG   ] Finished updating board flags in 1.411 seconds
2018-12-26 05:06:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 05:07:11 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 05:07:31 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-26 05:07:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:07:42 [WARNING ] (13, 1, 'bot')
2018-12-26 05:07:42 [WARNING ] (13, 1, 'bot')
2018-12-26 05:07:42 [WARNING ] (13, 1, 'bot')
2018-12-26 05:07:42 [WARNING ] (13, 1, 'bot')
2018-12-26 05:07:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:07:42 [DEBUG   ] Finished updating board flags in 1.390 seconds
2018-12-26 05:07:52 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-26 05:08:12 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-26 05:08:32 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-26 05:08:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:08:42 [WARNING ] (13, 1, 'bot')
2018-12-26 05:08:42 [WARNING ] (13, 1, 'bot')
2018-12-26 05:08:42 [WARNING ] (13, 1, 'bot')
2018-12-26 05:08:42 [WARNING ] (13, 1, 'bot')
2018-12-26 05:08:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:08:42 [DEBUG   ] Finished updating board flags in 1.350 seconds
2018-12-26 05:08:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 05:09:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 05:09:30 [DEBUG   ] Got command RPT from MCS: ref #954943
2018-12-26 05:09:30 [DEBUG   ] summary = ERROR
2018-12-26 05:09:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954943  13 58478 18570813 A  ERRORERROR'
2018-12-26 05:09:31 [DEBUG   ] Got command RPT from MCS: ref #954944
2018-12-26 05:09:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 05:09:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954944  77 58478 18571017 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 05:09:31 [DEBUG   ] Got command RPT from MCS: ref #954945
2018-12-26 05:09:31 [DEBUG   ] summary = ERROR
2018-12-26 05:09:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954945  13 58478 18571221 A  ERRORERROR'
2018-12-26 05:09:31 [DEBUG   ] Got command RPT from MCS: ref #954946
2018-12-26 05:09:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 05:09:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954946  77 58478 18571417 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 05:09:31 [DEBUG   ] Got command RPT from MCS: ref #954947
2018-12-26 05:09:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 05:09:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954947  12 58478 18571621 A  ERRORB—™š'
2018-12-26 05:09:32 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 05:09:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:09:43 [WARNING ] (13, 1, 'bot')
2018-12-26 05:09:43 [WARNING ] (13, 1, 'bot')
2018-12-26 05:09:43 [WARNING ] (13, 1, 'bot')
2018-12-26 05:09:43 [WARNING ] (13, 1, 'bot')
2018-12-26 05:09:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:09:43 [DEBUG   ] Finished updating board flags in 2.064 seconds
2018-12-26 05:09:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 05:10:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 05:10:32 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 05:10:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:10:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-26 05:10:43 [WARNING ] (13, 1, 'bot')
2018-12-26 05:10:43 [WARNING ] (13, 1, 'bot')
2018-12-26 05:10:43 [WARNING ] (13, 1, 'bot')
2018-12-26 05:10:43 [WARNING ] (13, 1, 'bot')
2018-12-26 05:10:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:10:43 [DEBUG   ] Finished updating board flags in 2.042 seconds
2018-12-26 05:10:52 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-26 05:10:58 [DEBUG   ] Got command RPT from MCS: ref #954952
2018-12-26 05:10:58 [DEBUG   ] summary = ERROR
2018-12-26 05:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954952  13 58478 18658577 A  ERRORERROR'
2018-12-26 05:10:58 [DEBUG   ] Got command RPT from MCS: ref #954953
2018-12-26 05:10:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 05:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954953  77 58478 18658578 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 05:11:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 05:11:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 05:11:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:11:43 [WARNING ] (13, 1, 'bot')
2018-12-26 05:11:43 [WARNING ] (13, 1, 'bot')
2018-12-26 05:11:43 [WARNING ] (13, 1, 'bot')
2018-12-26 05:11:43 [WARNING ] (13, 1, 'bot')
2018-12-26 05:11:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:11:43 [DEBUG   ] Finished updating board flags in 1.947 seconds
2018-12-26 05:11:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 05:12:12 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-12-26 05:12:32 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-26 05:12:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:12:43 [WARNING ] (13, 1, 'bot')
2018-12-26 05:12:43 [WARNING ] (13, 1, 'bot')
2018-12-26 05:12:43 [WARNING ] (13, 1, 'bot')
2018-12-26 05:12:43 [WARNING ] (13, 1, 'bot')
2018-12-26 05:12:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:12:43 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-12-26 05:12:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 05:13:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 05:13:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 05:13:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:13:43 [WARNING ] (13, 1, 'bot')
2018-12-26 05:13:43 [WARNING ] (13, 1, 'bot')
2018-12-26 05:13:43 [WARNING ] (13, 1, 'bot')
2018-12-26 05:13:43 [WARNING ] (13, 1, 'bot')
2018-12-26 05:13:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:13:43 [DEBUG   ] Finished updating board flags in 1.808 seconds
2018-12-26 05:13:52 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-26 05:14:12 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 05:14:30 [DEBUG   ] Got command RPT from MCS: ref #954975
2018-12-26 05:14:30 [DEBUG   ] summary = ERROR
2018-12-26 05:14:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954975  13 58478 18870901 A  ERRORERROR'
2018-12-26 05:14:31 [DEBUG   ] Got command RPT from MCS: ref #954976
2018-12-26 05:14:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 05:14:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954976  77 58478 18871105 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 05:14:31 [DEBUG   ] Got command RPT from MCS: ref #954977
2018-12-26 05:14:31 [DEBUG   ] summary = ERROR
2018-12-26 05:14:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954977  13 58478 18871297 A  ERRORERROR'
2018-12-26 05:14:31 [DEBUG   ] Got command RPT from MCS: ref #954979
2018-12-26 05:14:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 05:14:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954979  77 58478 18871501 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 05:14:31 [DEBUG   ] Got command RPT from MCS: ref #954980
2018-12-26 05:14:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 05:14:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954980  12 58478 18871705 A  ERRORB–™š'
2018-12-26 05:14:33 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-26 05:14:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:14:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-26 05:14:43 [WARNING ] (13, 1, 'bot')
2018-12-26 05:14:43 [WARNING ] (13, 1, 'bot')
2018-12-26 05:14:43 [WARNING ] (13, 1, 'bot')
2018-12-26 05:14:43 [WARNING ] (13, 1, 'bot')
2018-12-26 05:14:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:14:43 [DEBUG   ] Finished updating board flags in 1.798 seconds
2018-12-26 05:14:53 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-26 05:15:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 05:15:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 05:15:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:15:43 [WARNING ] (13, 1, 'bot')
2018-12-26 05:15:43 [WARNING ] (13, 1, 'bot')
2018-12-26 05:15:43 [WARNING ] (13, 1, 'bot')
2018-12-26 05:15:43 [WARNING ] (13, 1, 'bot')
2018-12-26 05:15:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:15:43 [DEBUG   ] Finished updating board flags in 1.596 seconds
2018-12-26 05:15:53 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 05:15:58 [DEBUG   ] Got command RPT from MCS: ref #954989
2018-12-26 05:15:58 [DEBUG   ] summary = ERROR
2018-12-26 05:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954989  13 58478 18958577 A  ERRORERROR'
2018-12-26 05:15:58 [DEBUG   ] Got command RPT from MCS: ref #954990
2018-12-26 05:15:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 05:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   954990  77 58478 18958578 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 05:16:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 05:16:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 05:16:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:16:43 [WARNING ] (13, 1, 'bot')
2018-12-26 05:16:43 [WARNING ] (13, 1, 'bot')
2018-12-26 05:16:43 [WARNING ] (13, 1, 'bot')
2018-12-26 05:16:43 [WARNING ] (13, 1, 'bot')
2018-12-26 05:16:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:16:43 [DEBUG   ] Finished updating board flags in 1.449 seconds
2018-12-26 05:16:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 05:17:13 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 05:17:33 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-26 05:17:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:17:43 [WARNING ] (13, 1, 'bot')
2018-12-26 05:17:43 [WARNING ] (13, 1, 'bot')
2018-12-26 05:17:43 [WARNING ] (13, 1, 'bot')
2018-12-26 05:17:43 [WARNING ] (13, 1, 'bot')
2018-12-26 05:17:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:17:43 [DEBUG   ] Finished updating board flags in 1.569 seconds
2018-12-26 05:17:53 [DEBUG   ] Finished updating ant stats in 0.990 seconds
2018-12-26 05:18:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 05:18:33 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2018-12-26 05:18:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:18:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 05:18:44 [WARNING ] (13, 1, 'bot')
2018-12-26 05:18:44 [WARNING ] (13, 1, 'bot')
2018-12-26 05:18:44 [WARNING ] (13, 1, 'bot')
2018-12-26 05:18:44 [WARNING ] (13, 1, 'bot')
2018-12-26 05:18:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:18:44 [DEBUG   ] Finished updating board flags in 2.280 seconds
2018-12-26 05:18:53 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-26 05:19:13 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 05:19:30 [DEBUG   ] Got command RPT from MCS: ref #955010
2018-12-26 05:19:30 [DEBUG   ] summary = ERROR
2018-12-26 05:19:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955010  13 58478 19170977 A  ERRORERROR'
2018-12-26 05:19:31 [DEBUG   ] Got command RPT from MCS: ref #955011
2018-12-26 05:19:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 05:19:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955011  77 58478 19171181 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 05:19:31 [DEBUG   ] Got command RPT from MCS: ref #955012
2018-12-26 05:19:31 [DEBUG   ] summary = ERROR
2018-12-26 05:19:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955012  13 58478 19171385 A  ERRORERROR'
2018-12-26 05:19:31 [DEBUG   ] Got command RPT from MCS: ref #955013
2018-12-26 05:19:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 05:19:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955013  77 58478 19171577 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 05:19:31 [DEBUG   ] Got command RPT from MCS: ref #955014
2018-12-26 05:19:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 05:19:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955014  12 58478 19171781 A  ERRORB—™š'
2018-12-26 05:19:33 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 05:19:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:19:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 05:19:44 [WARNING ] (13, 1, 'bot')
2018-12-26 05:19:44 [WARNING ] (13, 1, 'bot')
2018-12-26 05:19:44 [WARNING ] (13, 1, 'bot')
2018-12-26 05:19:44 [WARNING ] (13, 1, 'bot')
2018-12-26 05:19:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:19:44 [DEBUG   ] Finished updating board flags in 2.107 seconds
2018-12-26 05:19:54 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-26 05:20:14 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-26 05:20:34 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 05:20:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:20:44 [WARNING ] (13, 1, 'bot')
2018-12-26 05:20:44 [WARNING ] (13, 1, 'bot')
2018-12-26 05:20:44 [WARNING ] (13, 1, 'bot')
2018-12-26 05:20:44 [WARNING ] (13, 1, 'bot')
2018-12-26 05:20:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:20:44 [DEBUG   ] Finished updating board flags in 2.031 seconds
2018-12-26 05:20:54 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 05:20:58 [DEBUG   ] Got command RPT from MCS: ref #955015
2018-12-26 05:20:58 [DEBUG   ] summary = ERROR
2018-12-26 05:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955015  13 58478 19258577 A  ERRORERROR'
2018-12-26 05:20:58 [DEBUG   ] Got command RPT from MCS: ref #955016
2018-12-26 05:20:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 05:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955016  77 58478 19258578 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 05:21:14 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-26 05:21:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 05:21:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 05:21:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:21:44 [WARNING ] (13, 1, 'bot')
2018-12-26 05:21:44 [WARNING ] (13, 1, 'bot')
2018-12-26 05:21:44 [WARNING ] (13, 1, 'bot')
2018-12-26 05:21:44 [WARNING ] (13, 1, 'bot')
2018-12-26 05:21:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:21:44 [DEBUG   ] Finished updating board flags in 1.985 seconds
2018-12-26 05:21:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 05:22:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 05:22:34 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-26 05:22:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:22:44 [WARNING ] (13, 1, 'bot')
2018-12-26 05:22:44 [WARNING ] (13, 1, 'bot')
2018-12-26 05:22:44 [WARNING ] (13, 1, 'bot')
2018-12-26 05:22:44 [WARNING ] (13, 1, 'bot')
2018-12-26 05:22:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:22:44 [DEBUG   ] Finished updating board flags in 1.803 seconds
2018-12-26 05:22:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 05:23:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 05:23:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 05:23:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:23:44 [WARNING ] (13, 1, 'bot')
2018-12-26 05:23:44 [WARNING ] (13, 1, 'bot')
2018-12-26 05:23:44 [WARNING ] (13, 1, 'bot')
2018-12-26 05:23:44 [WARNING ] (13, 1, 'bot')
2018-12-26 05:23:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:23:44 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-12-26 05:23:54 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-26 05:24:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 05:24:31 [DEBUG   ] Got command RPT from MCS: ref #955038
2018-12-26 05:24:31 [DEBUG   ] summary = ERROR
2018-12-26 05:24:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955038  13 58478 19471053 A  ERRORERROR'
2018-12-26 05:24:31 [DEBUG   ] Got command RPT from MCS: ref #955039
2018-12-26 05:24:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 05:24:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955039  77 58478 19471257 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 05:24:31 [DEBUG   ] Got command RPT from MCS: ref #955040
2018-12-26 05:24:31 [DEBUG   ] summary = ERROR
2018-12-26 05:24:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955040  13 58478 19471461 A  ERRORERROR'
2018-12-26 05:24:31 [DEBUG   ] Got command RPT from MCS: ref #955042
2018-12-26 05:24:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 05:24:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955042  77 58478 19471665 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 05:24:31 [DEBUG   ] Got command RPT from MCS: ref #955043
2018-12-26 05:24:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 05:24:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955043  12 58478 19471857 A  ERRORB—™š'
2018-12-26 05:24:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 05:24:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:24:44 [WARNING ] (13, 1, 'bot')
2018-12-26 05:24:44 [WARNING ] (13, 1, 'bot')
2018-12-26 05:24:44 [WARNING ] (13, 1, 'bot')
2018-12-26 05:24:44 [WARNING ] (13, 1, 'bot')
2018-12-26 05:24:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:24:44 [DEBUG   ] Finished updating board flags in 1.783 seconds
2018-12-26 05:24:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 05:25:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 05:25:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 05:25:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:25:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 05:25:44 [WARNING ] (13, 1, 'bot')
2018-12-26 05:25:44 [WARNING ] (13, 1, 'bot')
2018-12-26 05:25:44 [WARNING ] (13, 1, 'bot')
2018-12-26 05:25:44 [WARNING ] (13, 1, 'bot')
2018-12-26 05:25:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:25:44 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-12-26 05:25:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 05:25:58 [DEBUG   ] Got command RPT from MCS: ref #955052
2018-12-26 05:25:58 [DEBUG   ] summary = ERROR
2018-12-26 05:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955052  13 58478 19558581 A  ERRORERROR'
2018-12-26 05:25:58 [DEBUG   ] Got command RPT from MCS: ref #955053
2018-12-26 05:25:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 05:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955053  77 58478 19558582 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 05:26:14 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 05:26:34 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-26 05:26:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:26:44 [WARNING ] (13, 1, 'bot')
2018-12-26 05:26:44 [WARNING ] (13, 1, 'bot')
2018-12-26 05:26:44 [WARNING ] (13, 1, 'bot')
2018-12-26 05:26:44 [WARNING ] (13, 1, 'bot')
2018-12-26 05:26:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:26:44 [DEBUG   ] Finished updating board flags in 1.596 seconds
2018-12-26 05:26:54 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-26 05:27:15 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-26 05:27:35 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-26 05:27:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:27:44 [WARNING ] (13, 1, 'bot')
2018-12-26 05:27:44 [WARNING ] (13, 1, 'bot')
2018-12-26 05:27:44 [WARNING ] (13, 1, 'bot')
2018-12-26 05:27:44 [WARNING ] (13, 1, 'bot')
2018-12-26 05:27:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:27:44 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-12-26 05:27:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 05:28:15 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 05:28:35 [DEBUG   ] Finished updating ant stats in 1.098 seconds
2018-12-26 05:28:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:28:44 [WARNING ] (13, 1, 'bot')
2018-12-26 05:28:44 [WARNING ] (13, 1, 'bot')
2018-12-26 05:28:44 [WARNING ] (13, 1, 'bot')
2018-12-26 05:28:44 [WARNING ] (13, 1, 'bot')
2018-12-26 05:28:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:28:44 [DEBUG   ] Finished updating board flags in 1.380 seconds
2018-12-26 05:28:55 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-26 05:29:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 05:29:31 [DEBUG   ] Got command RPT from MCS: ref #955073
2018-12-26 05:29:31 [DEBUG   ] summary = ERROR
2018-12-26 05:29:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955073  13 58478 19771145 A  ERRORERROR'
2018-12-26 05:29:31 [DEBUG   ] Got command RPT from MCS: ref #955074
2018-12-26 05:29:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 05:29:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955074  77 58478 19771337 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 05:29:31 [DEBUG   ] Got command RPT from MCS: ref #955075
2018-12-26 05:29:31 [DEBUG   ] summary = ERROR
2018-12-26 05:29:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955075  13 58478 19771541 A  ERRORERROR'
2018-12-26 05:29:31 [DEBUG   ] Got command RPT from MCS: ref #955076
2018-12-26 05:29:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 05:29:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955076  77 58478 19771745 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 05:29:31 [DEBUG   ] Got command RPT from MCS: ref #955077
2018-12-26 05:29:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 05:29:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955077  12 58478 19771949 A  ERRORB–™š'
2018-12-26 05:29:35 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 05:29:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:29:44 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-26 05:29:44 [WARNING ] (13, 1, 'bot')
2018-12-26 05:29:44 [WARNING ] (13, 1, 'bot')
2018-12-26 05:29:44 [WARNING ] (13, 1, 'bot')
2018-12-26 05:29:44 [WARNING ] (13, 1, 'bot')
2018-12-26 05:29:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:29:44 [DEBUG   ] Finished updating board flags in 1.394 seconds
2018-12-26 05:29:55 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-26 05:30:15 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-26 05:30:35 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 05:30:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:30:45 [WARNING ] (13, 1, 'bot')
2018-12-26 05:30:45 [WARNING ] (13, 1, 'bot')
2018-12-26 05:30:45 [WARNING ] (13, 1, 'bot')
2018-12-26 05:30:45 [WARNING ] (13, 1, 'bot')
2018-12-26 05:30:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:30:45 [DEBUG   ] Finished updating board flags in 2.026 seconds
2018-12-26 05:30:55 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-26 05:30:58 [DEBUG   ] Got command RPT from MCS: ref #955082
2018-12-26 05:30:58 [DEBUG   ] summary = ERROR
2018-12-26 05:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955082  13 58478 19858581 A  ERRORERROR'
2018-12-26 05:30:58 [DEBUG   ] Got command RPT from MCS: ref #955083
2018-12-26 05:30:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 05:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955083  77 58478 19858582 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 05:31:15 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-26 05:31:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 05:31:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:31:45 [WARNING ] (13, 1, 'bot')
2018-12-26 05:31:45 [WARNING ] (13, 1, 'bot')
2018-12-26 05:31:45 [WARNING ] (13, 1, 'bot')
2018-12-26 05:31:45 [WARNING ] (13, 1, 'bot')
2018-12-26 05:31:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:31:45 [DEBUG   ] Finished updating board flags in 1.987 seconds
2018-12-26 05:31:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 05:32:15 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 05:32:35 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-26 05:32:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:32:45 [WARNING ] (13, 1, 'bot')
2018-12-26 05:32:45 [WARNING ] (13, 1, 'bot')
2018-12-26 05:32:45 [WARNING ] (13, 1, 'bot')
2018-12-26 05:32:45 [WARNING ] (13, 1, 'bot')
2018-12-26 05:32:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:32:45 [DEBUG   ] Finished updating board flags in 1.861 seconds
2018-12-26 05:32:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 05:33:16 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-12-26 05:33:36 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 05:33:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:33:45 [WARNING ] (13, 1, 'bot')
2018-12-26 05:33:45 [WARNING ] (13, 1, 'bot')
2018-12-26 05:33:45 [WARNING ] (13, 1, 'bot')
2018-12-26 05:33:45 [WARNING ] (13, 1, 'bot')
2018-12-26 05:33:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:33:45 [DEBUG   ] Finished updating board flags in 1.745 seconds
2018-12-26 05:33:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 05:34:16 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 05:34:31 [DEBUG   ] Got command RPT from MCS: ref #955105
2018-12-26 05:34:31 [DEBUG   ] summary = ERROR
2018-12-26 05:34:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955105  13 58478 20071225 A  ERRORERROR'
2018-12-26 05:34:31 [DEBUG   ] Got command RPT from MCS: ref #955106
2018-12-26 05:34:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 05:34:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955106  77 58478 20071417 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 05:34:31 [DEBUG   ] Got command RPT from MCS: ref #955107
2018-12-26 05:34:31 [DEBUG   ] summary = ERROR
2018-12-26 05:34:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955107  13 58478 20071621 A  ERRORERROR'
2018-12-26 05:34:31 [DEBUG   ] Got command RPT from MCS: ref #955109
2018-12-26 05:34:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 05:34:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955109  77 58478 20071825 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 05:34:32 [DEBUG   ] Got command RPT from MCS: ref #955110
2018-12-26 05:34:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 05:34:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955110  12 58478 20072017 A  ERRORB—™š'
2018-12-26 05:34:36 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 05:34:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:34:45 [WARNING ] (13, 1, 'bot')
2018-12-26 05:34:45 [WARNING ] (13, 1, 'bot')
2018-12-26 05:34:45 [WARNING ] (13, 1, 'bot')
2018-12-26 05:34:45 [WARNING ] (13, 1, 'bot')
2018-12-26 05:34:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:34:45 [DEBUG   ] Finished updating board flags in 1.624 seconds
2018-12-26 05:34:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 05:35:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 05:35:36 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 05:35:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:35:45 [WARNING ] (13, 1, 'bot')
2018-12-26 05:35:45 [WARNING ] (13, 1, 'bot')
2018-12-26 05:35:45 [WARNING ] (13, 1, 'bot')
2018-12-26 05:35:45 [WARNING ] (13, 1, 'bot')
2018-12-26 05:35:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:35:45 [DEBUG   ] Finished updating board flags in 1.627 seconds
2018-12-26 05:35:56 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 05:35:58 [DEBUG   ] Got command RPT from MCS: ref #955115
2018-12-26 05:35:58 [DEBUG   ] summary = ERROR
2018-12-26 05:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955115  13 58478 20158589 A  ERRORERROR'
2018-12-26 05:35:58 [DEBUG   ] Got command RPT from MCS: ref #955116
2018-12-26 05:35:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 05:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955116  77 58478 20158590 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 05:36:16 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-26 05:36:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 05:36:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:36:45 [WARNING ] (13, 1, 'bot')
2018-12-26 05:36:45 [WARNING ] (13, 1, 'bot')
2018-12-26 05:36:45 [WARNING ] (13, 1, 'bot')
2018-12-26 05:36:45 [WARNING ] (13, 1, 'bot')
2018-12-26 05:36:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:36:45 [DEBUG   ] Finished updating board flags in 1.547 seconds
2018-12-26 05:36:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 05:37:16 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 05:37:36 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-26 05:37:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 05:37:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:37:45 [WARNING ] (13, 1, 'bot')
2018-12-26 05:37:45 [WARNING ] (13, 1, 'bot')
2018-12-26 05:37:45 [WARNING ] (13, 1, 'bot')
2018-12-26 05:37:45 [WARNING ] (13, 1, 'bot')
2018-12-26 05:37:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:37:45 [DEBUG   ] Finished updating board flags in 1.411 seconds
2018-12-26 05:37:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 05:38:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 05:38:36 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 05:38:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:38:45 [WARNING ] (13, 1, 'bot')
2018-12-26 05:38:45 [WARNING ] (13, 1, 'bot')
2018-12-26 05:38:45 [WARNING ] (13, 1, 'bot')
2018-12-26 05:38:45 [WARNING ] (13, 1, 'bot')
2018-12-26 05:38:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:38:45 [DEBUG   ] Finished updating board flags in 1.471 seconds
2018-12-26 05:38:56 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-26 05:39:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 05:39:31 [DEBUG   ] Got command RPT from MCS: ref #955136
2018-12-26 05:39:31 [DEBUG   ] summary = ERROR
2018-12-26 05:39:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955136  13 58478 20371301 A  ERRORERROR'
2018-12-26 05:39:31 [DEBUG   ] Got command RPT from MCS: ref #955137
2018-12-26 05:39:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 05:39:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955137  77 58478 20371505 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 05:39:31 [DEBUG   ] Got command RPT from MCS: ref #955138
2018-12-26 05:39:31 [DEBUG   ] summary = ERROR
2018-12-26 05:39:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955138  13 58478 20371697 A  ERRORERROR'
2018-12-26 05:39:31 [DEBUG   ] Got command RPT from MCS: ref #955139
2018-12-26 05:39:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 05:39:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955139  77 58478 20371901 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 05:39:32 [DEBUG   ] Got command RPT from MCS: ref #955140
2018-12-26 05:39:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 05:39:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955140  12 58478 20372105 A  ERRORB—™š'
2018-12-26 05:39:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 05:39:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:39:45 [WARNING ] (13, 1, 'bot')
2018-12-26 05:39:45 [WARNING ] (13, 1, 'bot')
2018-12-26 05:39:45 [WARNING ] (13, 1, 'bot')
2018-12-26 05:39:45 [WARNING ] (13, 1, 'bot')
2018-12-26 05:39:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:39:45 [DEBUG   ] Finished updating board flags in 1.466 seconds
2018-12-26 05:39:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 05:40:16 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-26 05:40:37 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-26 05:40:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:40:45 [WARNING ] (13, 1, 'bot')
2018-12-26 05:40:45 [WARNING ] (13, 1, 'bot')
2018-12-26 05:40:45 [WARNING ] (13, 1, 'bot')
2018-12-26 05:40:45 [WARNING ] (13, 1, 'bot')
2018-12-26 05:40:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:40:45 [DEBUG   ] Finished updating board flags in 1.469 seconds
2018-12-26 05:40:57 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-26 05:40:58 [DEBUG   ] Got command RPT from MCS: ref #955145
2018-12-26 05:40:58 [DEBUG   ] summary = ERROR
2018-12-26 05:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955145  13 58478 20458581 A  ERRORERROR'
2018-12-26 05:40:58 [DEBUG   ] Got command RPT from MCS: ref #955146
2018-12-26 05:40:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 05:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955146  77 58478 20458582 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 05:41:17 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-26 05:41:37 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-26 05:41:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:41:46 [WARNING ] (13, 1, 'bot')
2018-12-26 05:41:46 [WARNING ] (13, 1, 'bot')
2018-12-26 05:41:46 [WARNING ] (13, 1, 'bot')
2018-12-26 05:41:46 [WARNING ] (13, 1, 'bot')
2018-12-26 05:41:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:41:46 [DEBUG   ] Finished updating board flags in 2.233 seconds
2018-12-26 05:41:57 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-26 05:42:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 05:42:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 05:42:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:42:46 [WARNING ] (13, 1, 'bot')
2018-12-26 05:42:46 [WARNING ] (13, 1, 'bot')
2018-12-26 05:42:46 [WARNING ] (13, 1, 'bot')
2018-12-26 05:42:46 [WARNING ] (13, 1, 'bot')
2018-12-26 05:42:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:42:46 [DEBUG   ] Finished updating board flags in 2.170 seconds
2018-12-26 05:42:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 05:43:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 05:43:37 [DEBUG   ] Finished updating ant stats in 0.589 seconds
2018-12-26 05:43:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:43:46 [WARNING ] (13, 1, 'bot')
2018-12-26 05:43:46 [WARNING ] (13, 1, 'bot')
2018-12-26 05:43:46 [WARNING ] (13, 1, 'bot')
2018-12-26 05:43:46 [WARNING ] (13, 1, 'bot')
2018-12-26 05:43:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:43:46 [DEBUG   ] Finished updating board flags in 2.009 seconds
2018-12-26 05:43:58 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-12-26 05:44:18 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-26 05:44:31 [DEBUG   ] Got command RPT from MCS: ref #955168
2018-12-26 05:44:31 [DEBUG   ] summary = ERROR
2018-12-26 05:44:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955168  13 58478 20671377 A  ERRORERROR'
2018-12-26 05:44:31 [DEBUG   ] Got command RPT from MCS: ref #955169
2018-12-26 05:44:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 05:44:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955169  77 58478 20671581 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 05:44:31 [DEBUG   ] Got command RPT from MCS: ref #955170
2018-12-26 05:44:31 [DEBUG   ] summary = ERROR
2018-12-26 05:44:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955170  13 58478 20671785 A  ERRORERROR'
2018-12-26 05:44:31 [DEBUG   ] Got command RPT from MCS: ref #955172
2018-12-26 05:44:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 05:44:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955172  77 58478 20671977 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 05:44:32 [DEBUG   ] Got command RPT from MCS: ref #955173
2018-12-26 05:44:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 05:44:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955173  12 58478 20672181 A  ERRORB–™š'
2018-12-26 05:44:38 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 05:44:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:44:46 [WARNING ] (13, 1, 'bot')
2018-12-26 05:44:46 [WARNING ] (13, 1, 'bot')
2018-12-26 05:44:46 [WARNING ] (13, 1, 'bot')
2018-12-26 05:44:46 [WARNING ] (13, 1, 'bot')
2018-12-26 05:44:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:44:46 [DEBUG   ] Finished updating board flags in 1.983 seconds
2018-12-26 05:44:58 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-12-26 05:45:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 05:45:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 05:45:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:45:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-26 05:45:46 [WARNING ] (13, 1, 'bot')
2018-12-26 05:45:46 [WARNING ] (13, 1, 'bot')
2018-12-26 05:45:46 [WARNING ] (13, 1, 'bot')
2018-12-26 05:45:46 [WARNING ] (13, 1, 'bot')
2018-12-26 05:45:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:45:46 [DEBUG   ] Finished updating board flags in 1.811 seconds
2018-12-26 05:45:58 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 05:45:58 [DEBUG   ] Got command RPT from MCS: ref #955182
2018-12-26 05:45:58 [DEBUG   ] summary = ERROR
2018-12-26 05:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955182  13 58478 20758589 A  ERRORERROR'
2018-12-26 05:45:58 [DEBUG   ] Got command RPT from MCS: ref #955183
2018-12-26 05:45:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 05:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955183  77 58478 20758590 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 05:46:18 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-12-26 05:46:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 05:46:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:46:46 [WARNING ] (13, 1, 'bot')
2018-12-26 05:46:46 [WARNING ] (13, 1, 'bot')
2018-12-26 05:46:46 [WARNING ] (13, 1, 'bot')
2018-12-26 05:46:46 [WARNING ] (13, 1, 'bot')
2018-12-26 05:46:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:46:46 [DEBUG   ] Finished updating board flags in 1.798 seconds
2018-12-26 05:46:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 05:47:18 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 05:47:38 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-12-26 05:47:45 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 05:47:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:47:46 [WARNING ] (13, 1, 'bot')
2018-12-26 05:47:46 [WARNING ] (13, 1, 'bot')
2018-12-26 05:47:46 [WARNING ] (13, 1, 'bot')
2018-12-26 05:47:46 [WARNING ] (13, 1, 'bot')
2018-12-26 05:47:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:47:46 [DEBUG   ] Finished updating board flags in 1.660 seconds
2018-12-26 05:47:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 05:48:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 05:48:38 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 05:48:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 05:48:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:48:46 [WARNING ] (13, 1, 'bot')
2018-12-26 05:48:46 [WARNING ] (13, 1, 'bot')
2018-12-26 05:48:46 [WARNING ] (13, 1, 'bot')
2018-12-26 05:48:46 [WARNING ] (13, 1, 'bot')
2018-12-26 05:48:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:48:46 [DEBUG   ] Finished updating board flags in 1.541 seconds
2018-12-26 05:48:58 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-12-26 05:49:18 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 05:49:31 [DEBUG   ] Got command RPT from MCS: ref #955203
2018-12-26 05:49:31 [DEBUG   ] summary = ERROR
2018-12-26 05:49:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955203  13 58478 20971461 A  ERRORERROR'
2018-12-26 05:49:31 [DEBUG   ] Got command RPT from MCS: ref #955204
2018-12-26 05:49:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 05:49:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955204  77 58478 20971665 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 05:49:31 [DEBUG   ] Got command RPT from MCS: ref #955205
2018-12-26 05:49:31 [DEBUG   ] summary = ERROR
2018-12-26 05:49:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955205  13 58478 20971857 A  ERRORERROR'
2018-12-26 05:49:32 [DEBUG   ] Got command RPT from MCS: ref #955206
2018-12-26 05:49:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 05:49:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955206  77 58478 20972061 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 05:49:32 [DEBUG   ] Got command RPT from MCS: ref #955207
2018-12-26 05:49:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 05:49:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955207  12 58478 20972265 A  ERRORB—™š'
2018-12-26 05:49:38 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-26 05:49:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:49:46 [WARNING ] (13, 1, 'bot')
2018-12-26 05:49:46 [WARNING ] (13, 1, 'bot')
2018-12-26 05:49:46 [WARNING ] (13, 1, 'bot')
2018-12-26 05:49:46 [WARNING ] (13, 1, 'bot')
2018-12-26 05:49:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:49:46 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-12-26 05:49:59 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-12-26 05:50:19 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-26 05:50:39 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 05:50:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:50:46 [WARNING ] (13, 1, 'bot')
2018-12-26 05:50:46 [WARNING ] (13, 1, 'bot')
2018-12-26 05:50:46 [WARNING ] (13, 1, 'bot')
2018-12-26 05:50:46 [WARNING ] (13, 1, 'bot')
2018-12-26 05:50:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:50:46 [DEBUG   ] Finished updating board flags in 1.392 seconds
2018-12-26 05:50:58 [DEBUG   ] Got command RPT from MCS: ref #955208
2018-12-26 05:50:58 [DEBUG   ] summary = ERROR
2018-12-26 05:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955208  13 58478 21058589 A  ERRORERROR'
2018-12-26 05:50:58 [DEBUG   ] Got command RPT from MCS: ref #955209
2018-12-26 05:50:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 05:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955209  77 58478 21058590 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 05:50:59 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-26 05:51:19 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-26 05:51:39 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 05:51:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 05:51:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:51:46 [WARNING ] (13, 1, 'bot')
2018-12-26 05:51:46 [WARNING ] (13, 1, 'bot')
2018-12-26 05:51:46 [WARNING ] (13, 1, 'bot')
2018-12-26 05:51:46 [WARNING ] (13, 1, 'bot')
2018-12-26 05:51:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:51:46 [DEBUG   ] Finished updating board flags in 1.372 seconds
2018-12-26 05:51:59 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 05:52:19 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-26 05:52:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 05:52:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:52:47 [WARNING ] (13, 1, 'bot')
2018-12-26 05:52:47 [WARNING ] (13, 1, 'bot')
2018-12-26 05:52:47 [WARNING ] (13, 1, 'bot')
2018-12-26 05:52:47 [WARNING ] (13, 1, 'bot')
2018-12-26 05:52:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:52:47 [DEBUG   ] Finished updating board flags in 2.040 seconds
2018-12-26 05:52:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 05:53:19 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-12-26 05:53:39 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-26 05:53:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:53:47 [WARNING ] (13, 1, 'bot')
2018-12-26 05:53:47 [WARNING ] (13, 1, 'bot')
2018-12-26 05:53:47 [WARNING ] (13, 1, 'bot')
2018-12-26 05:53:47 [WARNING ] (13, 1, 'bot')
2018-12-26 05:53:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:53:47 [DEBUG   ] Finished updating board flags in 2.012 seconds
2018-12-26 05:53:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 05:54:19 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 05:54:31 [DEBUG   ] Got command RPT from MCS: ref #955231
2018-12-26 05:54:31 [DEBUG   ] summary = ERROR
2018-12-26 05:54:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955231  13 58478 21271537 A  ERRORERROR'
2018-12-26 05:54:31 [DEBUG   ] Got command RPT from MCS: ref #955232
2018-12-26 05:54:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 05:54:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955232  77 58478 21271741 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 05:54:31 [DEBUG   ] Got command RPT from MCS: ref #955233
2018-12-26 05:54:31 [DEBUG   ] summary = ERROR
2018-12-26 05:54:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955233  13 58478 21271945 A  ERRORERROR'
2018-12-26 05:54:32 [DEBUG   ] Got command RPT from MCS: ref #955235
2018-12-26 05:54:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 05:54:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955235  77 58478 21272137 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 05:54:32 [DEBUG   ] Got command RPT from MCS: ref #955236
2018-12-26 05:54:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 05:54:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955236  12 58478 21272341 A  ERRORB—™š'
2018-12-26 05:54:39 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-26 05:54:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:54:47 [WARNING ] (13, 1, 'bot')
2018-12-26 05:54:47 [WARNING ] (13, 1, 'bot')
2018-12-26 05:54:47 [WARNING ] (13, 1, 'bot')
2018-12-26 05:54:47 [WARNING ] (13, 1, 'bot')
2018-12-26 05:54:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:54:47 [DEBUG   ] Finished updating board flags in 1.984 seconds
2018-12-26 05:55:00 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-26 05:55:20 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-26 05:55:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 05:55:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:55:47 [WARNING ] (13, 1, 'bot')
2018-12-26 05:55:47 [WARNING ] (13, 1, 'bot')
2018-12-26 05:55:47 [WARNING ] (13, 1, 'bot')
2018-12-26 05:55:47 [WARNING ] (13, 1, 'bot')
2018-12-26 05:55:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:55:47 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-12-26 05:55:58 [DEBUG   ] Got command RPT from MCS: ref #955245
2018-12-26 05:55:58 [DEBUG   ] summary = ERROR
2018-12-26 05:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955245  13 58478 21358585 A  ERRORERROR'
2018-12-26 05:55:58 [DEBUG   ] Got command RPT from MCS: ref #955246
2018-12-26 05:55:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 05:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955246  77 58478 21358586 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 05:56:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 05:56:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 05:56:40 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 05:56:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:56:47 [WARNING ] (13, 1, 'bot')
2018-12-26 05:56:47 [WARNING ] (13, 1, 'bot')
2018-12-26 05:56:47 [WARNING ] (13, 1, 'bot')
2018-12-26 05:56:47 [WARNING ] (13, 1, 'bot')
2018-12-26 05:56:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:56:47 [DEBUG   ] Finished updating board flags in 1.826 seconds
2018-12-26 05:57:00 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 05:57:20 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-26 05:57:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 05:57:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:57:47 [WARNING ] (13, 1, 'bot')
2018-12-26 05:57:47 [WARNING ] (13, 1, 'bot')
2018-12-26 05:57:47 [WARNING ] (13, 1, 'bot')
2018-12-26 05:57:47 [WARNING ] (13, 1, 'bot')
2018-12-26 05:57:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:57:47 [DEBUG   ] Finished updating board flags in 1.772 seconds
2018-12-26 05:58:00 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 05:58:20 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-26 05:58:40 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-26 05:58:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:58:47 [WARNING ] (13, 1, 'bot')
2018-12-26 05:58:47 [WARNING ] (13, 1, 'bot')
2018-12-26 05:58:47 [WARNING ] (13, 1, 'bot')
2018-12-26 05:58:47 [WARNING ] (13, 1, 'bot')
2018-12-26 05:58:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:58:47 [DEBUG   ] Finished updating board flags in 1.620 seconds
2018-12-26 05:59:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 05:59:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 05:59:31 [DEBUG   ] Got command RPT from MCS: ref #955266
2018-12-26 05:59:31 [DEBUG   ] summary = ERROR
2018-12-26 05:59:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955266  13 58478 21571617 A  ERRORERROR'
2018-12-26 05:59:31 [DEBUG   ] Got command RPT from MCS: ref #955267
2018-12-26 05:59:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 05:59:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955267  77 58478 21571821 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 05:59:32 [DEBUG   ] Got command RPT from MCS: ref #955268
2018-12-26 05:59:32 [DEBUG   ] summary = ERROR
2018-12-26 05:59:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955268  13 58478 21572025 A  ERRORERROR'
2018-12-26 05:59:32 [DEBUG   ] Got command RPT from MCS: ref #955269
2018-12-26 05:59:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 05:59:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955269  77 58478 21572217 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 05:59:32 [DEBUG   ] Got command RPT from MCS: ref #955270
2018-12-26 05:59:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 05:59:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955270  12 58478 21572421 A  ERRORB–™š'
2018-12-26 05:59:40 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-12-26 05:59:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 05:59:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-26 05:59:47 [WARNING ] (13, 1, 'bot')
2018-12-26 05:59:47 [WARNING ] (13, 1, 'bot')
2018-12-26 05:59:47 [WARNING ] (13, 1, 'bot')
2018-12-26 05:59:47 [WARNING ] (13, 1, 'bot')
2018-12-26 05:59:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 05:59:47 [DEBUG   ] Finished updating board flags in 1.587 seconds
2018-12-26 06:00:00 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-26 06:00:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 06:00:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 06:00:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:00:47 [WARNING ] (13, 1, 'bot')
2018-12-26 06:00:47 [WARNING ] (13, 1, 'bot')
2018-12-26 06:00:47 [WARNING ] (13, 1, 'bot')
2018-12-26 06:00:47 [WARNING ] (13, 1, 'bot')
2018-12-26 06:00:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:00:47 [DEBUG   ] Finished updating board flags in 1.403 seconds
2018-12-26 06:00:58 [DEBUG   ] Got command RPT from MCS: ref #955275
2018-12-26 06:00:58 [DEBUG   ] summary = ERROR
2018-12-26 06:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955275  13 58478 21658589 A  ERRORERROR'
2018-12-26 06:00:58 [DEBUG   ] Got command RPT from MCS: ref #955276
2018-12-26 06:00:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 06:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955276  77 58478 21658590 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 06:01:00 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 06:01:20 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-26 06:01:40 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 06:01:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-26 06:01:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:01:47 [WARNING ] (13, 1, 'bot')
2018-12-26 06:01:47 [WARNING ] (13, 1, 'bot')
2018-12-26 06:01:47 [WARNING ] (13, 1, 'bot')
2018-12-26 06:01:47 [WARNING ] (13, 1, 'bot')
2018-12-26 06:01:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:01:47 [DEBUG   ] Finished updating board flags in 1.394 seconds
2018-12-26 06:02:01 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-12-26 06:02:21 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-26 06:02:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 06:02:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:02:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-26 06:02:47 [WARNING ] (13, 1, 'bot')
2018-12-26 06:02:47 [WARNING ] (13, 1, 'bot')
2018-12-26 06:02:47 [WARNING ] (13, 1, 'bot')
2018-12-26 06:02:47 [WARNING ] (13, 1, 'bot')
2018-12-26 06:02:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:02:47 [DEBUG   ] Finished updating board flags in 1.354 seconds
2018-12-26 06:03:01 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-26 06:03:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-26 06:03:41 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-26 06:03:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:03:48 [WARNING ] (13, 1, 'bot')
2018-12-26 06:03:48 [WARNING ] (13, 1, 'bot')
2018-12-26 06:03:48 [WARNING ] (13, 1, 'bot')
2018-12-26 06:03:48 [WARNING ] (13, 1, 'bot')
2018-12-26 06:03:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:03:48 [DEBUG   ] Finished updating board flags in 2.058 seconds
2018-12-26 06:04:01 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-26 06:04:21 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 06:04:31 [DEBUG   ] Got command RPT from MCS: ref #955298
2018-12-26 06:04:31 [DEBUG   ] summary = ERROR
2018-12-26 06:04:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955298  13 58478 21871705 A  ERRORERROR'
2018-12-26 06:04:31 [DEBUG   ] Got command RPT from MCS: ref #955299
2018-12-26 06:04:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 06:04:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955299  77 58478 21871897 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 06:04:32 [DEBUG   ] Got command RPT from MCS: ref #955300
2018-12-26 06:04:32 [DEBUG   ] summary = ERROR
2018-12-26 06:04:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955300  13 58478 21872101 A  ERRORERROR'
2018-12-26 06:04:32 [DEBUG   ] Got command RPT from MCS: ref #955302
2018-12-26 06:04:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 06:04:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955302  77 58478 21872305 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 06:04:32 [DEBUG   ] Got command RPT from MCS: ref #955303
2018-12-26 06:04:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 06:04:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955303  12 58478 21872509 A  ERRORB˜™š'
2018-12-26 06:04:41 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 06:04:47 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 06:04:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:04:48 [WARNING ] (13, 1, 'bot')
2018-12-26 06:04:48 [WARNING ] (13, 1, 'bot')
2018-12-26 06:04:48 [WARNING ] (13, 1, 'bot')
2018-12-26 06:04:48 [WARNING ] (13, 1, 'bot')
2018-12-26 06:04:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:04:48 [DEBUG   ] Finished updating board flags in 2.012 seconds
2018-12-26 06:05:01 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 06:05:21 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-12-26 06:05:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 06:05:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:05:48 [WARNING ] (13, 1, 'bot')
2018-12-26 06:05:48 [WARNING ] (13, 1, 'bot')
2018-12-26 06:05:48 [WARNING ] (13, 1, 'bot')
2018-12-26 06:05:48 [WARNING ] (13, 1, 'bot')
2018-12-26 06:05:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:05:48 [DEBUG   ] Finished updating board flags in 1.986 seconds
2018-12-26 06:05:58 [DEBUG   ] Got command RPT from MCS: ref #955308
2018-12-26 06:05:58 [DEBUG   ] summary = ERROR
2018-12-26 06:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955308  13 58478 21958589 A  ERRORERROR'
2018-12-26 06:05:58 [DEBUG   ] Got command RPT from MCS: ref #955309
2018-12-26 06:05:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 06:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955309  77 58478 21958590 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 06:06:01 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-26 06:06:21 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-26 06:06:42 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-26 06:06:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:06:48 [WARNING ] (13, 1, 'bot')
2018-12-26 06:06:48 [WARNING ] (13, 1, 'bot')
2018-12-26 06:06:48 [WARNING ] (13, 1, 'bot')
2018-12-26 06:06:48 [WARNING ] (13, 1, 'bot')
2018-12-26 06:06:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:06:48 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-12-26 06:07:02 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-26 06:07:22 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-26 06:07:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 06:07:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:07:48 [WARNING ] (13, 1, 'bot')
2018-12-26 06:07:48 [WARNING ] (13, 1, 'bot')
2018-12-26 06:07:48 [WARNING ] (13, 1, 'bot')
2018-12-26 06:07:48 [WARNING ] (13, 1, 'bot')
2018-12-26 06:07:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:07:48 [DEBUG   ] Finished updating board flags in 1.808 seconds
2018-12-26 06:08:02 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-26 06:08:22 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 06:08:42 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-26 06:08:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:08:48 [WARNING ] (13, 1, 'bot')
2018-12-26 06:08:48 [WARNING ] (13, 1, 'bot')
2018-12-26 06:08:48 [WARNING ] (13, 1, 'bot')
2018-12-26 06:08:48 [WARNING ] (13, 1, 'bot')
2018-12-26 06:08:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:08:48 [DEBUG   ] Finished updating board flags in 1.788 seconds
2018-12-26 06:09:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 06:09:22 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 06:09:31 [DEBUG   ] Got command RPT from MCS: ref #955329
2018-12-26 06:09:31 [DEBUG   ] summary = ERROR
2018-12-26 06:09:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955329  13 58478 22171785 A  ERRORERROR'
2018-12-26 06:09:31 [DEBUG   ] Got command RPT from MCS: ref #955330
2018-12-26 06:09:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 06:09:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955330  77 58478 22171978 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 06:09:32 [DEBUG   ] Got command RPT from MCS: ref #955331
2018-12-26 06:09:32 [DEBUG   ] summary = ERROR
2018-12-26 06:09:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955331  13 58478 22172181 A  ERRORERROR'
2018-12-26 06:09:32 [DEBUG   ] Got command RPT from MCS: ref #955332
2018-12-26 06:09:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 06:09:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955332  77 58478 22172385 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 06:09:32 [DEBUG   ] Got command RPT from MCS: ref #955333
2018-12-26 06:09:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 06:09:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955333  12 58478 22172589 A  ERRORB—™š'
2018-12-26 06:09:42 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-26 06:09:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:09:48 [WARNING ] (13, 1, 'bot')
2018-12-26 06:09:48 [WARNING ] (13, 1, 'bot')
2018-12-26 06:09:48 [WARNING ] (13, 1, 'bot')
2018-12-26 06:09:48 [WARNING ] (13, 1, 'bot')
2018-12-26 06:09:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:09:48 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-12-26 06:10:03 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-12-26 06:10:23 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 06:10:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 06:10:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:10:48 [WARNING ] (13, 1, 'bot')
2018-12-26 06:10:48 [WARNING ] (13, 1, 'bot')
2018-12-26 06:10:48 [WARNING ] (13, 1, 'bot')
2018-12-26 06:10:48 [WARNING ] (13, 1, 'bot')
2018-12-26 06:10:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:10:48 [DEBUG   ] Finished updating board flags in 1.584 seconds
2018-12-26 06:10:58 [DEBUG   ] Got command RPT from MCS: ref #955338
2018-12-26 06:10:58 [DEBUG   ] summary = ERROR
2018-12-26 06:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955338  13 58478 22258593 A  ERRORERROR'
2018-12-26 06:10:58 [DEBUG   ] Got command RPT from MCS: ref #955339
2018-12-26 06:10:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 06:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955339  77 58478 22258594 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 06:11:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 06:11:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 06:11:43 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 06:11:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:11:48 [WARNING ] (13, 1, 'bot')
2018-12-26 06:11:48 [WARNING ] (13, 1, 'bot')
2018-12-26 06:11:48 [WARNING ] (13, 1, 'bot')
2018-12-26 06:11:48 [WARNING ] (13, 1, 'bot')
2018-12-26 06:11:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:11:48 [DEBUG   ] Finished updating board flags in 1.470 seconds
2018-12-26 06:12:03 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-26 06:12:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 06:12:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 06:12:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:12:48 [WARNING ] (13, 1, 'bot')
2018-12-26 06:12:48 [WARNING ] (13, 1, 'bot')
2018-12-26 06:12:48 [WARNING ] (13, 1, 'bot')
2018-12-26 06:12:48 [WARNING ] (13, 1, 'bot')
2018-12-26 06:12:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:12:48 [DEBUG   ] Finished updating board flags in 1.434 seconds
2018-12-26 06:13:03 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-12-26 06:13:23 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-26 06:13:43 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-26 06:13:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 06:13:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:13:48 [WARNING ] (13, 1, 'bot')
2018-12-26 06:13:48 [WARNING ] (13, 1, 'bot')
2018-12-26 06:13:48 [WARNING ] (13, 1, 'bot')
2018-12-26 06:13:48 [WARNING ] (13, 1, 'bot')
2018-12-26 06:13:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:13:48 [DEBUG   ] Finished updating board flags in 1.427 seconds
2018-12-26 06:14:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 06:14:23 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-12-26 06:14:31 [DEBUG   ] Got command RPT from MCS: ref #955361
2018-12-26 06:14:31 [DEBUG   ] summary = ERROR
2018-12-26 06:14:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955361  13 58478 22471857 A  ERRORERROR'
2018-12-26 06:14:32 [DEBUG   ] Got command RPT from MCS: ref #955362
2018-12-26 06:14:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 06:14:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955362  77 58478 22472061 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 06:14:32 [DEBUG   ] Got command RPT from MCS: ref #955363
2018-12-26 06:14:32 [DEBUG   ] summary = ERROR
2018-12-26 06:14:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955363  13 58478 22472265 A  ERRORERROR'
2018-12-26 06:14:32 [DEBUG   ] Got command RPT from MCS: ref #955365
2018-12-26 06:14:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 06:14:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955365  77 58478 22472469 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 06:14:32 [DEBUG   ] Got command RPT from MCS: ref #955367
2018-12-26 06:14:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 06:14:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955367  12 58478 22472661 A  ERRORB–™š'
2018-12-26 06:14:43 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-26 06:14:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:14:48 [WARNING ] (13, 1, 'bot')
2018-12-26 06:14:48 [WARNING ] (13, 1, 'bot')
2018-12-26 06:14:48 [WARNING ] (13, 1, 'bot')
2018-12-26 06:14:48 [WARNING ] (13, 1, 'bot')
2018-12-26 06:14:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:14:48 [DEBUG   ] Finished updating board flags in 1.504 seconds
2018-12-26 06:15:03 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-26 06:15:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 06:15:43 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 06:15:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:15:49 [WARNING ] (13, 1, 'bot')
2018-12-26 06:15:49 [WARNING ] (13, 1, 'bot')
2018-12-26 06:15:49 [WARNING ] (13, 1, 'bot')
2018-12-26 06:15:49 [WARNING ] (13, 1, 'bot')
2018-12-26 06:15:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:15:49 [DEBUG   ] Finished updating board flags in 2.282 seconds
2018-12-26 06:15:58 [DEBUG   ] Got command RPT from MCS: ref #955375
2018-12-26 06:15:58 [DEBUG   ] summary = ERROR
2018-12-26 06:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955375  13 58478 22558593 A  ERRORERROR'
2018-12-26 06:15:58 [DEBUG   ] Got command RPT from MCS: ref #955376
2018-12-26 06:15:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 06:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955376  77 58478 22558594 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 06:16:03 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-26 06:16:23 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-12-26 06:16:43 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-26 06:16:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:16:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 06:16:49 [WARNING ] (13, 1, 'bot')
2018-12-26 06:16:49 [WARNING ] (13, 1, 'bot')
2018-12-26 06:16:49 [WARNING ] (13, 1, 'bot')
2018-12-26 06:16:49 [WARNING ] (13, 1, 'bot')
2018-12-26 06:16:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:16:49 [DEBUG   ] Finished updating board flags in 2.091 seconds
2018-12-26 06:17:04 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-26 06:17:24 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-26 06:17:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 06:17:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:17:49 [WARNING ] (13, 1, 'bot')
2018-12-26 06:17:49 [WARNING ] (13, 1, 'bot')
2018-12-26 06:17:49 [WARNING ] (13, 1, 'bot')
2018-12-26 06:17:49 [WARNING ] (13, 1, 'bot')
2018-12-26 06:17:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:17:49 [DEBUG   ] Finished updating board flags in 2.019 seconds
2018-12-26 06:18:04 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 06:18:24 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-26 06:18:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 06:18:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:18:49 [WARNING ] (13, 1, 'bot')
2018-12-26 06:18:49 [WARNING ] (13, 1, 'bot')
2018-12-26 06:18:49 [WARNING ] (13, 1, 'bot')
2018-12-26 06:18:49 [WARNING ] (13, 1, 'bot')
2018-12-26 06:18:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:18:49 [DEBUG   ] Finished updating board flags in 2.013 seconds
2018-12-26 06:19:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 06:19:24 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-12-26 06:19:31 [DEBUG   ] Got command RPT from MCS: ref #955396
2018-12-26 06:19:31 [DEBUG   ] summary = ERROR
2018-12-26 06:19:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955396  13 58478 22771941 A  ERRORERROR'
2018-12-26 06:19:32 [DEBUG   ] Got command RPT from MCS: ref #955397
2018-12-26 06:19:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 06:19:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955397  77 58478 22772145 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 06:19:32 [DEBUG   ] Got command RPT from MCS: ref #955398
2018-12-26 06:19:32 [DEBUG   ] summary = ERROR
2018-12-26 06:19:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955398  13 58478 22772349 A  ERRORERROR'
2018-12-26 06:19:32 [DEBUG   ] Got command RPT from MCS: ref #955399
2018-12-26 06:19:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 06:19:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955399  77 58478 22772541 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 06:19:32 [DEBUG   ] Got command RPT from MCS: ref #955400
2018-12-26 06:19:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 06:19:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955400  12 58478 22772745 A  ERRORB˜™š'
2018-12-26 06:19:44 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-26 06:19:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:19:49 [WARNING ] (13, 1, 'bot')
2018-12-26 06:19:49 [WARNING ] (13, 1, 'bot')
2018-12-26 06:19:49 [WARNING ] (13, 1, 'bot')
2018-12-26 06:19:49 [WARNING ] (13, 1, 'bot')
2018-12-26 06:19:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:19:49 [DEBUG   ] Finished updating board flags in 1.987 seconds
2018-12-26 06:20:04 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-26 06:20:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 06:20:44 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 06:20:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 06:20:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:20:49 [WARNING ] (13, 1, 'bot')
2018-12-26 06:20:49 [WARNING ] (13, 1, 'bot')
2018-12-26 06:20:49 [WARNING ] (13, 1, 'bot')
2018-12-26 06:20:49 [WARNING ] (13, 1, 'bot')
2018-12-26 06:20:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:20:49 [DEBUG   ] Finished updating board flags in 1.815 seconds
2018-12-26 06:20:58 [DEBUG   ] Got command RPT from MCS: ref #955401
2018-12-26 06:20:58 [DEBUG   ] summary = ERROR
2018-12-26 06:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955401  13 58478 22858597 A  ERRORERROR'
2018-12-26 06:20:58 [DEBUG   ] Got command RPT from MCS: ref #955402
2018-12-26 06:20:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 06:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955402  77 58478 22858598 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 06:21:04 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-26 06:21:24 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 06:21:44 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-26 06:21:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 06:21:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:21:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 06:21:49 [WARNING ] (13, 1, 'bot')
2018-12-26 06:21:49 [WARNING ] (13, 1, 'bot')
2018-12-26 06:21:49 [WARNING ] (13, 1, 'bot')
2018-12-26 06:21:49 [WARNING ] (13, 1, 'bot')
2018-12-26 06:21:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:21:49 [DEBUG   ] Finished updating board flags in 1.789 seconds
2018-12-26 06:22:05 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-26 06:22:25 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-26 06:22:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 06:22:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:22:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 06:22:49 [WARNING ] (13, 1, 'bot')
2018-12-26 06:22:49 [WARNING ] (13, 1, 'bot')
2018-12-26 06:22:49 [WARNING ] (13, 1, 'bot')
2018-12-26 06:22:49 [WARNING ] (13, 1, 'bot')
2018-12-26 06:22:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:22:49 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-12-26 06:23:05 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 06:23:25 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-26 06:23:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 06:23:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:23:49 [WARNING ] (13, 1, 'bot')
2018-12-26 06:23:49 [WARNING ] (13, 1, 'bot')
2018-12-26 06:23:49 [WARNING ] (13, 1, 'bot')
2018-12-26 06:23:49 [WARNING ] (13, 1, 'bot')
2018-12-26 06:23:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:23:49 [DEBUG   ] Finished updating board flags in 1.580 seconds
2018-12-26 06:24:05 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-26 06:24:25 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-12-26 06:24:32 [DEBUG   ] Got command RPT from MCS: ref #955424
2018-12-26 06:24:32 [DEBUG   ] summary = ERROR
2018-12-26 06:24:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955424  13 58478 23072021 A  ERRORERROR'
2018-12-26 06:24:32 [DEBUG   ] Got command RPT from MCS: ref #955425
2018-12-26 06:24:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 06:24:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955425  77 58478 23072225 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 06:24:32 [DEBUG   ] Got command RPT from MCS: ref #955426
2018-12-26 06:24:32 [DEBUG   ] summary = ERROR
2018-12-26 06:24:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955426  13 58478 23072429 A  ERRORERROR'
2018-12-26 06:24:32 [DEBUG   ] Got command RPT from MCS: ref #955428
2018-12-26 06:24:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 06:24:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955428  77 58478 23072621 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 06:24:32 [DEBUG   ] Got command RPT from MCS: ref #955429
2018-12-26 06:24:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 06:24:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955429  12 58478 23072825 A  ERRORB—™š'
2018-12-26 06:24:45 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-26 06:24:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:24:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-26 06:24:49 [WARNING ] (13, 1, 'bot')
2018-12-26 06:24:49 [WARNING ] (13, 1, 'bot')
2018-12-26 06:24:49 [WARNING ] (13, 1, 'bot')
2018-12-26 06:24:49 [WARNING ] (13, 1, 'bot')
2018-12-26 06:24:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:24:49 [DEBUG   ] Finished updating board flags in 1.417 seconds
2018-12-26 06:25:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 06:25:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 06:25:45 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 06:25:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:25:49 [WARNING ] (13, 1, 'bot')
2018-12-26 06:25:49 [WARNING ] (13, 1, 'bot')
2018-12-26 06:25:49 [WARNING ] (13, 1, 'bot')
2018-12-26 06:25:49 [WARNING ] (13, 1, 'bot')
2018-12-26 06:25:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:25:49 [DEBUG   ] Finished updating board flags in 1.398 seconds
2018-12-26 06:25:58 [DEBUG   ] Got command RPT from MCS: ref #955438
2018-12-26 06:25:58 [DEBUG   ] summary = ERROR
2018-12-26 06:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955438  13 58478 23158593 A  ERRORERROR'
2018-12-26 06:25:58 [DEBUG   ] Got command RPT from MCS: ref #955439
2018-12-26 06:25:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 06:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955439  77 58478 23158594 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 06:26:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 06:26:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 06:26:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 06:26:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:26:49 [WARNING ] (13, 1, 'bot')
2018-12-26 06:26:49 [WARNING ] (13, 1, 'bot')
2018-12-26 06:26:49 [WARNING ] (13, 1, 'bot')
2018-12-26 06:26:49 [WARNING ] (13, 1, 'bot')
2018-12-26 06:26:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:26:49 [DEBUG   ] Finished updating board flags in 1.381 seconds
2018-12-26 06:27:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 06:27:25 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-26 06:27:45 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 06:27:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:27:50 [WARNING ] (13, 1, 'bot')
2018-12-26 06:27:50 [WARNING ] (13, 1, 'bot')
2018-12-26 06:27:50 [WARNING ] (13, 1, 'bot')
2018-12-26 06:27:50 [WARNING ] (13, 1, 'bot')
2018-12-26 06:27:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:27:50 [DEBUG   ] Finished updating board flags in 2.027 seconds
2018-12-26 06:28:05 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 06:28:26 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-26 06:28:46 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-26 06:28:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:28:50 [WARNING ] (13, 1, 'bot')
2018-12-26 06:28:50 [WARNING ] (13, 1, 'bot')
2018-12-26 06:28:50 [WARNING ] (13, 1, 'bot')
2018-12-26 06:28:50 [WARNING ] (13, 1, 'bot')
2018-12-26 06:28:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:28:50 [DEBUG   ] Finished updating board flags in 2.001 seconds
2018-12-26 06:29:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 06:29:26 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 06:29:32 [DEBUG   ] Got command RPT from MCS: ref #955459
2018-12-26 06:29:32 [DEBUG   ] summary = ERROR
2018-12-26 06:29:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955459  13 58478 23372105 A  ERRORERROR'
2018-12-26 06:29:32 [DEBUG   ] Got command RPT from MCS: ref #955460
2018-12-26 06:29:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 06:29:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955460  77 58478 23372309 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 06:29:32 [DEBUG   ] Got command RPT from MCS: ref #955461
2018-12-26 06:29:32 [DEBUG   ] summary = ERROR
2018-12-26 06:29:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955461  13 58478 23372501 A  ERRORERROR'
2018-12-26 06:29:32 [DEBUG   ] Got command RPT from MCS: ref #955462
2018-12-26 06:29:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 06:29:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955462  77 58478 23372705 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 06:29:32 [DEBUG   ] Got command RPT from MCS: ref #955463
2018-12-26 06:29:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 06:29:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955463  12 58478 23372909 A  ERRORB•™š'
2018-12-26 06:29:46 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-26 06:29:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:29:50 [WARNING ] (13, 1, 'bot')
2018-12-26 06:29:50 [WARNING ] (13, 1, 'bot')
2018-12-26 06:29:50 [WARNING ] (13, 1, 'bot')
2018-12-26 06:29:50 [WARNING ] (13, 1, 'bot')
2018-12-26 06:29:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:29:50 [DEBUG   ] Finished updating board flags in 1.992 seconds
2018-12-26 06:30:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 06:30:26 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-26 06:30:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 06:30:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:30:50 [WARNING ] (13, 1, 'bot')
2018-12-26 06:30:50 [WARNING ] (13, 1, 'bot')
2018-12-26 06:30:50 [WARNING ] (13, 1, 'bot')
2018-12-26 06:30:50 [WARNING ] (13, 1, 'bot')
2018-12-26 06:30:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:30:50 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-12-26 06:30:58 [DEBUG   ] Got command RPT from MCS: ref #955468
2018-12-26 06:30:58 [DEBUG   ] summary = ERROR
2018-12-26 06:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955468  13 58478 23458593 A  ERRORERROR'
2018-12-26 06:30:58 [DEBUG   ] Got command RPT from MCS: ref #955469
2018-12-26 06:30:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 06:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955469  77 58478 23458594 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 06:31:06 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-12-26 06:31:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 06:31:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 06:31:49 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 06:31:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:31:50 [WARNING ] (13, 1, 'bot')
2018-12-26 06:31:50 [WARNING ] (13, 1, 'bot')
2018-12-26 06:31:50 [WARNING ] (13, 1, 'bot')
2018-12-26 06:31:50 [WARNING ] (13, 1, 'bot')
2018-12-26 06:31:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:31:50 [DEBUG   ] Finished updating board flags in 1.785 seconds
2018-12-26 06:32:06 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 06:32:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 06:32:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 06:32:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:32:50 [WARNING ] (13, 1, 'bot')
2018-12-26 06:32:50 [WARNING ] (13, 1, 'bot')
2018-12-26 06:32:50 [WARNING ] (13, 1, 'bot')
2018-12-26 06:32:50 [WARNING ] (13, 1, 'bot')
2018-12-26 06:32:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:32:50 [DEBUG   ] Finished updating board flags in 1.657 seconds
2018-12-26 06:33:06 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 06:33:26 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-26 06:33:46 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-12-26 06:33:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:33:50 [WARNING ] (13, 1, 'bot')
2018-12-26 06:33:50 [WARNING ] (13, 1, 'bot')
2018-12-26 06:33:50 [WARNING ] (13, 1, 'bot')
2018-12-26 06:33:50 [WARNING ] (13, 1, 'bot')
2018-12-26 06:33:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:33:50 [DEBUG   ] Finished updating board flags in 1.556 seconds
2018-12-26 06:34:07 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-26 06:34:27 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-26 06:34:32 [DEBUG   ] Got command RPT from MCS: ref #955491
2018-12-26 06:34:32 [DEBUG   ] summary = ERROR
2018-12-26 06:34:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955491  13 58478 23672181 A  ERRORERROR'
2018-12-26 06:34:32 [DEBUG   ] Got command RPT from MCS: ref #955492
2018-12-26 06:34:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 06:34:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955492  77 58478 23672385 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 06:34:32 [DEBUG   ] Got command RPT from MCS: ref #955493
2018-12-26 06:34:32 [DEBUG   ] summary = ERROR
2018-12-26 06:34:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955493  13 58478 23672589 A  ERRORERROR'
2018-12-26 06:34:32 [DEBUG   ] Got command RPT from MCS: ref #955495
2018-12-26 06:34:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 06:34:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955495  77 58478 23672793 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 06:34:32 [DEBUG   ] Got command RPT from MCS: ref #955496
2018-12-26 06:34:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 06:34:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955496  12 58478 23672985 A  ERRORB˜™š'
2018-12-26 06:34:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 06:34:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:34:50 [WARNING ] (13, 1, 'bot')
2018-12-26 06:34:50 [WARNING ] (13, 1, 'bot')
2018-12-26 06:34:50 [WARNING ] (13, 1, 'bot')
2018-12-26 06:34:50 [WARNING ] (13, 1, 'bot')
2018-12-26 06:34:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:34:50 [DEBUG   ] Finished updating board flags in 1.408 seconds
2018-12-26 06:35:07 [DEBUG   ] Finished updating ant stats in 1.217 seconds
2018-12-26 06:35:27 [DEBUG   ] Finished updating ant stats in 1.188 seconds
2018-12-26 06:35:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 06:35:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 06:35:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:35:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 06:35:50 [WARNING ] (13, 1, 'bot')
2018-12-26 06:35:50 [WARNING ] (13, 1, 'bot')
2018-12-26 06:35:50 [WARNING ] (13, 1, 'bot')
2018-12-26 06:35:50 [WARNING ] (13, 1, 'bot')
2018-12-26 06:35:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:35:50 [DEBUG   ] Finished updating board flags in 1.390 seconds
2018-12-26 06:35:58 [DEBUG   ] Got command RPT from MCS: ref #955501
2018-12-26 06:35:58 [DEBUG   ] summary = ERROR
2018-12-26 06:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955501  13 58478 23758597 A  ERRORERROR'
2018-12-26 06:35:58 [DEBUG   ] Got command RPT from MCS: ref #955502
2018-12-26 06:35:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 06:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955502  77 58478 23758598 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 06:36:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 06:36:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 06:36:47 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 06:36:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 06:36:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:36:50 [WARNING ] (13, 1, 'bot')
2018-12-26 06:36:50 [WARNING ] (13, 1, 'bot')
2018-12-26 06:36:50 [WARNING ] (13, 1, 'bot')
2018-12-26 06:36:50 [WARNING ] (13, 1, 'bot')
2018-12-26 06:36:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:36:50 [DEBUG   ] Finished updating board flags in 1.490 seconds
2018-12-26 06:37:07 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-26 06:37:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 06:37:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 06:37:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:37:51 [WARNING ] (13, 1, 'bot')
2018-12-26 06:37:51 [WARNING ] (13, 1, 'bot')
2018-12-26 06:37:51 [WARNING ] (13, 1, 'bot')
2018-12-26 06:37:51 [WARNING ] (13, 1, 'bot')
2018-12-26 06:37:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:37:51 [DEBUG   ] Finished updating board flags in 2.191 seconds
2018-12-26 06:38:07 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 06:38:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 06:38:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 06:38:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:38:51 [WARNING ] (13, 1, 'bot')
2018-12-26 06:38:51 [WARNING ] (13, 1, 'bot')
2018-12-26 06:38:51 [WARNING ] (13, 1, 'bot')
2018-12-26 06:38:51 [WARNING ] (13, 1, 'bot')
2018-12-26 06:38:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:38:51 [DEBUG   ] Finished updating board flags in 1.931 seconds
2018-12-26 06:39:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 06:39:27 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 06:39:32 [DEBUG   ] Got command RPT from MCS: ref #955522
2018-12-26 06:39:32 [DEBUG   ] summary = ERROR
2018-12-26 06:39:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955522  13 58478 23972261 A  ERRORERROR'
2018-12-26 06:39:32 [DEBUG   ] Got command RPT from MCS: ref #955523
2018-12-26 06:39:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 06:39:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955523  77 58478 23972465 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 06:39:32 [DEBUG   ] Got command RPT from MCS: ref #955524
2018-12-26 06:39:32 [DEBUG   ] summary = ERROR
2018-12-26 06:39:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955524  13 58478 23972669 A  ERRORERROR'
2018-12-26 06:39:32 [DEBUG   ] Got command RPT from MCS: ref #955525
2018-12-26 06:39:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 06:39:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955525  77 58478 23972873 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 06:39:33 [DEBUG   ] Got command RPT from MCS: ref #955526
2018-12-26 06:39:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 06:39:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955526  12 58478 23973065 A  ERRORB—™š'
2018-12-26 06:39:47 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-26 06:39:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:39:51 [WARNING ] (13, 1, 'bot')
2018-12-26 06:39:51 [WARNING ] (13, 1, 'bot')
2018-12-26 06:39:51 [WARNING ] (13, 1, 'bot')
2018-12-26 06:39:51 [WARNING ] (13, 1, 'bot')
2018-12-26 06:39:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:39:51 [DEBUG   ] Finished updating board flags in 1.804 seconds
2018-12-26 06:40:07 [DEBUG   ] Finished updating ant stats in 0.614 seconds
2018-12-26 06:40:27 [DEBUG   ] Finished updating ant stats in 0.590 seconds
2018-12-26 06:40:48 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-26 06:40:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:40:51 [WARNING ] (13, 1, 'bot')
2018-12-26 06:40:51 [WARNING ] (13, 1, 'bot')
2018-12-26 06:40:51 [WARNING ] (13, 1, 'bot')
2018-12-26 06:40:51 [WARNING ] (13, 1, 'bot')
2018-12-26 06:40:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:40:51 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-12-26 06:40:58 [DEBUG   ] Got command RPT from MCS: ref #955531
2018-12-26 06:40:58 [DEBUG   ] summary = ERROR
2018-12-26 06:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955531  13 58478 24058601 A  ERRORERROR'
2018-12-26 06:40:58 [DEBUG   ] Got command RPT from MCS: ref #955532
2018-12-26 06:40:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 06:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955532  77 58478 24058602 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 06:41:08 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-26 06:41:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 06:41:48 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 06:41:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:41:51 [WARNING ] (13, 1, 'bot')
2018-12-26 06:41:51 [WARNING ] (13, 1, 'bot')
2018-12-26 06:41:51 [WARNING ] (13, 1, 'bot')
2018-12-26 06:41:51 [WARNING ] (13, 1, 'bot')
2018-12-26 06:41:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:41:51 [DEBUG   ] Finished updating board flags in 1.787 seconds
2018-12-26 06:42:08 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-26 06:42:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 06:42:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 06:42:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:42:51 [WARNING ] (13, 1, 'bot')
2018-12-26 06:42:51 [WARNING ] (13, 1, 'bot')
2018-12-26 06:42:51 [WARNING ] (13, 1, 'bot')
2018-12-26 06:42:51 [WARNING ] (13, 1, 'bot')
2018-12-26 06:42:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:42:51 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-12-26 06:43:08 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 06:43:28 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-26 06:43:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 06:43:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:43:51 [WARNING ] (13, 1, 'bot')
2018-12-26 06:43:51 [WARNING ] (13, 1, 'bot')
2018-12-26 06:43:51 [WARNING ] (13, 1, 'bot')
2018-12-26 06:43:51 [WARNING ] (13, 1, 'bot')
2018-12-26 06:43:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:43:51 [DEBUG   ] Finished updating board flags in 1.594 seconds
2018-12-26 06:44:08 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-26 06:44:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 06:44:32 [DEBUG   ] Got command RPT from MCS: ref #955554
2018-12-26 06:44:32 [DEBUG   ] summary = ERROR
2018-12-26 06:44:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955554  13 58478 24272349 A  ERRORERROR'
2018-12-26 06:44:32 [DEBUG   ] Got command RPT from MCS: ref #955555
2018-12-26 06:44:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 06:44:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955555  77 58478 24272553 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 06:44:32 [DEBUG   ] Got command RPT from MCS: ref #955556
2018-12-26 06:44:32 [DEBUG   ] summary = ERROR
2018-12-26 06:44:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955556  13 58478 24272745 A  ERRORERROR'
2018-12-26 06:44:32 [DEBUG   ] Got command RPT from MCS: ref #955558
2018-12-26 06:44:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 06:44:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955558  77 58478 24272949 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 06:44:33 [DEBUG   ] Got command RPT from MCS: ref #955560
2018-12-26 06:44:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 06:44:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955560  12 58478 24273153 A  ERRORB—™š'
2018-12-26 06:44:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 06:44:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:44:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 06:44:51 [WARNING ] (13, 1, 'bot')
2018-12-26 06:44:51 [WARNING ] (13, 1, 'bot')
2018-12-26 06:44:51 [WARNING ] (13, 1, 'bot')
2018-12-26 06:44:51 [WARNING ] (13, 1, 'bot')
2018-12-26 06:44:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:44:51 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-12-26 06:45:08 [DEBUG   ] Finished updating ant stats in 0.616 seconds
2018-12-26 06:45:28 [DEBUG   ] Finished updating ant stats in 0.587 seconds
2018-12-26 06:45:49 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-26 06:45:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:45:51 [WARNING ] (13, 1, 'bot')
2018-12-26 06:45:51 [WARNING ] (13, 1, 'bot')
2018-12-26 06:45:51 [WARNING ] (13, 1, 'bot')
2018-12-26 06:45:51 [WARNING ] (13, 1, 'bot')
2018-12-26 06:45:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:45:51 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-12-26 06:45:58 [DEBUG   ] Got command RPT from MCS: ref #955567
2018-12-26 06:45:58 [DEBUG   ] summary = ERROR
2018-12-26 06:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955567  13 58478 24358597 A  ERRORERROR'
2018-12-26 06:45:58 [DEBUG   ] Got command RPT from MCS: ref #955568
2018-12-26 06:45:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 06:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955568  77 58478 24358598 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 06:46:09 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-26 06:46:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 06:46:49 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 06:46:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:46:51 [WARNING ] (13, 1, 'bot')
2018-12-26 06:46:51 [WARNING ] (13, 1, 'bot')
2018-12-26 06:46:51 [WARNING ] (13, 1, 'bot')
2018-12-26 06:46:51 [WARNING ] (13, 1, 'bot')
2018-12-26 06:46:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:46:51 [DEBUG   ] Finished updating board flags in 1.538 seconds
2018-12-26 06:47:09 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-26 06:47:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 06:47:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 06:47:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:47:51 [WARNING ] (13, 1, 'bot')
2018-12-26 06:47:51 [WARNING ] (13, 1, 'bot')
2018-12-26 06:47:51 [WARNING ] (13, 1, 'bot')
2018-12-26 06:47:51 [WARNING ] (13, 1, 'bot')
2018-12-26 06:47:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:47:51 [DEBUG   ] Finished updating board flags in 1.321 seconds
2018-12-26 06:48:09 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 06:48:29 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-26 06:48:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 06:48:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2018-12-26 06:48:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:48:52 [WARNING ] (13, 1, 'bot')
2018-12-26 06:48:52 [WARNING ] (13, 1, 'bot')
2018-12-26 06:48:52 [WARNING ] (13, 1, 'bot')
2018-12-26 06:48:52 [WARNING ] (13, 1, 'bot')
2018-12-26 06:48:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:48:52 [DEBUG   ] Finished updating board flags in 2.137 seconds
2018-12-26 06:49:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 06:49:29 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-26 06:49:32 [DEBUG   ] Got command RPT from MCS: ref #955589
2018-12-26 06:49:32 [DEBUG   ] summary = ERROR
2018-12-26 06:49:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955589  13 58478 24572433 A  ERRORERROR'
2018-12-26 06:49:32 [DEBUG   ] Got command RPT from MCS: ref #955590
2018-12-26 06:49:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 06:49:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955590  77 58478 24572625 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 06:49:32 [DEBUG   ] Got command RPT from MCS: ref #955591
2018-12-26 06:49:32 [DEBUG   ] summary = ERROR
2018-12-26 06:49:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955591  13 58478 24572829 A  ERRORERROR'
2018-12-26 06:49:33 [DEBUG   ] Got command RPT from MCS: ref #955592
2018-12-26 06:49:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 06:49:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955592  77 58478 24573033 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 06:49:33 [DEBUG   ] Got command RPT from MCS: ref #955593
2018-12-26 06:49:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 06:49:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955593  12 58478 24573225 A  ERRORB˜™š'
2018-12-26 06:49:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 06:49:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 06:49:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:49:52 [WARNING ] (13, 1, 'bot')
2018-12-26 06:49:52 [WARNING ] (13, 1, 'bot')
2018-12-26 06:49:52 [WARNING ] (13, 1, 'bot')
2018-12-26 06:49:52 [WARNING ] (13, 1, 'bot')
2018-12-26 06:49:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:49:52 [DEBUG   ] Finished updating board flags in 1.996 seconds
2018-12-26 06:50:09 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-12-26 06:50:29 [DEBUG   ] Finished updating ant stats in 0.590 seconds
2018-12-26 06:50:50 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-26 06:50:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:50:52 [WARNING ] (13, 1, 'bot')
2018-12-26 06:50:52 [WARNING ] (13, 1, 'bot')
2018-12-26 06:50:52 [WARNING ] (13, 1, 'bot')
2018-12-26 06:50:52 [WARNING ] (13, 1, 'bot')
2018-12-26 06:50:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:50:52 [DEBUG   ] Finished updating board flags in 1.803 seconds
2018-12-26 06:50:58 [DEBUG   ] Got command RPT from MCS: ref #955594
2018-12-26 06:50:58 [DEBUG   ] summary = ERROR
2018-12-26 06:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955594  13 58478 24658601 A  ERRORERROR'
2018-12-26 06:50:58 [DEBUG   ] Got command RPT from MCS: ref #955595
2018-12-26 06:50:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 06:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955595  77 58478 24658602 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 06:51:10 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-26 06:51:30 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 06:51:50 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 06:51:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:51:52 [WARNING ] (13, 1, 'bot')
2018-12-26 06:51:52 [WARNING ] (13, 1, 'bot')
2018-12-26 06:51:52 [WARNING ] (13, 1, 'bot')
2018-12-26 06:51:52 [WARNING ] (13, 1, 'bot')
2018-12-26 06:51:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:51:52 [DEBUG   ] Finished updating board flags in 1.795 seconds
2018-12-26 06:52:10 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2018-12-26 06:52:30 [DEBUG   ] Finished updating ant stats in 0.978 seconds
2018-12-26 06:52:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 06:52:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:52:52 [WARNING ] (13, 1, 'bot')
2018-12-26 06:52:52 [WARNING ] (13, 1, 'bot')
2018-12-26 06:52:52 [WARNING ] (13, 1, 'bot')
2018-12-26 06:52:52 [WARNING ] (13, 1, 'bot')
2018-12-26 06:52:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:52:52 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-12-26 06:53:10 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 06:53:30 [DEBUG   ] Finished updating ant stats in 0.789 seconds
2018-12-26 06:53:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 06:53:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:53:52 [WARNING ] (13, 1, 'bot')
2018-12-26 06:53:52 [WARNING ] (13, 1, 'bot')
2018-12-26 06:53:52 [WARNING ] (13, 1, 'bot')
2018-12-26 06:53:52 [WARNING ] (13, 1, 'bot')
2018-12-26 06:53:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:53:52 [DEBUG   ] Finished updating board flags in 1.604 seconds
2018-12-26 06:54:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 06:54:30 [DEBUG   ] Finished updating ant stats in 0.583 seconds
2018-12-26 06:54:32 [DEBUG   ] Got command RPT from MCS: ref #955617
2018-12-26 06:54:32 [DEBUG   ] summary = ERROR
2018-12-26 06:54:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955617  13 58478 24872509 A  ERRORERROR'
2018-12-26 06:54:32 [DEBUG   ] Got command RPT from MCS: ref #955618
2018-12-26 06:54:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 06:54:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955618  77 58478 24872713 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 06:54:32 [DEBUG   ] Got command RPT from MCS: ref #955619
2018-12-26 06:54:32 [DEBUG   ] summary = ERROR
2018-12-26 06:54:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955619  13 58478 24872905 A  ERRORERROR'
2018-12-26 06:54:33 [DEBUG   ] Got command RPT from MCS: ref #955621
2018-12-26 06:54:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 06:54:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955621  77 58478 24873109 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 06:54:33 [DEBUG   ] Got command RPT from MCS: ref #955623
2018-12-26 06:54:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 06:54:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955623  12 58478 24873313 A  ERRORB—™š'
2018-12-26 06:54:51 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-26 06:54:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:54:52 [WARNING ] (13, 1, 'bot')
2018-12-26 06:54:52 [WARNING ] (13, 1, 'bot')
2018-12-26 06:54:52 [WARNING ] (13, 1, 'bot')
2018-12-26 06:54:52 [WARNING ] (13, 1, 'bot')
2018-12-26 06:54:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:54:52 [DEBUG   ] Finished updating board flags in 1.601 seconds
2018-12-26 06:55:11 [DEBUG   ] Finished updating ant stats in 1.220 seconds
2018-12-26 06:55:31 [DEBUG   ] Finished updating ant stats in 1.187 seconds
2018-12-26 06:55:51 [DEBUG   ] Finished updating ant stats in 1.048 seconds
2018-12-26 06:55:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:55:52 [WARNING ] (13, 1, 'bot')
2018-12-26 06:55:52 [WARNING ] (13, 1, 'bot')
2018-12-26 06:55:52 [WARNING ] (13, 1, 'bot')
2018-12-26 06:55:52 [WARNING ] (13, 1, 'bot')
2018-12-26 06:55:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:55:52 [DEBUG   ] Finished updating board flags in 1.586 seconds
2018-12-26 06:55:58 [DEBUG   ] Got command RPT from MCS: ref #955631
2018-12-26 06:55:58 [DEBUG   ] summary = ERROR
2018-12-26 06:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955631  13 58478 24958605 A  ERRORERROR'
2018-12-26 06:55:58 [DEBUG   ] Got command RPT from MCS: ref #955632
2018-12-26 06:55:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 06:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955632  77 58478 24958606 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 06:56:11 [DEBUG   ] Finished updating ant stats in 0.954 seconds
2018-12-26 06:56:31 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 06:56:51 [DEBUG   ] Finished updating ant stats in 0.846 seconds
2018-12-26 06:56:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:56:52 [WARNING ] (13, 1, 'bot')
2018-12-26 06:56:52 [WARNING ] (13, 1, 'bot')
2018-12-26 06:56:52 [WARNING ] (13, 1, 'bot')
2018-12-26 06:56:52 [WARNING ] (13, 1, 'bot')
2018-12-26 06:56:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:56:52 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-12-26 06:57:11 [DEBUG   ] Finished updating ant stats in 0.754 seconds
2018-12-26 06:57:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 06:57:51 [DEBUG   ] Finished updating ant stats in 0.650 seconds
2018-12-26 06:57:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:57:52 [WARNING ] (13, 1, 'bot')
2018-12-26 06:57:52 [WARNING ] (13, 1, 'bot')
2018-12-26 06:57:52 [WARNING ] (13, 1, 'bot')
2018-12-26 06:57:52 [WARNING ] (13, 1, 'bot')
2018-12-26 06:57:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:57:52 [DEBUG   ] Finished updating board flags in 1.403 seconds
2018-12-26 06:58:11 [DEBUG   ] Finished updating ant stats in 0.555 seconds
2018-12-26 06:58:31 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 06:58:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:58:52 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-12-26 06:58:52 [WARNING ] (13, 1, 'bot')
2018-12-26 06:58:52 [WARNING ] (13, 1, 'bot')
2018-12-26 06:58:52 [WARNING ] (13, 1, 'bot')
2018-12-26 06:58:52 [WARNING ] (13, 1, 'bot')
2018-12-26 06:58:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:58:52 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-12-26 06:59:12 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-12-26 06:59:32 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-26 06:59:32 [DEBUG   ] Got command RPT from MCS: ref #955652
2018-12-26 06:59:32 [DEBUG   ] summary = ERROR
2018-12-26 06:59:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955652  13 58478 25172585 A  ERRORERROR'
2018-12-26 06:59:32 [DEBUG   ] Got command RPT from MCS: ref #955653
2018-12-26 06:59:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 06:59:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955653  77 58478 25172789 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 06:59:32 [DEBUG   ] Got command RPT from MCS: ref #955654
2018-12-26 06:59:32 [DEBUG   ] summary = ERROR
2018-12-26 06:59:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955654  13 58478 25172993 A  ERRORERROR'
2018-12-26 06:59:33 [DEBUG   ] Got command RPT from MCS: ref #955655
2018-12-26 06:59:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 06:59:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955655  77 58478 25173197 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 06:59:33 [DEBUG   ] Got command RPT from MCS: ref #955656
2018-12-26 06:59:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 06:59:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955656  12 58478 25173389 A  ERRORB—™š'
2018-12-26 06:59:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 06:59:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 06:59:52 [DEBUG   ] Finished updating ant stats in 1.247 seconds
2018-12-26 06:59:52 [WARNING ] (13, 1, 'bot')
2018-12-26 06:59:52 [WARNING ] (13, 1, 'bot')
2018-12-26 06:59:52 [WARNING ] (13, 1, 'bot')
2018-12-26 06:59:52 [WARNING ] (13, 1, 'bot')
2018-12-26 06:59:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 06:59:52 [DEBUG   ] Finished updating board flags in 1.443 seconds
2018-12-26 07:00:12 [DEBUG   ] Finished updating ant stats in 1.260 seconds
2018-12-26 07:00:32 [DEBUG   ] Finished updating ant stats in 1.099 seconds
2018-12-26 07:00:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:00:52 [DEBUG   ] Finished updating ant stats in 1.045 seconds
2018-12-26 07:00:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-26 07:00:52 [WARNING ] (13, 1, 'bot')
2018-12-26 07:00:52 [WARNING ] (13, 1, 'bot')
2018-12-26 07:00:52 [WARNING ] (13, 1, 'bot')
2018-12-26 07:00:52 [WARNING ] (13, 1, 'bot')
2018-12-26 07:00:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:00:52 [DEBUG   ] Finished updating board flags in 1.456 seconds
2018-12-26 07:00:58 [DEBUG   ] Got command RPT from MCS: ref #955659
2018-12-26 07:00:58 [DEBUG   ] summary = ERROR
2018-12-26 07:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955659  13 58478 25258601 A  ERRORERROR'
2018-12-26 07:00:58 [DEBUG   ] Got command RPT from MCS: ref #955660
2018-12-26 07:00:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 07:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955660  77 58478 25258602 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 07:01:12 [DEBUG   ] Finished updating ant stats in 0.956 seconds
2018-12-26 07:01:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 07:01:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:01:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 07:01:52 [DEBUG   ] Finished updating ant stats in 0.846 seconds
2018-12-26 07:01:52 [WARNING ] (13, 1, 'bot')
2018-12-26 07:01:52 [WARNING ] (13, 1, 'bot')
2018-12-26 07:01:52 [WARNING ] (13, 1, 'bot')
2018-12-26 07:01:52 [WARNING ] (13, 1, 'bot')
2018-12-26 07:01:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:01:52 [DEBUG   ] Finished updating board flags in 1.451 seconds
2018-12-26 07:02:12 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2018-12-26 07:02:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 07:02:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:02:52 [DEBUG   ] Finished updating ant stats in 0.648 seconds
2018-12-26 07:02:52 [WARNING ] (13, 1, 'bot')
2018-12-26 07:02:52 [WARNING ] (13, 1, 'bot')
2018-12-26 07:02:52 [WARNING ] (13, 1, 'bot')
2018-12-26 07:02:52 [WARNING ] (13, 1, 'bot')
2018-12-26 07:02:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:02:52 [DEBUG   ] Finished updating board flags in 1.476 seconds
2018-12-26 07:03:12 [DEBUG   ] Finished updating ant stats in 0.554 seconds
2018-12-26 07:03:32 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 07:03:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 07:03:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:03:53 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-12-26 07:03:53 [WARNING ] (13, 1, 'bot')
2018-12-26 07:03:53 [WARNING ] (13, 1, 'bot')
2018-12-26 07:03:53 [WARNING ] (13, 1, 'bot')
2018-12-26 07:03:53 [WARNING ] (13, 1, 'bot')
2018-12-26 07:03:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:03:53 [DEBUG   ] Finished updating board flags in 2.179 seconds
2018-12-26 07:04:12 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-26 07:04:32 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-12-26 07:04:32 [DEBUG   ] Got command RPT from MCS: ref #955684
2018-12-26 07:04:32 [DEBUG   ] summary = ERROR
2018-12-26 07:04:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955684  13 58478 25472665 A  ERRORERROR'
2018-12-26 07:04:32 [DEBUG   ] Got command RPT from MCS: ref #955685
2018-12-26 07:04:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 07:04:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955685  77 58478 25472869 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 07:04:33 [DEBUG   ] Got command RPT from MCS: ref #955686
2018-12-26 07:04:33 [DEBUG   ] summary = ERROR
2018-12-26 07:04:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955686  13 58478 25473073 A  ERRORERROR'
2018-12-26 07:04:33 [DEBUG   ] Got command RPT from MCS: ref #955688
2018-12-26 07:04:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 07:04:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955688  77 58478 25473277 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 07:04:33 [DEBUG   ] Got command RPT from MCS: ref #955689
2018-12-26 07:04:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 07:04:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955689  12 58478 25473469 A  ERRORB˜™š'
2018-12-26 07:04:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:04:53 [DEBUG   ] Finished updating ant stats in 1.247 seconds
2018-12-26 07:04:53 [WARNING ] (13, 1, 'bot')
2018-12-26 07:04:53 [WARNING ] (13, 1, 'bot')
2018-12-26 07:04:53 [WARNING ] (13, 1, 'bot')
2018-12-26 07:04:53 [WARNING ] (13, 1, 'bot')
2018-12-26 07:04:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:04:53 [DEBUG   ] Finished updating board flags in 2.051 seconds
2018-12-26 07:05:13 [DEBUG   ] Finished updating ant stats in 1.522 seconds
2018-12-26 07:05:33 [DEBUG   ] Finished updating ant stats in 1.039 seconds
2018-12-26 07:05:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:05:53 [DEBUG   ] Finished updating ant stats in 1.046 seconds
2018-12-26 07:05:53 [WARNING ] (13, 1, 'bot')
2018-12-26 07:05:53 [WARNING ] (13, 1, 'bot')
2018-12-26 07:05:53 [WARNING ] (13, 1, 'bot')
2018-12-26 07:05:53 [WARNING ] (13, 1, 'bot')
2018-12-26 07:05:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:05:53 [DEBUG   ] Finished updating board flags in 2.019 seconds
2018-12-26 07:05:58 [DEBUG   ] Got command RPT from MCS: ref #955694
2018-12-26 07:05:58 [DEBUG   ] summary = ERROR
2018-12-26 07:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955694  13 58478 25558601 A  ERRORERROR'
2018-12-26 07:05:58 [DEBUG   ] Got command RPT from MCS: ref #955695
2018-12-26 07:05:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 07:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955695  77 58478 25558602 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 07:06:13 [DEBUG   ] Finished updating ant stats in 0.958 seconds
2018-12-26 07:06:33 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 07:06:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:06:53 [DEBUG   ] Finished updating ant stats in 0.843 seconds
2018-12-26 07:06:53 [WARNING ] (13, 1, 'bot')
2018-12-26 07:06:53 [WARNING ] (13, 1, 'bot')
2018-12-26 07:06:53 [WARNING ] (13, 1, 'bot')
2018-12-26 07:06:53 [WARNING ] (13, 1, 'bot')
2018-12-26 07:06:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:06:53 [DEBUG   ] Finished updating board flags in 2.007 seconds
2018-12-26 07:07:13 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2018-12-26 07:07:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 07:07:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:07:53 [DEBUG   ] Finished updating ant stats in 0.647 seconds
2018-12-26 07:07:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-26 07:07:53 [WARNING ] (13, 1, 'bot')
2018-12-26 07:07:53 [WARNING ] (13, 1, 'bot')
2018-12-26 07:07:53 [WARNING ] (13, 1, 'bot')
2018-12-26 07:07:53 [WARNING ] (13, 1, 'bot')
2018-12-26 07:07:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:07:53 [DEBUG   ] Finished updating board flags in 1.978 seconds
2018-12-26 07:08:13 [DEBUG   ] Finished updating ant stats in 0.559 seconds
2018-12-26 07:08:33 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 07:08:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:08:53 [WARNING ] (13, 1, 'bot')
2018-12-26 07:08:53 [WARNING ] (13, 1, 'bot')
2018-12-26 07:08:53 [WARNING ] (13, 1, 'bot')
2018-12-26 07:08:53 [WARNING ] (13, 1, 'bot')
2018-12-26 07:08:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:08:53 [DEBUG   ] Finished updating board flags in 1.837 seconds
2018-12-26 07:08:54 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-26 07:09:13 [DEBUG   ] Finished updating ant stats in 0.407 seconds
2018-12-26 07:09:32 [DEBUG   ] Got command RPT from MCS: ref #955715
2018-12-26 07:09:32 [DEBUG   ] summary = ERROR
2018-12-26 07:09:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955715  13 58478 25772753 A  ERRORERROR'
2018-12-26 07:09:32 [DEBUG   ] Got command RPT from MCS: ref #955716
2018-12-26 07:09:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 07:09:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955716  77 58478 25772958 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 07:09:33 [DEBUG   ] Got command RPT from MCS: ref #955717
2018-12-26 07:09:33 [DEBUG   ] summary = ERROR
2018-12-26 07:09:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955717  13 58478 25773153 A  ERRORERROR'
2018-12-26 07:09:33 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-26 07:09:33 [DEBUG   ] Got command RPT from MCS: ref #955718
2018-12-26 07:09:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 07:09:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955718  77 58478 25773353 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 07:09:33 [DEBUG   ] Got command RPT from MCS: ref #955719
2018-12-26 07:09:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 07:09:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955719  12 58478 25773557 A  ERRORB–™š'
2018-12-26 07:09:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:09:53 [WARNING ] (13, 1, 'bot')
2018-12-26 07:09:53 [WARNING ] (13, 1, 'bot')
2018-12-26 07:09:53 [WARNING ] (13, 1, 'bot')
2018-12-26 07:09:53 [WARNING ] (13, 1, 'bot')
2018-12-26 07:09:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:09:53 [DEBUG   ] Finished updating board flags in 1.795 seconds
2018-12-26 07:09:54 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-12-26 07:10:14 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-26 07:10:34 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-26 07:10:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:10:53 [WARNING ] (13, 1, 'bot')
2018-12-26 07:10:53 [WARNING ] (13, 1, 'bot')
2018-12-26 07:10:53 [WARNING ] (13, 1, 'bot')
2018-12-26 07:10:53 [WARNING ] (13, 1, 'bot')
2018-12-26 07:10:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:10:53 [DEBUG   ] Finished updating board flags in 1.580 seconds
2018-12-26 07:10:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 07:10:58 [DEBUG   ] Got command RPT from MCS: ref #955724
2018-12-26 07:10:58 [DEBUG   ] summary = ERROR
2018-12-26 07:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955724  13 58478 25858597 A  ERRORERROR'
2018-12-26 07:10:58 [DEBUG   ] Got command RPT from MCS: ref #955725
2018-12-26 07:10:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 07:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955725  77 58478 25858598 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 07:11:14 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 07:11:34 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-26 07:11:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 4
2018-12-26 07:11:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:11:53 [WARNING ] (13, 1, 'bot')
2018-12-26 07:11:53 [WARNING ] (13, 1, 'bot')
2018-12-26 07:11:53 [WARNING ] (13, 1, 'bot')
2018-12-26 07:11:53 [WARNING ] (13, 1, 'bot')
2018-12-26 07:11:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:11:53 [DEBUG   ] Finished updating board flags in 1.408 seconds
2018-12-26 07:11:54 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-26 07:12:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 07:12:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 07:12:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:12:53 [WARNING ] (13, 1, 'bot')
2018-12-26 07:12:53 [WARNING ] (13, 1, 'bot')
2018-12-26 07:12:53 [WARNING ] (13, 1, 'bot')
2018-12-26 07:12:53 [WARNING ] (13, 1, 'bot')
2018-12-26 07:12:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:12:53 [DEBUG   ] Finished updating board flags in 1.394 seconds
2018-12-26 07:12:54 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-26 07:13:14 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-26 07:13:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 07:13:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:13:54 [DEBUG   ] Finished updating ant stats in 0.646 seconds
2018-12-26 07:13:54 [WARNING ] (13, 1, 'bot')
2018-12-26 07:13:54 [WARNING ] (13, 1, 'bot')
2018-12-26 07:13:54 [WARNING ] (13, 1, 'bot')
2018-12-26 07:13:54 [WARNING ] (13, 1, 'bot')
2018-12-26 07:13:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:13:54 [DEBUG   ] Finished updating board flags in 2.223 seconds
2018-12-26 07:14:14 [DEBUG   ] Finished updating ant stats in 0.560 seconds
2018-12-26 07:14:32 [DEBUG   ] Got command RPT from MCS: ref #955747
2018-12-26 07:14:32 [DEBUG   ] summary = ERROR
2018-12-26 07:14:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955747  13 58478 26072833 A  ERRORERROR'
2018-12-26 07:14:33 [DEBUG   ] Got command RPT from MCS: ref #955748
2018-12-26 07:14:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 07:14:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955748  77 58478 26073037 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 07:14:33 [DEBUG   ] Got command RPT from MCS: ref #955749
2018-12-26 07:14:33 [DEBUG   ] summary = ERROR
2018-12-26 07:14:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955749  13 58478 26073229 A  ERRORERROR'
2018-12-26 07:14:33 [DEBUG   ] Got command RPT from MCS: ref #955751
2018-12-26 07:14:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 07:14:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955751  77 58478 26073433 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 07:14:33 [DEBUG   ] Got command RPT from MCS: ref #955752
2018-12-26 07:14:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 07:14:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955752  12 58478 26073637 A  ERRORB–™š'
2018-12-26 07:14:34 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-12-26 07:14:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-12-26 07:14:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:14:54 [WARNING ] (13, 1, 'bot')
2018-12-26 07:14:54 [WARNING ] (13, 1, 'bot')
2018-12-26 07:14:54 [WARNING ] (13, 1, 'bot')
2018-12-26 07:14:54 [WARNING ] (13, 1, 'bot')
2018-12-26 07:14:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:14:54 [DEBUG   ] Finished updating board flags in 2.193 seconds
2018-12-26 07:14:55 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-12-26 07:15:15 [DEBUG   ] Finished updating ant stats in 1.512 seconds
2018-12-26 07:15:35 [DEBUG   ] Finished updating ant stats in 1.090 seconds
2018-12-26 07:15:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:15:54 [WARNING ] (13, 1, 'bot')
2018-12-26 07:15:54 [WARNING ] (13, 1, 'bot')
2018-12-26 07:15:54 [WARNING ] (13, 1, 'bot')
2018-12-26 07:15:54 [WARNING ] (13, 1, 'bot')
2018-12-26 07:15:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:15:54 [DEBUG   ] Finished updating board flags in 2.002 seconds
2018-12-26 07:15:55 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-26 07:15:58 [DEBUG   ] Got command RPT from MCS: ref #955758
2018-12-26 07:15:58 [DEBUG   ] summary = ERROR
2018-12-26 07:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955758  13 58478 26158601 A  ERRORERROR'
2018-12-26 07:15:58 [DEBUG   ] Got command RPT from MCS: ref #955759
2018-12-26 07:15:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 07:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955759  77 58478 26158602 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 07:16:15 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-26 07:16:35 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-26 07:16:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:16:54 [WARNING ] (13, 1, 'bot')
2018-12-26 07:16:54 [WARNING ] (13, 1, 'bot')
2018-12-26 07:16:54 [WARNING ] (13, 1, 'bot')
2018-12-26 07:16:54 [WARNING ] (13, 1, 'bot')
2018-12-26 07:16:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:16:54 [DEBUG   ] Finished updating board flags in 1.991 seconds
2018-12-26 07:16:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 07:17:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 07:17:35 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 07:17:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:17:54 [WARNING ] (13, 1, 'bot')
2018-12-26 07:17:54 [WARNING ] (13, 1, 'bot')
2018-12-26 07:17:54 [WARNING ] (13, 1, 'bot')
2018-12-26 07:17:54 [WARNING ] (13, 1, 'bot')
2018-12-26 07:17:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:17:54 [DEBUG   ] Finished updating board flags in 1.783 seconds
2018-12-26 07:17:55 [DEBUG   ] Finished updating ant stats in 0.790 seconds
2018-12-26 07:18:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 07:18:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 07:18:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:18:54 [WARNING ] (13, 1, 'bot')
2018-12-26 07:18:54 [WARNING ] (13, 1, 'bot')
2018-12-26 07:18:54 [WARNING ] (13, 1, 'bot')
2018-12-26 07:18:54 [WARNING ] (13, 1, 'bot')
2018-12-26 07:18:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:18:54 [DEBUG   ] Finished updating board flags in 1.574 seconds
2018-12-26 07:18:55 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 07:19:15 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-26 07:19:32 [DEBUG   ] Got command RPT from MCS: ref #955782
2018-12-26 07:19:32 [DEBUG   ] summary = ERROR
2018-12-26 07:19:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955782  13 58478 26372917 A  ERRORERROR'
2018-12-26 07:19:33 [DEBUG   ] Got command RPT from MCS: ref #955783
2018-12-26 07:19:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 07:19:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955783  77 58478 26373109 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 07:19:33 [DEBUG   ] Got command RPT from MCS: ref #955784
2018-12-26 07:19:33 [DEBUG   ] summary = ERROR
2018-12-26 07:19:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955784  13 58478 26373313 A  ERRORERROR'
2018-12-26 07:19:33 [DEBUG   ] Got command RPT from MCS: ref #955785
2018-12-26 07:19:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 07:19:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955785  77 58478 26373517 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 07:19:33 [DEBUG   ] Got command RPT from MCS: ref #955786
2018-12-26 07:19:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 07:19:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955786  12 58478 26373721 A  ERRORB˜™š'
2018-12-26 07:19:35 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 07:19:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:19:54 [WARNING ] (13, 1, 'bot')
2018-12-26 07:19:54 [WARNING ] (13, 1, 'bot')
2018-12-26 07:19:54 [WARNING ] (13, 1, 'bot')
2018-12-26 07:19:54 [WARNING ] (13, 1, 'bot')
2018-12-26 07:19:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:19:54 [DEBUG   ] Finished updating board flags in 1.396 seconds
2018-12-26 07:19:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 07:20:16 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-26 07:20:36 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-26 07:20:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:20:54 [WARNING ] (13, 1, 'bot')
2018-12-26 07:20:54 [WARNING ] (13, 1, 'bot')
2018-12-26 07:20:54 [WARNING ] (13, 1, 'bot')
2018-12-26 07:20:54 [WARNING ] (13, 1, 'bot')
2018-12-26 07:20:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:20:54 [DEBUG   ] Finished updating board flags in 1.357 seconds
2018-12-26 07:20:56 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2018-12-26 07:20:58 [DEBUG   ] Got command RPT from MCS: ref #955787
2018-12-26 07:20:58 [DEBUG   ] summary = ERROR
2018-12-26 07:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955787  13 58478 26458609 A  ERRORERROR'
2018-12-26 07:20:58 [DEBUG   ] Got command RPT from MCS: ref #955788
2018-12-26 07:20:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 07:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955788  77 58478 26458610 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 07:21:16 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 07:21:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 07:21:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:21:55 [WARNING ] (13, 1, 'bot')
2018-12-26 07:21:55 [WARNING ] (13, 1, 'bot')
2018-12-26 07:21:55 [WARNING ] (13, 1, 'bot')
2018-12-26 07:21:55 [WARNING ] (13, 1, 'bot')
2018-12-26 07:21:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:21:55 [DEBUG   ] Finished updating board flags in 2.101 seconds
2018-12-26 07:21:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 07:22:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 07:22:36 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 07:22:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:22:55 [WARNING ] (13, 1, 'bot')
2018-12-26 07:22:55 [WARNING ] (13, 1, 'bot')
2018-12-26 07:22:55 [WARNING ] (13, 1, 'bot')
2018-12-26 07:22:55 [WARNING ] (13, 1, 'bot')
2018-12-26 07:22:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:22:55 [DEBUG   ] Finished updating board flags in 2.013 seconds
2018-12-26 07:22:56 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-26 07:23:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 07:23:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 07:23:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:23:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-26 07:23:55 [WARNING ] (13, 1, 'bot')
2018-12-26 07:23:55 [WARNING ] (13, 1, 'bot')
2018-12-26 07:23:55 [WARNING ] (13, 1, 'bot')
2018-12-26 07:23:55 [WARNING ] (13, 1, 'bot')
2018-12-26 07:23:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:23:55 [DEBUG   ] Finished updating board flags in 1.986 seconds
2018-12-26 07:23:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 07:24:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 07:24:32 [DEBUG   ] Got command RPT from MCS: ref #955810
2018-12-26 07:24:32 [DEBUG   ] summary = ERROR
2018-12-26 07:24:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955810  13 58478 26672989 A  ERRORERROR'
2018-12-26 07:24:33 [DEBUG   ] Got command RPT from MCS: ref #955811
2018-12-26 07:24:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 07:24:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955811  77 58478 26673193 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 07:24:33 [DEBUG   ] Got command RPT from MCS: ref #955812
2018-12-26 07:24:33 [DEBUG   ] summary = ERROR
2018-12-26 07:24:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955812  13 58478 26673397 A  ERRORERROR'
2018-12-26 07:24:33 [DEBUG   ] Got command RPT from MCS: ref #955814
2018-12-26 07:24:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 07:24:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955814  77 58478 26673601 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 07:24:33 [DEBUG   ] Got command RPT from MCS: ref #955815
2018-12-26 07:24:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 07:24:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955815  12 58478 26673793 A  ERRORB–™š'
2018-12-26 07:24:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 07:24:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:24:55 [WARNING ] (13, 1, 'bot')
2018-12-26 07:24:55 [WARNING ] (13, 1, 'bot')
2018-12-26 07:24:55 [WARNING ] (13, 1, 'bot')
2018-12-26 07:24:55 [WARNING ] (13, 1, 'bot')
2018-12-26 07:24:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:24:55 [DEBUG   ] Finished updating board flags in 1.866 seconds
2018-12-26 07:24:56 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-26 07:25:16 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-26 07:25:37 [DEBUG   ] Finished updating ant stats in 1.602 seconds
2018-12-26 07:25:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:25:55 [WARNING ] (13, 1, 'bot')
2018-12-26 07:25:55 [WARNING ] (13, 1, 'bot')
2018-12-26 07:25:55 [WARNING ] (13, 1, 'bot')
2018-12-26 07:25:55 [WARNING ] (13, 1, 'bot')
2018-12-26 07:25:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:25:55 [DEBUG   ] Finished updating board flags in 1.690 seconds
2018-12-26 07:25:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 07:25:58 [DEBUG   ] Got command RPT from MCS: ref #955824
2018-12-26 07:25:58 [DEBUG   ] summary = ERROR
2018-12-26 07:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955824  13 58478 26758601 A  ERRORERROR'
2018-12-26 07:25:58 [DEBUG   ] Got command RPT from MCS: ref #955825
2018-12-26 07:25:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 07:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955825  77 58478 26758602 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 07:26:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 07:26:36 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 07:26:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:26:55 [WARNING ] (13, 1, 'bot')
2018-12-26 07:26:55 [WARNING ] (13, 1, 'bot')
2018-12-26 07:26:55 [WARNING ] (13, 1, 'bot')
2018-12-26 07:26:55 [WARNING ] (13, 1, 'bot')
2018-12-26 07:26:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:26:55 [DEBUG   ] Finished updating board flags in 1.640 seconds
2018-12-26 07:26:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 07:27:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 07:27:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 07:27:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:27:55 [WARNING ] (13, 1, 'bot')
2018-12-26 07:27:55 [WARNING ] (13, 1, 'bot')
2018-12-26 07:27:55 [WARNING ] (13, 1, 'bot')
2018-12-26 07:27:55 [WARNING ] (13, 1, 'bot')
2018-12-26 07:27:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:27:55 [DEBUG   ] Finished updating board flags in 1.566 seconds
2018-12-26 07:27:56 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 07:28:16 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-26 07:28:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 07:28:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:28:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-26 07:28:55 [WARNING ] (13, 1, 'bot')
2018-12-26 07:28:55 [WARNING ] (13, 1, 'bot')
2018-12-26 07:28:55 [WARNING ] (13, 1, 'bot')
2018-12-26 07:28:55 [WARNING ] (13, 1, 'bot')
2018-12-26 07:28:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:28:55 [DEBUG   ] Finished updating board flags in 1.483 seconds
2018-12-26 07:28:57 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-26 07:29:16 [DEBUG   ] Finished updating ant stats in 0.407 seconds
2018-12-26 07:29:33 [DEBUG   ] Got command RPT from MCS: ref #955845
2018-12-26 07:29:33 [DEBUG   ] summary = ERROR
2018-12-26 07:29:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955845  13 58478 26973069 A  ERRORERROR'
2018-12-26 07:29:33 [DEBUG   ] Got command RPT from MCS: ref #955846
2018-12-26 07:29:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 07:29:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955846  77 58478 26973273 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 07:29:33 [DEBUG   ] Got command RPT from MCS: ref #955847
2018-12-26 07:29:33 [DEBUG   ] summary = ERROR
2018-12-26 07:29:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955847  13 58478 26973477 A  ERRORERROR'
2018-12-26 07:29:33 [DEBUG   ] Got command RPT from MCS: ref #955848
2018-12-26 07:29:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 07:29:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955848  77 58478 26973681 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 07:29:33 [DEBUG   ] Got command RPT from MCS: ref #955849
2018-12-26 07:29:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 07:29:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955849  12 58478 26973873 A  ERRORB–™š'
2018-12-26 07:29:36 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-26 07:29:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:29:55 [WARNING ] (13, 1, 'bot')
2018-12-26 07:29:55 [WARNING ] (13, 1, 'bot')
2018-12-26 07:29:55 [WARNING ] (13, 1, 'bot')
2018-12-26 07:29:55 [WARNING ] (13, 1, 'bot')
2018-12-26 07:29:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:29:55 [DEBUG   ] Finished updating board flags in 1.537 seconds
2018-12-26 07:29:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 07:30:17 [DEBUG   ] Finished updating ant stats in 1.477 seconds
2018-12-26 07:30:37 [DEBUG   ] Finished updating ant stats in 1.323 seconds
2018-12-26 07:30:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:30:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:30:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:30:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:30:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:30:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:30:56 [DEBUG   ] Finished updating board flags in 2.247 seconds
2018-12-26 07:30:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 07:30:58 [DEBUG   ] Got command RPT from MCS: ref #955850
2018-12-26 07:30:58 [DEBUG   ] summary = ERROR
2018-12-26 07:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955850  13 58478 27058609 A  ERRORERROR'
2018-12-26 07:30:58 [DEBUG   ] Got command RPT from MCS: ref #955851
2018-12-26 07:30:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 07:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955851  77 58478 27058610 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 07:31:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 07:31:37 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 07:31:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:31:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:31:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:31:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:31:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:31:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:31:56 [DEBUG   ] Finished updating board flags in 2.215 seconds
2018-12-26 07:31:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 07:32:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 07:32:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 07:32:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:32:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:32:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:32:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:32:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:32:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:32:56 [DEBUG   ] Finished updating board flags in 2.232 seconds
2018-12-26 07:32:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 07:33:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 07:33:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 07:33:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:33:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:33:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:33:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:33:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:33:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:33:56 [DEBUG   ] Finished updating board flags in 2.224 seconds
2018-12-26 07:33:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 07:34:17 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 07:34:33 [DEBUG   ] Got command RPT from MCS: ref #955877
2018-12-26 07:34:33 [DEBUG   ] summary = ERROR
2018-12-26 07:34:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955877  13 58478 27273157 A  ERRORERROR'
2018-12-26 07:34:33 [DEBUG   ] Got command RPT from MCS: ref #955878
2018-12-26 07:34:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 07:34:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955878  77 58478 27273349 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 07:34:33 [DEBUG   ] Got command RPT from MCS: ref #955879
2018-12-26 07:34:33 [DEBUG   ] summary = ERROR
2018-12-26 07:34:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955879  13 58478 27273553 A  ERRORERROR'
2018-12-26 07:34:33 [DEBUG   ] Got command RPT from MCS: ref #955881
2018-12-26 07:34:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 07:34:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955881  77 58478 27273757 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 07:34:33 [DEBUG   ] Got command RPT from MCS: ref #955883
2018-12-26 07:34:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 07:34:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955883  12 58478 27273961 A  ERRORB˜™š'
2018-12-26 07:34:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 07:34:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:34:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:34:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:34:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:34:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:34:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:34:56 [DEBUG   ] Finished updating board flags in 2.223 seconds
2018-12-26 07:34:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 07:35:17 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-26 07:35:37 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 07:35:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:35:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:35:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:35:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:35:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:35:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:35:56 [DEBUG   ] Finished updating board flags in 2.104 seconds
2018-12-26 07:35:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 07:35:58 [DEBUG   ] Got command RPT from MCS: ref #955887
2018-12-26 07:35:58 [DEBUG   ] summary = ERROR
2018-12-26 07:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955887  13 58478 27358605 A  ERRORERROR'
2018-12-26 07:35:58 [DEBUG   ] Got command RPT from MCS: ref #955888
2018-12-26 07:35:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 07:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955888  77 58478 27358606 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 07:36:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 07:36:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 07:36:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:36:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 07:36:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:36:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:36:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:36:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:36:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:36:56 [DEBUG   ] Finished updating board flags in 2.029 seconds
2018-12-26 07:36:57 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 07:37:17 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-26 07:37:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 07:37:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:37:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:37:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:37:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:37:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:37:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:37:56 [DEBUG   ] Finished updating board flags in 1.951 seconds
2018-12-26 07:37:57 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-26 07:38:17 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 07:38:37 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-26 07:38:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:38:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:38:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:38:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:38:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:38:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:38:56 [DEBUG   ] Finished updating board flags in 1.802 seconds
2018-12-26 07:38:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 07:39:18 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-26 07:39:33 [DEBUG   ] Got command RPT from MCS: ref #955908
2018-12-26 07:39:33 [DEBUG   ] summary = ERROR
2018-12-26 07:39:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955908  13 58478 27573229 A  ERRORERROR'
2018-12-26 07:39:33 [DEBUG   ] Got command RPT from MCS: ref #955909
2018-12-26 07:39:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 07:39:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955909  77 58478 27573433 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 07:39:33 [DEBUG   ] Got command RPT from MCS: ref #955910
2018-12-26 07:39:33 [DEBUG   ] summary = ERROR
2018-12-26 07:39:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955910  13 58478 27573637 A  ERRORERROR'
2018-12-26 07:39:33 [DEBUG   ] Got command RPT from MCS: ref #955911
2018-12-26 07:39:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 07:39:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955911  77 58478 27573829 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 07:39:34 [DEBUG   ] Got command RPT from MCS: ref #955912
2018-12-26 07:39:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 07:39:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955912  12 58478 27574033 A  ERRORB—™š'
2018-12-26 07:39:38 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-26 07:39:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:39:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:39:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:39:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:39:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:39:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:39:56 [DEBUG   ] Finished updating board flags in 1.787 seconds
2018-12-26 07:39:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 07:40:18 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-26 07:40:38 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 07:40:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:40:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-26 07:40:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:40:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:40:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:40:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:40:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:40:56 [DEBUG   ] Finished updating board flags in 1.605 seconds
2018-12-26 07:40:58 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-26 07:40:58 [DEBUG   ] Got command RPT from MCS: ref #955917
2018-12-26 07:40:58 [DEBUG   ] summary = ERROR
2018-12-26 07:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955917  13 58478 27658609 A  ERRORERROR'
2018-12-26 07:40:58 [DEBUG   ] Got command RPT from MCS: ref #955918
2018-12-26 07:40:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 07:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955918  77 58478 27658610 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 07:41:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 07:41:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 07:41:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:41:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:41:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:41:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:41:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:41:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:41:56 [DEBUG   ] Finished updating board flags in 1.608 seconds
2018-12-26 07:41:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 07:42:18 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-26 07:42:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 07:42:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:42:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:42:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:42:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:42:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:42:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:42:56 [DEBUG   ] Finished updating board flags in 1.610 seconds
2018-12-26 07:42:58 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-26 07:43:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 07:43:38 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-12-26 07:43:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:43:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:43:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:43:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:43:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:43:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:43:56 [DEBUG   ] Finished updating board flags in 1.623 seconds
2018-12-26 07:43:58 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-12-26 07:44:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 07:44:33 [DEBUG   ] Got command RPT from MCS: ref #955940
2018-12-26 07:44:33 [DEBUG   ] summary = ERROR
2018-12-26 07:44:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955940  13 58478 27873309 A  ERRORERROR'
2018-12-26 07:44:33 [DEBUG   ] Got command RPT from MCS: ref #955941
2018-12-26 07:44:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 07:44:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955941  77 58478 27873513 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 07:44:33 [DEBUG   ] Got command RPT from MCS: ref #955942
2018-12-26 07:44:33 [DEBUG   ] summary = ERROR
2018-12-26 07:44:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955942  13 58478 27873717 A  ERRORERROR'
2018-12-26 07:44:33 [DEBUG   ] Got command RPT from MCS: ref #955944
2018-12-26 07:44:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 07:44:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955944  77 58478 27873910 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 07:44:34 [DEBUG   ] Got command RPT from MCS: ref #955946
2018-12-26 07:44:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 07:44:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955946  12 58478 27874113 A  ERRORB–™š'
2018-12-26 07:44:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 07:44:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:44:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:44:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:44:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:44:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:44:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:44:56 [DEBUG   ] Finished updating board flags in 1.557 seconds
2018-12-26 07:44:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 07:45:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 07:45:39 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-26 07:45:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:45:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:45:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:45:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:45:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:45:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:45:56 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-12-26 07:45:58 [DEBUG   ] Got command RPT from MCS: ref #955950
2018-12-26 07:45:58 [DEBUG   ] summary = ERROR
2018-12-26 07:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955950  13 58478 27958613 A  ERRORERROR'
2018-12-26 07:45:58 [DEBUG   ] Got command RPT from MCS: ref #955951
2018-12-26 07:45:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 07:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955951  77 58478 27958614 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 07:45:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 07:46:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 07:46:39 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 07:46:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:46:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:46:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:46:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:46:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:46:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:46:56 [DEBUG   ] Finished updating board flags in 1.383 seconds
2018-12-26 07:46:59 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-26 07:47:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 07:47:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 07:47:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:47:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:47:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:47:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:47:56 [WARNING ] (13, 1, 'bot')
2018-12-26 07:47:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:47:56 [DEBUG   ] Finished updating board flags in 1.356 seconds
2018-12-26 07:47:59 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 07:48:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 07:48:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-26 07:48:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 07:48:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:48:57 [WARNING ] (13, 1, 'bot')
2018-12-26 07:48:57 [WARNING ] (13, 1, 'bot')
2018-12-26 07:48:57 [WARNING ] (13, 1, 'bot')
2018-12-26 07:48:57 [WARNING ] (13, 1, 'bot')
2018-12-26 07:48:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:48:57 [DEBUG   ] Finished updating board flags in 2.129 seconds
2018-12-26 07:48:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 07:49:19 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 07:49:33 [DEBUG   ] Got command RPT from MCS: ref #955975
2018-12-26 07:49:33 [DEBUG   ] summary = ERROR
2018-12-26 07:49:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955975  13 58478 28173393 A  ERRORERROR'
2018-12-26 07:49:33 [DEBUG   ] Got command RPT from MCS: ref #955976
2018-12-26 07:49:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 07:49:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955976  77 58478 28173597 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 07:49:33 [DEBUG   ] Got command RPT from MCS: ref #955977
2018-12-26 07:49:33 [DEBUG   ] summary = ERROR
2018-12-26 07:49:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955977  13 58478 28173801 A  ERRORERROR'
2018-12-26 07:49:33 [DEBUG   ] Got command RPT from MCS: ref #955978
2018-12-26 07:49:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 07:49:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955978  77 58478 28173993 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 07:49:34 [DEBUG   ] Got command RPT from MCS: ref #955979
2018-12-26 07:49:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 07:49:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955979  12 58478 28174197 A  ERRORB˜™š'
2018-12-26 07:49:39 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-26 07:49:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:49:57 [WARNING ] (13, 1, 'bot')
2018-12-26 07:49:57 [WARNING ] (13, 1, 'bot')
2018-12-26 07:49:57 [WARNING ] (13, 1, 'bot')
2018-12-26 07:49:57 [WARNING ] (13, 1, 'bot')
2018-12-26 07:49:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:49:57 [DEBUG   ] Finished updating board flags in 1.925 seconds
2018-12-26 07:49:59 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-26 07:50:19 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 07:50:39 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-26 07:50:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:50:57 [WARNING ] (13, 1, 'bot')
2018-12-26 07:50:57 [WARNING ] (13, 1, 'bot')
2018-12-26 07:50:57 [WARNING ] (13, 1, 'bot')
2018-12-26 07:50:57 [WARNING ] (13, 1, 'bot')
2018-12-26 07:50:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:50:57 [DEBUG   ] Finished updating board flags in 1.821 seconds
2018-12-26 07:50:58 [DEBUG   ] Got command RPT from MCS: ref #955980
2018-12-26 07:50:58 [DEBUG   ] summary = ERROR
2018-12-26 07:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955980  13 58478 28258613 A  ERRORERROR'
2018-12-26 07:50:58 [DEBUG   ] Got command RPT from MCS: ref #955981
2018-12-26 07:50:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 07:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   955981  77 58478 28258614 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 07:51:00 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-26 07:51:20 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-26 07:51:40 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 07:51:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:51:57 [WARNING ] (13, 1, 'bot')
2018-12-26 07:51:57 [WARNING ] (13, 1, 'bot')
2018-12-26 07:51:57 [WARNING ] (13, 1, 'bot')
2018-12-26 07:51:57 [WARNING ] (13, 1, 'bot')
2018-12-26 07:51:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:51:57 [DEBUG   ] Finished updating board flags in 1.808 seconds
2018-12-26 07:52:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 07:52:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 07:52:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 07:52:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:52:57 [WARNING ] (13, 1, 'bot')
2018-12-26 07:52:57 [WARNING ] (13, 1, 'bot')
2018-12-26 07:52:57 [WARNING ] (13, 1, 'bot')
2018-12-26 07:52:57 [WARNING ] (13, 1, 'bot')
2018-12-26 07:52:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:52:57 [DEBUG   ] Finished updating board flags in 1.781 seconds
2018-12-26 07:53:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 07:53:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 07:53:40 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-26 07:53:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:53:57 [WARNING ] (13, 1, 'bot')
2018-12-26 07:53:57 [WARNING ] (13, 1, 'bot')
2018-12-26 07:53:57 [WARNING ] (13, 1, 'bot')
2018-12-26 07:53:57 [WARNING ] (13, 1, 'bot')
2018-12-26 07:53:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:53:57 [DEBUG   ] Finished updating board flags in 1.626 seconds
2018-12-26 07:54:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 07:54:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 07:54:33 [DEBUG   ] Got command RPT from MCS: ref #956003
2018-12-26 07:54:33 [DEBUG   ] summary = ERROR
2018-12-26 07:54:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956003  13 58478 28473473 A  ERRORERROR'
2018-12-26 07:54:33 [DEBUG   ] Got command RPT from MCS: ref #956004
2018-12-26 07:54:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 07:54:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956004  77 58478 28473677 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 07:54:33 [DEBUG   ] Got command RPT from MCS: ref #956005
2018-12-26 07:54:33 [DEBUG   ] summary = ERROR
2018-12-26 07:54:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956005  13 58478 28473881 A  ERRORERROR'
2018-12-26 07:54:34 [DEBUG   ] Got command RPT from MCS: ref #956007
2018-12-26 07:54:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 07:54:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956007  77 58478 28474073 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 07:54:34 [DEBUG   ] Got command RPT from MCS: ref #956009
2018-12-26 07:54:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 07:54:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956009  12 58478 28474277 A  ERRORB˜™š'
2018-12-26 07:54:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 07:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:54:57 [WARNING ] (13, 1, 'bot')
2018-12-26 07:54:57 [WARNING ] (13, 1, 'bot')
2018-12-26 07:54:57 [WARNING ] (13, 1, 'bot')
2018-12-26 07:54:57 [WARNING ] (13, 1, 'bot')
2018-12-26 07:54:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:54:57 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-12-26 07:55:00 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-26 07:55:20 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 07:55:40 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 07:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:55:57 [WARNING ] (13, 1, 'bot')
2018-12-26 07:55:57 [WARNING ] (13, 1, 'bot')
2018-12-26 07:55:57 [WARNING ] (13, 1, 'bot')
2018-12-26 07:55:57 [WARNING ] (13, 1, 'bot')
2018-12-26 07:55:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:55:57 [DEBUG   ] Finished updating board flags in 1.691 seconds
2018-12-26 07:55:58 [DEBUG   ] Got command RPT from MCS: ref #956017
2018-12-26 07:55:58 [DEBUG   ] summary = ERROR
2018-12-26 07:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956017  13 58478 28558617 A  ERRORERROR'
2018-12-26 07:55:58 [DEBUG   ] Got command RPT from MCS: ref #956018
2018-12-26 07:55:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 07:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956018  77 58478 28558618 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 07:56:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 07:56:20 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-26 07:56:40 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 07:56:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:56:57 [WARNING ] (13, 1, 'bot')
2018-12-26 07:56:57 [WARNING ] (13, 1, 'bot')
2018-12-26 07:56:57 [WARNING ] (13, 1, 'bot')
2018-12-26 07:56:57 [WARNING ] (13, 1, 'bot')
2018-12-26 07:56:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:56:57 [DEBUG   ] Finished updating board flags in 1.489 seconds
2018-12-26 07:57:00 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 07:57:20 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-26 07:57:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 07:57:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:57:57 [WARNING ] (13, 1, 'bot')
2018-12-26 07:57:57 [WARNING ] (13, 1, 'bot')
2018-12-26 07:57:57 [WARNING ] (13, 1, 'bot')
2018-12-26 07:57:57 [WARNING ] (13, 1, 'bot')
2018-12-26 07:57:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:57:57 [DEBUG   ] Finished updating board flags in 1.488 seconds
2018-12-26 07:58:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 07:58:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 07:58:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 07:58:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:58:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-26 07:58:57 [WARNING ] (13, 1, 'bot')
2018-12-26 07:58:57 [WARNING ] (13, 1, 'bot')
2018-12-26 07:58:57 [WARNING ] (13, 1, 'bot')
2018-12-26 07:58:57 [WARNING ] (13, 1, 'bot')
2018-12-26 07:58:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:58:57 [DEBUG   ] Finished updating board flags in 1.502 seconds
2018-12-26 07:59:00 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-26 07:59:20 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 07:59:33 [DEBUG   ] Got command RPT from MCS: ref #956038
2018-12-26 07:59:33 [DEBUG   ] summary = ERROR
2018-12-26 07:59:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956038  13 58478 28773557 A  ERRORERROR'
2018-12-26 07:59:33 [DEBUG   ] Got command RPT from MCS: ref #956039
2018-12-26 07:59:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 07:59:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956039  77 58478 28773761 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 07:59:33 [DEBUG   ] Got command RPT from MCS: ref #956040
2018-12-26 07:59:33 [DEBUG   ] summary = ERROR
2018-12-26 07:59:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956040  13 58478 28773953 A  ERRORERROR'
2018-12-26 07:59:34 [DEBUG   ] Got command RPT from MCS: ref #956041
2018-12-26 07:59:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 07:59:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956041  77 58478 28774157 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 07:59:34 [DEBUG   ] Got command RPT from MCS: ref #956042
2018-12-26 07:59:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 07:59:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956042  12 58478 28774361 A  ERRORB–™š'
2018-12-26 07:59:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 07:59:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 07:59:57 [WARNING ] (13, 1, 'bot')
2018-12-26 07:59:57 [WARNING ] (13, 1, 'bot')
2018-12-26 07:59:57 [WARNING ] (13, 1, 'bot')
2018-12-26 07:59:57 [WARNING ] (13, 1, 'bot')
2018-12-26 07:59:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 07:59:57 [DEBUG   ] Finished updating board flags in 1.505 seconds
2018-12-26 08:00:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 08:00:20 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-26 08:00:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 08:00:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 08:00:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:00:58 [DEBUG   ] Got command RPT from MCS: ref #956043
2018-12-26 08:00:58 [DEBUG   ] summary = ERROR
2018-12-26 08:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956043  13 58478 28858617 A  ERRORERROR'
2018-12-26 08:00:58 [DEBUG   ] Got command RPT from MCS: ref #956044
2018-12-26 08:00:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 08:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956044  77 58478 28858618 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 08:00:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:00:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:00:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:00:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:00:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:00:58 [DEBUG   ] Finished updating board flags in 2.130 seconds
2018-12-26 08:01:00 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 08:01:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 08:01:40 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-26 08:01:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-26 08:01:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:01:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:01:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:01:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:01:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:01:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:01:58 [DEBUG   ] Finished updating board flags in 2.060 seconds
2018-12-26 08:02:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 08:02:20 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 08:02:40 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-26 08:02:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 08:02:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:02:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-26 08:02:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:02:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:02:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:02:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:02:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:02:58 [DEBUG   ] Finished updating board flags in 1.917 seconds
2018-12-26 08:03:00 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-26 08:03:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 08:03:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 08:03:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 08:03:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:03:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-26 08:03:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:03:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:03:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:03:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:03:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:03:58 [DEBUG   ] Finished updating board flags in 1.808 seconds
2018-12-26 08:04:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 08:04:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 08:04:33 [DEBUG   ] Got command RPT from MCS: ref #956070
2018-12-26 08:04:33 [DEBUG   ] summary = ERROR
2018-12-26 08:04:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956070  13 58478 29073641 A  ERRORERROR'
2018-12-26 08:04:33 [DEBUG   ] Got command RPT from MCS: ref #956071
2018-12-26 08:04:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 08:04:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956071  77 58478 29073833 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 08:04:34 [DEBUG   ] Got command RPT from MCS: ref #956072
2018-12-26 08:04:34 [DEBUG   ] summary = ERROR
2018-12-26 08:04:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956072  13 58478 29074037 A  ERRORERROR'
2018-12-26 08:04:34 [DEBUG   ] Got command RPT from MCS: ref #956074
2018-12-26 08:04:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 08:04:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956074  77 58478 29074241 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 08:04:34 [DEBUG   ] Got command RPT from MCS: ref #956076
2018-12-26 08:04:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 08:04:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956076  12 58478 29074445 A  ERRORB˜™š'
2018-12-26 08:04:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 08:04:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:04:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:04:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:04:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:04:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:04:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:04:58 [DEBUG   ] Finished updating board flags in 1.845 seconds
2018-12-26 08:05:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 08:05:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 08:05:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 08:05:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 08:05:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:05:58 [DEBUG   ] Got command RPT from MCS: ref #956080
2018-12-26 08:05:58 [DEBUG   ] summary = ERROR
2018-12-26 08:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956080  13 58478 29158613 A  ERRORERROR'
2018-12-26 08:05:58 [DEBUG   ] Got command RPT from MCS: ref #956081
2018-12-26 08:05:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 08:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956081  77 58478 29158614 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 08:05:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:05:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:05:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:05:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:05:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:05:58 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-12-26 08:06:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 08:06:20 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 08:06:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 08:06:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:06:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:06:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:06:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:06:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:06:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:06:58 [DEBUG   ] Finished updating board flags in 1.833 seconds
2018-12-26 08:07:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 08:07:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 08:07:40 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 08:07:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:07:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:07:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:07:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:07:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:07:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:07:58 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-12-26 08:08:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 08:08:20 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-26 08:08:40 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 08:08:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:08:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:08:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:08:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:08:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:08:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:08:58 [DEBUG   ] Finished updating board flags in 1.694 seconds
2018-12-26 08:09:00 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-26 08:09:20 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-26 08:09:33 [DEBUG   ] Got command RPT from MCS: ref #956101
2018-12-26 08:09:33 [DEBUG   ] summary = ERROR
2018-12-26 08:09:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956101  13 58478 29373717 A  ERRORERROR'
2018-12-26 08:09:33 [DEBUG   ] Got command RPT from MCS: ref #956102
2018-12-26 08:09:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 08:09:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956102  77 58478 29373921 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 08:09:34 [DEBUG   ] Got command RPT from MCS: ref #956103
2018-12-26 08:09:34 [DEBUG   ] summary = ERROR
2018-12-26 08:09:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956103  13 58478 29374125 A  ERRORERROR'
2018-12-26 08:09:34 [DEBUG   ] Got command RPT from MCS: ref #956104
2018-12-26 08:09:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 08:09:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956104  77 58478 29374317 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 08:09:34 [DEBUG   ] Got command RPT from MCS: ref #956105
2018-12-26 08:09:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 08:09:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956105  12 58478 29374521 A  ERRORB—™š'
2018-12-26 08:09:40 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 08:09:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:09:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:09:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:09:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:09:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:09:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:09:58 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-12-26 08:10:01 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-26 08:10:20 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-26 08:10:40 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 08:10:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:10:58 [DEBUG   ] Got command RPT from MCS: ref #956110
2018-12-26 08:10:58 [DEBUG   ] summary = ERROR
2018-12-26 08:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956110  13 58478 29458617 A  ERRORERROR'
2018-12-26 08:10:58 [DEBUG   ] Got command RPT from MCS: ref #956111
2018-12-26 08:10:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 08:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956111  77 58478 29458618 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 08:10:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:10:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:10:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:10:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:10:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:10:58 [DEBUG   ] Finished updating board flags in 1.571 seconds
2018-12-26 08:11:00 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 08:11:21 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-26 08:11:41 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-26 08:11:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:11:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:11:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:11:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:11:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:11:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:11:58 [DEBUG   ] Finished updating board flags in 1.425 seconds
2018-12-26 08:12:01 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-26 08:12:21 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-26 08:12:41 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 08:12:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:12:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-26 08:12:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:12:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:12:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:12:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:12:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:12:58 [DEBUG   ] Finished updating board flags in 1.381 seconds
2018-12-26 08:13:01 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2018-12-26 08:13:21 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-26 08:13:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 08:13:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:13:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:13:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:13:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:13:58 [WARNING ] (13, 1, 'bot')
2018-12-26 08:13:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:13:58 [DEBUG   ] Finished updating board flags in 1.416 seconds
2018-12-26 08:14:01 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-12-26 08:14:21 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-26 08:14:33 [DEBUG   ] Got command RPT from MCS: ref #956133
2018-12-26 08:14:33 [DEBUG   ] summary = ERROR
2018-12-26 08:14:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956133  13 58478 29673801 A  ERRORERROR'
2018-12-26 08:14:34 [DEBUG   ] Got command RPT from MCS: ref #956134
2018-12-26 08:14:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 08:14:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956134  77 58478 29674005 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 08:14:34 [DEBUG   ] Got command RPT from MCS: ref #956135
2018-12-26 08:14:34 [DEBUG   ] summary = ERROR
2018-12-26 08:14:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956135  13 58478 29674197 A  ERRORERROR'
2018-12-26 08:14:34 [DEBUG   ] Got command RPT from MCS: ref #956137
2018-12-26 08:14:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 08:14:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956137  77 58478 29674401 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 08:14:34 [DEBUG   ] Got command RPT from MCS: ref #956138
2018-12-26 08:14:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 08:14:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956138  12 58478 29674605 A  ERRORB–™š'
2018-12-26 08:14:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 08:14:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:14:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:14:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:14:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:14:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:14:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:14:59 [DEBUG   ] Finished updating board flags in 2.229 seconds
2018-12-26 08:15:01 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-12-26 08:15:21 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-26 08:15:42 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-12-26 08:15:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2018-12-26 08:15:58 [DEBUG   ] Got command RPT from MCS: ref #956143
2018-12-26 08:15:58 [DEBUG   ] summary = ERROR
2018-12-26 08:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956143  13 58478 29758617 A  ERRORERROR'
2018-12-26 08:15:58 [DEBUG   ] Got command RPT from MCS: ref #956144
2018-12-26 08:15:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 08:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956144  77 58478 29758618 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 08:15:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:15:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:15:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:15:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:15:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:15:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:15:59 [DEBUG   ] Finished updating board flags in 2.178 seconds
2018-12-26 08:16:02 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-26 08:16:22 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 08:16:42 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-26 08:16:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:16:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:16:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:16:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:16:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:16:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:16:59 [DEBUG   ] Finished updating board flags in 1.997 seconds
2018-12-26 08:17:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 08:17:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 08:17:42 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 08:17:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-12-26 08:17:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:17:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:17:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:17:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:17:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:17:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:17:59 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-12-26 08:18:02 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-26 08:18:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 08:18:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 08:18:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:18:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:18:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:18:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:18:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:18:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:18:59 [DEBUG   ] Finished updating board flags in 1.788 seconds
2018-12-26 08:19:02 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 08:19:22 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-12-26 08:19:33 [DEBUG   ] Got command RPT from MCS: ref #956168
2018-12-26 08:19:33 [DEBUG   ] summary = ERROR
2018-12-26 08:19:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956168  13 58478 29973885 A  ERRORERROR'
2018-12-26 08:19:34 [DEBUG   ] Got command RPT from MCS: ref #956169
2018-12-26 08:19:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 08:19:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956169  77 58478 29974077 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 08:19:34 [DEBUG   ] Got command RPT from MCS: ref #956170
2018-12-26 08:19:34 [DEBUG   ] summary = ERROR
2018-12-26 08:19:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956170  13 58478 29974281 A  ERRORERROR'
2018-12-26 08:19:34 [DEBUG   ] Got command RPT from MCS: ref #956171
2018-12-26 08:19:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 08:19:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956171  77 58478 29974485 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 08:19:34 [DEBUG   ] Got command RPT from MCS: ref #956172
2018-12-26 08:19:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 08:19:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956172  12 58478 29974677 A  ERRORB˜™š'
2018-12-26 08:19:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 08:19:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:19:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:19:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:19:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:19:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:19:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:19:59 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-12-26 08:20:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 08:20:22 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 08:20:42 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-26 08:20:58 [DEBUG   ] Got command RPT from MCS: ref #956173
2018-12-26 08:20:58 [DEBUG   ] summary = ERROR
2018-12-26 08:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956173  13 58478 30058613 A  ERRORERROR'
2018-12-26 08:20:58 [DEBUG   ] Got command RPT from MCS: ref #956174
2018-12-26 08:20:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 08:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956174  77 58478 30058614 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 08:20:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:20:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:20:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:20:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:20:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:20:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:20:59 [DEBUG   ] Finished updating board flags in 1.697 seconds
2018-12-26 08:21:02 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-26 08:21:22 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-26 08:21:42 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-26 08:21:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:21:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:21:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:21:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:21:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:21:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:21:59 [DEBUG   ] Finished updating board flags in 1.484 seconds
2018-12-26 08:22:03 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-12-26 08:22:23 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-26 08:22:43 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-26 08:22:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:22:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 08:22:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:22:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:22:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:22:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:22:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:22:59 [DEBUG   ] Finished updating board flags in 1.430 seconds
2018-12-26 08:23:03 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-26 08:23:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 08:23:43 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 08:23:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:23:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:23:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:23:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:23:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:23:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:23:59 [DEBUG   ] Finished updating board flags in 1.441 seconds
2018-12-26 08:24:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 08:24:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 08:24:33 [DEBUG   ] Got command RPT from MCS: ref #956196
2018-12-26 08:24:33 [DEBUG   ] summary = ERROR
2018-12-26 08:24:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956196  13 58478 30273961 A  ERRORERROR'
2018-12-26 08:24:34 [DEBUG   ] Got command RPT from MCS: ref #956197
2018-12-26 08:24:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 08:24:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956197  77 58478 30274165 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 08:24:34 [DEBUG   ] Got command RPT from MCS: ref #956198
2018-12-26 08:24:34 [DEBUG   ] summary = ERROR
2018-12-26 08:24:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956198  13 58478 30274357 A  ERRORERROR'
2018-12-26 08:24:34 [DEBUG   ] Got command RPT from MCS: ref #956200
2018-12-26 08:24:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 08:24:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956200  77 58478 30274561 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 08:24:34 [DEBUG   ] Got command RPT from MCS: ref #956201
2018-12-26 08:24:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 08:24:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956201  12 58478 30274765 A  ERRORB—™š'
2018-12-26 08:24:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 08:24:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:24:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:24:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:24:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:24:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:24:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:24:59 [DEBUG   ] Finished updating board flags in 1.469 seconds
2018-12-26 08:25:03 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-26 08:25:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 08:25:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 08:25:58 [DEBUG   ] Got command RPT from MCS: ref #956210
2018-12-26 08:25:58 [DEBUG   ] summary = ERROR
2018-12-26 08:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956210  13 58478 30358621 A  ERRORERROR'
2018-12-26 08:25:58 [DEBUG   ] Got command RPT from MCS: ref #956211
2018-12-26 08:25:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 08:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956211  77 58478 30358622 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 08:25:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:25:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:25:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:25:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:25:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:25:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:25:59 [DEBUG   ] Finished updating board flags in 1.477 seconds
2018-12-26 08:26:03 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-26 08:26:23 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 08:26:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 08:26:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:26:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:26:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:26:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:26:59 [WARNING ] (13, 1, 'bot')
2018-12-26 08:26:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:26:59 [DEBUG   ] Finished updating board flags in 1.483 seconds
2018-12-26 08:27:03 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-26 08:27:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 08:27:43 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 08:27:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:28:00 [WARNING ] (13, 1, 'bot')
2018-12-26 08:28:00 [WARNING ] (13, 1, 'bot')
2018-12-26 08:28:00 [WARNING ] (13, 1, 'bot')
2018-12-26 08:28:00 [WARNING ] (13, 1, 'bot')
2018-12-26 08:28:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:28:00 [DEBUG   ] Finished updating board flags in 2.209 seconds
2018-12-26 08:28:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 08:28:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 08:28:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 08:28:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:29:00 [WARNING ] (13, 1, 'bot')
2018-12-26 08:29:00 [WARNING ] (13, 1, 'bot')
2018-12-26 08:29:00 [WARNING ] (13, 1, 'bot')
2018-12-26 08:29:00 [WARNING ] (13, 1, 'bot')
2018-12-26 08:29:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:29:00 [DEBUG   ] Finished updating board flags in 2.156 seconds
2018-12-26 08:29:03 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 08:29:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 08:29:34 [DEBUG   ] Got command RPT from MCS: ref #956231
2018-12-26 08:29:34 [DEBUG   ] summary = ERROR
2018-12-26 08:29:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956231  13 58478 30574037 A  ERRORERROR'
2018-12-26 08:29:34 [DEBUG   ] Got command RPT from MCS: ref #956232
2018-12-26 08:29:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 08:29:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956232  77 58478 30574241 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 08:29:34 [DEBUG   ] Got command RPT from MCS: ref #956233
2018-12-26 08:29:34 [DEBUG   ] summary = ERROR
2018-12-26 08:29:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956233  13 58478 30574445 A  ERRORERROR'
2018-12-26 08:29:34 [DEBUG   ] Got command RPT from MCS: ref #956234
2018-12-26 08:29:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 08:29:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956234  77 58478 30574649 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 08:29:34 [DEBUG   ] Got command RPT from MCS: ref #956235
2018-12-26 08:29:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 08:29:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956235  12 58478 30574841 A  ERRORB–™š'
2018-12-26 08:29:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 08:29:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:30:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-26 08:30:00 [WARNING ] (13, 1, 'bot')
2018-12-26 08:30:00 [WARNING ] (13, 1, 'bot')
2018-12-26 08:30:00 [WARNING ] (13, 1, 'bot')
2018-12-26 08:30:00 [WARNING ] (13, 1, 'bot')
2018-12-26 08:30:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:30:00 [DEBUG   ] Finished updating board flags in 1.995 seconds
2018-12-26 08:30:03 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-26 08:30:23 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 08:30:43 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-26 08:30:58 [DEBUG   ] Got command RPT from MCS: ref #956236
2018-12-26 08:30:58 [DEBUG   ] summary = ERROR
2018-12-26 08:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956236  13 58478 30658617 A  ERRORERROR'
2018-12-26 08:30:58 [DEBUG   ] Got command RPT from MCS: ref #956237
2018-12-26 08:30:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 08:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956237  77 58478 30658618 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 08:30:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:31:00 [WARNING ] (13, 1, 'bot')
2018-12-26 08:31:00 [WARNING ] (13, 1, 'bot')
2018-12-26 08:31:00 [WARNING ] (13, 1, 'bot')
2018-12-26 08:31:00 [WARNING ] (13, 1, 'bot')
2018-12-26 08:31:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:31:00 [DEBUG   ] Finished updating board flags in 1.765 seconds
2018-12-26 08:31:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 08:31:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 08:31:43 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 08:31:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:32:00 [WARNING ] (13, 1, 'bot')
2018-12-26 08:32:00 [WARNING ] (13, 1, 'bot')
2018-12-26 08:32:00 [WARNING ] (13, 1, 'bot')
2018-12-26 08:32:00 [WARNING ] (13, 1, 'bot')
2018-12-26 08:32:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:32:00 [DEBUG   ] Finished updating board flags in 1.626 seconds
2018-12-26 08:32:03 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-26 08:32:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 08:32:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 08:32:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:33:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-26 08:33:00 [WARNING ] (13, 1, 'bot')
2018-12-26 08:33:00 [WARNING ] (13, 1, 'bot')
2018-12-26 08:33:00 [WARNING ] (13, 1, 'bot')
2018-12-26 08:33:00 [WARNING ] (13, 1, 'bot')
2018-12-26 08:33:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:33:00 [DEBUG   ] Finished updating board flags in 1.575 seconds
2018-12-26 08:33:04 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-26 08:33:24 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-26 08:33:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 08:33:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:34:00 [WARNING ] (13, 1, 'bot')
2018-12-26 08:34:00 [WARNING ] (13, 1, 'bot')
2018-12-26 08:34:00 [WARNING ] (13, 1, 'bot')
2018-12-26 08:34:00 [WARNING ] (13, 1, 'bot')
2018-12-26 08:34:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:34:00 [DEBUG   ] Finished updating board flags in 1.426 seconds
2018-12-26 08:34:04 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 08:34:24 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-26 08:34:34 [DEBUG   ] Got command RPT from MCS: ref #956263
2018-12-26 08:34:34 [DEBUG   ] summary = ERROR
2018-12-26 08:34:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956263  13 58478 30874121 A  ERRORERROR'
2018-12-26 08:34:34 [DEBUG   ] Got command RPT from MCS: ref #956264
2018-12-26 08:34:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 08:34:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956264  77 58478 30874325 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 08:34:34 [DEBUG   ] Got command RPT from MCS: ref #956265
2018-12-26 08:34:34 [DEBUG   ] summary = ERROR
2018-12-26 08:34:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956265  13 58478 30874517 A  ERRORERROR'
2018-12-26 08:34:34 [DEBUG   ] Got command RPT from MCS: ref #956267
2018-12-26 08:34:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 08:34:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956267  77 58478 30874721 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 08:34:34 [DEBUG   ] Got command RPT from MCS: ref #956268
2018-12-26 08:34:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 08:34:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956268  12 58478 30874925 A  ERRORB•™š'
2018-12-26 08:34:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 08:34:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:35:00 [WARNING ] (13, 1, 'bot')
2018-12-26 08:35:00 [WARNING ] (13, 1, 'bot')
2018-12-26 08:35:00 [WARNING ] (13, 1, 'bot')
2018-12-26 08:35:00 [WARNING ] (13, 1, 'bot')
2018-12-26 08:35:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:35:00 [DEBUG   ] Finished updating board flags in 1.379 seconds
2018-12-26 08:35:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 08:35:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 08:35:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 08:35:58 [DEBUG   ] Got command RPT from MCS: ref #956273
2018-12-26 08:35:58 [DEBUG   ] summary = ERROR
2018-12-26 08:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956273  13 58478 30958621 A  ERRORERROR'
2018-12-26 08:35:58 [DEBUG   ] Got command RPT from MCS: ref #956274
2018-12-26 08:35:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 08:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956274  77 58478 30958622 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 08:36:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:36:00 [WARNING ] (13, 1, 'bot')
2018-12-26 08:36:00 [WARNING ] (13, 1, 'bot')
2018-12-26 08:36:00 [WARNING ] (13, 1, 'bot')
2018-12-26 08:36:00 [WARNING ] (13, 1, 'bot')
2018-12-26 08:36:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:36:00 [DEBUG   ] Finished updating board flags in 1.369 seconds
2018-12-26 08:36:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 08:36:24 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 08:36:44 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 08:37:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 08:37:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-26 08:37:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:37:01 [WARNING ] (13, 1, 'bot')
2018-12-26 08:37:01 [WARNING ] (13, 1, 'bot')
2018-12-26 08:37:01 [WARNING ] (13, 1, 'bot')
2018-12-26 08:37:01 [WARNING ] (13, 1, 'bot')
2018-12-26 08:37:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:37:01 [DEBUG   ] Finished updating board flags in 2.052 seconds
2018-12-26 08:37:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 08:37:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 08:37:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 08:38:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:38:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 08:38:01 [WARNING ] (13, 1, 'bot')
2018-12-26 08:38:01 [WARNING ] (13, 1, 'bot')
2018-12-26 08:38:01 [WARNING ] (13, 1, 'bot')
2018-12-26 08:38:01 [WARNING ] (13, 1, 'bot')
2018-12-26 08:38:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:38:01 [DEBUG   ] Finished updating board flags in 2.016 seconds
2018-12-26 08:38:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 08:38:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 08:38:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 08:39:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:39:01 [WARNING ] (13, 1, 'bot')
2018-12-26 08:39:01 [WARNING ] (13, 1, 'bot')
2018-12-26 08:39:01 [WARNING ] (13, 1, 'bot')
2018-12-26 08:39:01 [WARNING ] (13, 1, 'bot')
2018-12-26 08:39:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:39:01 [DEBUG   ] Finished updating board flags in 2.097 seconds
2018-12-26 08:39:04 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 08:39:24 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-26 08:39:34 [DEBUG   ] Got command RPT from MCS: ref #956294
2018-12-26 08:39:34 [DEBUG   ] summary = ERROR
2018-12-26 08:39:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956294  13 58478 31174201 A  ERRORERROR'
2018-12-26 08:39:34 [DEBUG   ] Got command RPT from MCS: ref #956295
2018-12-26 08:39:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 08:39:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956295  77 58478 31174405 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 08:39:34 [DEBUG   ] Got command RPT from MCS: ref #956296
2018-12-26 08:39:34 [DEBUG   ] summary = ERROR
2018-12-26 08:39:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956296  13 58478 31174597 A  ERRORERROR'
2018-12-26 08:39:34 [DEBUG   ] Got command RPT from MCS: ref #956297
2018-12-26 08:39:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 08:39:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956297  77 58478 31174801 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 08:39:35 [DEBUG   ] Got command RPT from MCS: ref #956298
2018-12-26 08:39:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 08:39:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956298  12 58478 31175005 A  ERRORB—™š'
2018-12-26 08:39:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 08:40:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:40:01 [WARNING ] (13, 1, 'bot')
2018-12-26 08:40:01 [WARNING ] (13, 1, 'bot')
2018-12-26 08:40:01 [WARNING ] (13, 1, 'bot')
2018-12-26 08:40:01 [WARNING ] (13, 1, 'bot')
2018-12-26 08:40:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:40:01 [DEBUG   ] Finished updating board flags in 1.882 seconds
2018-12-26 08:40:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 08:40:24 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-26 08:40:44 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-26 08:40:58 [DEBUG   ] Got command RPT from MCS: ref #956303
2018-12-26 08:40:58 [DEBUG   ] summary = ERROR
2018-12-26 08:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956303  13 58478 31258621 A  ERRORERROR'
2018-12-26 08:40:58 [DEBUG   ] Got command RPT from MCS: ref #956304
2018-12-26 08:40:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 08:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956304  77 58478 31258622 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 08:41:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:41:01 [WARNING ] (13, 1, 'bot')
2018-12-26 08:41:01 [WARNING ] (13, 1, 'bot')
2018-12-26 08:41:01 [WARNING ] (13, 1, 'bot')
2018-12-26 08:41:01 [WARNING ] (13, 1, 'bot')
2018-12-26 08:41:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:41:01 [DEBUG   ] Finished updating board flags in 1.799 seconds
2018-12-26 08:41:05 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-12-26 08:41:25 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-26 08:41:45 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 08:42:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:42:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 08:42:01 [WARNING ] (13, 1, 'bot')
2018-12-26 08:42:01 [WARNING ] (13, 1, 'bot')
2018-12-26 08:42:01 [WARNING ] (13, 1, 'bot')
2018-12-26 08:42:01 [WARNING ] (13, 1, 'bot')
2018-12-26 08:42:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:42:01 [DEBUG   ] Finished updating board flags in 1.596 seconds
2018-12-26 08:42:05 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-26 08:42:25 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-26 08:42:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 08:43:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:43:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 08:43:01 [WARNING ] (13, 1, 'bot')
2018-12-26 08:43:01 [WARNING ] (13, 1, 'bot')
2018-12-26 08:43:01 [WARNING ] (13, 1, 'bot')
2018-12-26 08:43:01 [WARNING ] (13, 1, 'bot')
2018-12-26 08:43:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:43:01 [DEBUG   ] Finished updating board flags in 1.422 seconds
2018-12-26 08:43:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 08:43:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 08:43:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 08:44:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:44:01 [WARNING ] (13, 1, 'bot')
2018-12-26 08:44:01 [WARNING ] (13, 1, 'bot')
2018-12-26 08:44:01 [WARNING ] (13, 1, 'bot')
2018-12-26 08:44:01 [WARNING ] (13, 1, 'bot')
2018-12-26 08:44:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:44:01 [DEBUG   ] Finished updating board flags in 1.388 seconds
2018-12-26 08:44:05 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-26 08:44:25 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 08:44:34 [DEBUG   ] Got command RPT from MCS: ref #956326
2018-12-26 08:44:34 [DEBUG   ] summary = ERROR
2018-12-26 08:44:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956326  13 58478 31474277 A  ERRORERROR'
2018-12-26 08:44:34 [DEBUG   ] Got command RPT from MCS: ref #956327
2018-12-26 08:44:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 08:44:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956327  77 58478 31474481 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 08:44:34 [DEBUG   ] Got command RPT from MCS: ref #956328
2018-12-26 08:44:34 [DEBUG   ] summary = ERROR
2018-12-26 08:44:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956328  13 58478 31474685 A  ERRORERROR'
2018-12-26 08:44:34 [DEBUG   ] Got command RPT from MCS: ref #956329
2018-12-26 08:44:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 08:44:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956329  77 58478 31474877 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 08:44:35 [DEBUG   ] Got command RPT from MCS: ref #956331
2018-12-26 08:44:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 08:44:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956331  12 58478 31475081 A  ERRORB—™š'
2018-12-26 08:44:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 08:45:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:45:01 [WARNING ] (13, 1, 'bot')
2018-12-26 08:45:01 [WARNING ] (13, 1, 'bot')
2018-12-26 08:45:01 [WARNING ] (13, 1, 'bot')
2018-12-26 08:45:01 [WARNING ] (13, 1, 'bot')
2018-12-26 08:45:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:45:01 [DEBUG   ] Finished updating board flags in 1.372 seconds
2018-12-26 08:45:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 08:45:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 08:45:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 08:45:58 [DEBUG   ] Got command RPT from MCS: ref #956336
2018-12-26 08:45:58 [DEBUG   ] summary = ERROR
2018-12-26 08:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956336  13 58478 31558625 A  ERRORERROR'
2018-12-26 08:45:58 [DEBUG   ] Got command RPT from MCS: ref #956337
2018-12-26 08:45:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 08:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956337  77 58478 31558626 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 08:46:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:46:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-26 08:46:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:46:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:46:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:46:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:46:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:46:02 [DEBUG   ] Finished updating board flags in 2.048 seconds
2018-12-26 08:46:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 08:46:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 08:46:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 08:47:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:47:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:47:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:47:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:47:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:47:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:47:02 [DEBUG   ] Finished updating board flags in 2.038 seconds
2018-12-26 08:47:05 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 08:47:25 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-26 08:47:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-26 08:48:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 08:48:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:48:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:48:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:48:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:48:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:48:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:48:02 [DEBUG   ] Finished updating board flags in 2.009 seconds
2018-12-26 08:48:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 08:48:25 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-26 08:48:45 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-26 08:49:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:49:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:49:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:49:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:49:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:49:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:49:02 [DEBUG   ] Finished updating board flags in 1.942 seconds
2018-12-26 08:49:06 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-26 08:49:26 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-26 08:49:34 [DEBUG   ] Got command RPT from MCS: ref #956361
2018-12-26 08:49:34 [DEBUG   ] summary = ERROR
2018-12-26 08:49:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956361  13 58478 31774361 A  ERRORERROR'
2018-12-26 08:49:34 [DEBUG   ] Got command RPT from MCS: ref #956362
2018-12-26 08:49:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 08:49:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956362  77 58478 31774565 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 08:49:34 [DEBUG   ] Got command RPT from MCS: ref #956363
2018-12-26 08:49:34 [DEBUG   ] summary = ERROR
2018-12-26 08:49:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956363  13 58478 31774757 A  ERRORERROR'
2018-12-26 08:49:34 [DEBUG   ] Got command RPT from MCS: ref #956364
2018-12-26 08:49:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 08:49:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956364  77 58478 31774961 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 08:49:35 [DEBUG   ] Got command RPT from MCS: ref #956365
2018-12-26 08:49:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 08:49:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956365  12 58478 31775165 A  ERRORB—™š'
2018-12-26 08:49:46 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-26 08:50:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-26 08:50:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:50:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:50:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:50:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:50:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:50:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:50:02 [DEBUG   ] Finished updating board flags in 1.826 seconds
2018-12-26 08:50:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 08:50:26 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-26 08:50:46 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 08:50:58 [DEBUG   ] Got command RPT from MCS: ref #956366
2018-12-26 08:50:58 [DEBUG   ] summary = ERROR
2018-12-26 08:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956366  13 58478 31858617 A  ERRORERROR'
2018-12-26 08:50:58 [DEBUG   ] Got command RPT from MCS: ref #956367
2018-12-26 08:50:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 08:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956367  77 58478 31858618 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 08:51:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-26 08:51:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:51:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:51:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:51:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:51:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:51:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:51:02 [DEBUG   ] Finished updating board flags in 1.775 seconds
2018-12-26 08:51:06 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-26 08:51:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 08:51:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 08:52:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:52:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:52:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:52:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:52:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:52:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:52:02 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-12-26 08:52:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 08:52:26 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-26 08:52:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 08:53:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:53:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:53:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:53:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:53:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:53:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:53:02 [DEBUG   ] Finished updating board flags in 1.627 seconds
2018-12-26 08:53:06 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2018-12-26 08:53:26 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 08:53:46 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-26 08:54:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:54:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:54:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:54:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:54:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:54:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:54:02 [DEBUG   ] Finished updating board flags in 1.627 seconds
2018-12-26 08:54:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 08:54:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 08:54:34 [DEBUG   ] Got command RPT from MCS: ref #956389
2018-12-26 08:54:34 [DEBUG   ] summary = ERROR
2018-12-26 08:54:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956389  13 58478 32074445 A  ERRORERROR'
2018-12-26 08:54:34 [DEBUG   ] Got command RPT from MCS: ref #956390
2018-12-26 08:54:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 08:54:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956390  77 58478 32074637 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 08:54:34 [DEBUG   ] Got command RPT from MCS: ref #956391
2018-12-26 08:54:34 [DEBUG   ] summary = ERROR
2018-12-26 08:54:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956391  13 58478 32074841 A  ERRORERROR'
2018-12-26 08:54:35 [DEBUG   ] Got command RPT from MCS: ref #956393
2018-12-26 08:54:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 08:54:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956393  77 58478 32075045 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 08:54:35 [DEBUG   ] Got command RPT from MCS: ref #956394
2018-12-26 08:54:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 08:54:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956394  12 58478 32075249 A  ERRORB˜™š'
2018-12-26 08:54:46 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 08:55:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2018-12-26 08:55:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 08:55:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:55:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:55:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:55:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:55:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:55:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:55:02 [DEBUG   ] Finished updating board flags in 1.623 seconds
2018-12-26 08:55:06 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-12-26 08:55:26 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 08:55:46 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-26 08:55:58 [DEBUG   ] Got command RPT from MCS: ref #956403
2018-12-26 08:55:58 [DEBUG   ] summary = ERROR
2018-12-26 08:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956403  13 58478 32158625 A  ERRORERROR'
2018-12-26 08:55:58 [DEBUG   ] Got command RPT from MCS: ref #956404
2018-12-26 08:55:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 08:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956404  77 58478 32158626 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 08:56:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:56:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:56:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:56:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:56:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:56:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:56:02 [DEBUG   ] Finished updating board flags in 1.520 seconds
2018-12-26 08:56:07 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-26 08:56:27 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-26 08:56:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 08:57:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:57:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 08:57:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:57:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:57:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:57:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:57:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:57:02 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-12-26 08:57:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 08:57:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 08:57:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 08:58:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:58:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 08:58:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:58:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:58:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:58:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:58:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:58:02 [DEBUG   ] Finished updating board flags in 1.412 seconds
2018-12-26 08:58:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 08:58:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 08:58:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 08:59:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 08:59:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:59:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:59:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:59:02 [WARNING ] (13, 1, 'bot')
2018-12-26 08:59:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 08:59:02 [DEBUG   ] Finished updating board flags in 1.430 seconds
2018-12-26 08:59:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 08:59:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 08:59:34 [DEBUG   ] Got command RPT from MCS: ref #956424
2018-12-26 08:59:34 [DEBUG   ] summary = ERROR
2018-12-26 08:59:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956424  13 58478 32374521 A  ERRORERROR'
2018-12-26 08:59:34 [DEBUG   ] Got command RPT from MCS: ref #956425
2018-12-26 08:59:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 08:59:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956425  77 58478 32374725 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 08:59:34 [DEBUG   ] Got command RPT from MCS: ref #956426
2018-12-26 08:59:34 [DEBUG   ] summary = ERROR
2018-12-26 08:59:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956426  13 58478 32374933 A  ERRORERROR'
2018-12-26 08:59:35 [DEBUG   ] Got command RPT from MCS: ref #956427
2018-12-26 08:59:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 08:59:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956427  77 58478 32375125 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 08:59:35 [DEBUG   ] Got command RPT from MCS: ref #956428
2018-12-26 08:59:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 08:59:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956428  12 58478 32375329 A  ERRORB–™š'
2018-12-26 08:59:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 09:00:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:00:02 [WARNING ] (13, 1, 'bot')
2018-12-26 09:00:02 [WARNING ] (13, 1, 'bot')
2018-12-26 09:00:02 [WARNING ] (13, 1, 'bot')
2018-12-26 09:00:02 [WARNING ] (13, 1, 'bot')
2018-12-26 09:00:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:00:02 [DEBUG   ] Finished updating board flags in 1.467 seconds
2018-12-26 09:00:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-26 09:00:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 09:00:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 09:00:58 [DEBUG   ] Got command RPT from MCS: ref #956429
2018-12-26 09:00:58 [DEBUG   ] summary = ERROR
2018-12-26 09:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956429  13 58478 32458625 A  ERRORERROR'
2018-12-26 09:00:58 [DEBUG   ] Got command RPT from MCS: ref #956430
2018-12-26 09:00:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 09:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956430  77 58478 32458626 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 09:01:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:01:02 [WARNING ] (13, 1, 'bot')
2018-12-26 09:01:02 [WARNING ] (13, 1, 'bot')
2018-12-26 09:01:02 [WARNING ] (13, 1, 'bot')
2018-12-26 09:01:02 [WARNING ] (13, 1, 'bot')
2018-12-26 09:01:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:01:02 [DEBUG   ] Finished updating board flags in 1.502 seconds
2018-12-26 09:01:07 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-26 09:01:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 09:01:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 09:02:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:02:03 [WARNING ] (13, 1, 'bot')
2018-12-26 09:02:03 [WARNING ] (13, 1, 'bot')
2018-12-26 09:02:03 [WARNING ] (13, 1, 'bot')
2018-12-26 09:02:03 [WARNING ] (13, 1, 'bot')
2018-12-26 09:02:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:02:03 [DEBUG   ] Finished updating board flags in 2.253 seconds
2018-12-26 09:02:07 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 09:02:27 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-26 09:02:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 09:03:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:03:03 [WARNING ] (13, 1, 'bot')
2018-12-26 09:03:03 [WARNING ] (13, 1, 'bot')
2018-12-26 09:03:03 [WARNING ] (13, 1, 'bot')
2018-12-26 09:03:03 [WARNING ] (13, 1, 'bot')
2018-12-26 09:03:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:03:03 [DEBUG   ] Finished updating board flags in 2.136 seconds
2018-12-26 09:03:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 09:03:27 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 09:03:47 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-26 09:04:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:04:03 [WARNING ] (13, 1, 'bot')
2018-12-26 09:04:03 [WARNING ] (13, 1, 'bot')
2018-12-26 09:04:03 [WARNING ] (13, 1, 'bot')
2018-12-26 09:04:03 [WARNING ] (13, 1, 'bot')
2018-12-26 09:04:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:04:03 [DEBUG   ] Finished updating board flags in 2.060 seconds
2018-12-26 09:04:07 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-26 09:04:27 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 09:04:34 [DEBUG   ] Got command RPT from MCS: ref #956456
2018-12-26 09:04:34 [DEBUG   ] summary = ERROR
2018-12-26 09:04:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956456  13 58478 32674605 A  ERRORERROR'
2018-12-26 09:04:34 [DEBUG   ] Got command RPT from MCS: ref #956457
2018-12-26 09:04:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 09:04:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956457  77 58478 32674797 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 09:04:35 [DEBUG   ] Got command RPT from MCS: ref #956458
2018-12-26 09:04:35 [DEBUG   ] summary = ERROR
2018-12-26 09:04:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956458  13 58478 32675001 A  ERRORERROR'
2018-12-26 09:04:35 [DEBUG   ] Got command RPT from MCS: ref #956460
2018-12-26 09:04:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 09:04:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956460  77 58478 32675205 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 09:04:35 [DEBUG   ] Got command RPT from MCS: ref #956462
2018-12-26 09:04:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 09:04:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956462  12 58478 32675409 A  ERRORB–™š'
2018-12-26 09:04:47 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-26 09:05:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 09:05:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:05:03 [WARNING ] (13, 1, 'bot')
2018-12-26 09:05:03 [WARNING ] (13, 1, 'bot')
2018-12-26 09:05:03 [WARNING ] (13, 1, 'bot')
2018-12-26 09:05:03 [WARNING ] (13, 1, 'bot')
2018-12-26 09:05:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:05:03 [DEBUG   ] Finished updating board flags in 1.949 seconds
2018-12-26 09:05:08 [DEBUG   ] Finished updating ant stats in 1.391 seconds
2018-12-26 09:05:28 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-26 09:05:48 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 09:05:58 [DEBUG   ] Got command RPT from MCS: ref #956466
2018-12-26 09:05:58 [DEBUG   ] summary = ERROR
2018-12-26 09:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956466  13 58478 32758621 A  ERRORERROR'
2018-12-26 09:05:58 [DEBUG   ] Got command RPT from MCS: ref #956467
2018-12-26 09:05:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 09:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956467  77 58478 32758622 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 09:06:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:06:03 [WARNING ] (13, 1, 'bot')
2018-12-26 09:06:03 [WARNING ] (13, 1, 'bot')
2018-12-26 09:06:03 [WARNING ] (13, 1, 'bot')
2018-12-26 09:06:03 [WARNING ] (13, 1, 'bot')
2018-12-26 09:06:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:06:03 [DEBUG   ] Finished updating board flags in 1.805 seconds
2018-12-26 09:06:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 09:06:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 09:06:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 09:07:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:07:03 [WARNING ] (13, 1, 'bot')
2018-12-26 09:07:03 [WARNING ] (13, 1, 'bot')
2018-12-26 09:07:03 [WARNING ] (13, 1, 'bot')
2018-12-26 09:07:03 [WARNING ] (13, 1, 'bot')
2018-12-26 09:07:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:07:03 [DEBUG   ] Finished updating board flags in 1.827 seconds
2018-12-26 09:07:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 09:07:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 09:07:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 09:08:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:08:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 09:08:03 [WARNING ] (13, 1, 'bot')
2018-12-26 09:08:03 [WARNING ] (13, 1, 'bot')
2018-12-26 09:08:03 [WARNING ] (13, 1, 'bot')
2018-12-26 09:08:03 [WARNING ] (13, 1, 'bot')
2018-12-26 09:08:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:08:03 [DEBUG   ] Finished updating board flags in 1.815 seconds
2018-12-26 09:08:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 09:08:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 09:08:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 09:09:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:09:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 09:09:03 [WARNING ] (13, 1, 'bot')
2018-12-26 09:09:03 [WARNING ] (13, 1, 'bot')
2018-12-26 09:09:03 [WARNING ] (13, 1, 'bot')
2018-12-26 09:09:03 [WARNING ] (13, 1, 'bot')
2018-12-26 09:09:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:09:03 [DEBUG   ] Finished updating board flags in 1.772 seconds
2018-12-26 09:09:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 09:09:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 09:09:34 [DEBUG   ] Got command RPT from MCS: ref #956487
2018-12-26 09:09:34 [DEBUG   ] summary = ERROR
2018-12-26 09:09:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956487  13 58478 32974677 A  ERRORERROR'
2018-12-26 09:09:34 [DEBUG   ] Got command RPT from MCS: ref #956488
2018-12-26 09:09:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 09:09:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956488  77 58478 32974881 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 09:09:35 [DEBUG   ] Got command RPT from MCS: ref #956489
2018-12-26 09:09:35 [DEBUG   ] summary = ERROR
2018-12-26 09:09:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956489  13 58478 32975085 A  ERRORERROR'
2018-12-26 09:09:35 [DEBUG   ] Got command RPT from MCS: ref #956490
2018-12-26 09:09:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 09:09:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956490  77 58478 32975289 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 09:09:35 [DEBUG   ] Got command RPT from MCS: ref #956491
2018-12-26 09:09:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 09:09:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956491  12 58478 32975481 A  ERRORB˜™š'
2018-12-26 09:09:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 09:10:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:10:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-26 09:10:03 [WARNING ] (13, 1, 'bot')
2018-12-26 09:10:03 [WARNING ] (13, 1, 'bot')
2018-12-26 09:10:03 [WARNING ] (13, 1, 'bot')
2018-12-26 09:10:03 [WARNING ] (13, 1, 'bot')
2018-12-26 09:10:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:10:03 [DEBUG   ] Finished updating board flags in 1.687 seconds
2018-12-26 09:10:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 09:10:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-26 09:10:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 09:10:58 [DEBUG   ] Got command RPT from MCS: ref #956496
2018-12-26 09:10:58 [DEBUG   ] summary = ERROR
2018-12-26 09:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956496  13 58478 33058640 A  ERRORERROR'
2018-12-26 09:10:58 [DEBUG   ] Got command RPT from MCS: ref #956497
2018-12-26 09:10:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 09:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956497  77 58478 33058640 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 09:11:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 09:11:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:11:03 [WARNING ] (13, 1, 'bot')
2018-12-26 09:11:03 [WARNING ] (13, 1, 'bot')
2018-12-26 09:11:03 [WARNING ] (13, 1, 'bot')
2018-12-26 09:11:03 [WARNING ] (13, 1, 'bot')
2018-12-26 09:11:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:11:03 [DEBUG   ] Finished updating board flags in 1.524 seconds
2018-12-26 09:11:08 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 09:11:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 09:11:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 09:12:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:12:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 09:12:03 [WARNING ] (13, 1, 'bot')
2018-12-26 09:12:03 [WARNING ] (13, 1, 'bot')
2018-12-26 09:12:03 [WARNING ] (13, 1, 'bot')
2018-12-26 09:12:03 [WARNING ] (13, 1, 'bot')
2018-12-26 09:12:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:12:03 [DEBUG   ] Finished updating board flags in 1.496 seconds
2018-12-26 09:12:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 09:12:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 09:12:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 09:13:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:13:03 [WARNING ] (13, 1, 'bot')
2018-12-26 09:13:03 [WARNING ] (13, 1, 'bot')
2018-12-26 09:13:03 [WARNING ] (13, 1, 'bot')
2018-12-26 09:13:03 [WARNING ] (13, 1, 'bot')
2018-12-26 09:13:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:13:03 [DEBUG   ] Finished updating board flags in 1.529 seconds
2018-12-26 09:13:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 09:13:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-26 09:13:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 09:14:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:14:04 [WARNING ] (13, 1, 'bot')
2018-12-26 09:14:04 [WARNING ] (13, 1, 'bot')
2018-12-26 09:14:04 [WARNING ] (13, 1, 'bot')
2018-12-26 09:14:04 [WARNING ] (13, 1, 'bot')
2018-12-26 09:14:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:14:04 [DEBUG   ] Finished updating board flags in 2.237 seconds
2018-12-26 09:14:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 09:14:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 09:14:34 [DEBUG   ] Got command RPT from MCS: ref #956519
2018-12-26 09:14:34 [DEBUG   ] summary = ERROR
2018-12-26 09:14:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956519  13 58478 33274761 A  ERRORERROR'
2018-12-26 09:14:34 [DEBUG   ] Got command RPT from MCS: ref #956520
2018-12-26 09:14:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 09:14:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956520  77 58478 33274965 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 09:14:35 [DEBUG   ] Got command RPT from MCS: ref #956521
2018-12-26 09:14:35 [DEBUG   ] summary = ERROR
2018-12-26 09:14:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956521  13 58478 33275157 A  ERRORERROR'
2018-12-26 09:14:35 [DEBUG   ] Got command RPT from MCS: ref #956523
2018-12-26 09:14:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 09:14:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956523  77 58478 33275361 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 09:14:35 [DEBUG   ] Got command RPT from MCS: ref #956524
2018-12-26 09:14:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 09:14:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956524  12 58478 33275565 A  ERRORB—™š'
2018-12-26 09:14:48 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 09:15:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:15:04 [WARNING ] (13, 1, 'bot')
2018-12-26 09:15:04 [WARNING ] (13, 1, 'bot')
2018-12-26 09:15:04 [WARNING ] (13, 1, 'bot')
2018-12-26 09:15:04 [WARNING ] (13, 1, 'bot')
2018-12-26 09:15:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:15:04 [DEBUG   ] Finished updating board flags in 2.258 seconds
2018-12-26 09:15:08 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 09:15:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 09:15:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 09:15:58 [DEBUG   ] Got command RPT from MCS: ref #956529
2018-12-26 09:15:58 [DEBUG   ] summary = ERROR
2018-12-26 09:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956529  13 58478 33358625 A  ERRORERROR'
2018-12-26 09:15:58 [DEBUG   ] Got command RPT from MCS: ref #956530
2018-12-26 09:15:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 09:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956530  77 58478 33358626 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 09:16:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:16:04 [WARNING ] (13, 1, 'bot')
2018-12-26 09:16:04 [WARNING ] (13, 1, 'bot')
2018-12-26 09:16:04 [WARNING ] (13, 1, 'bot')
2018-12-26 09:16:04 [WARNING ] (13, 1, 'bot')
2018-12-26 09:16:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:16:04 [DEBUG   ] Finished updating board flags in 2.107 seconds
2018-12-26 09:16:08 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 09:16:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 09:16:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 09:17:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:17:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 09:17:04 [WARNING ] (13, 1, 'bot')
2018-12-26 09:17:04 [WARNING ] (13, 1, 'bot')
2018-12-26 09:17:04 [WARNING ] (13, 1, 'bot')
2018-12-26 09:17:04 [WARNING ] (13, 1, 'bot')
2018-12-26 09:17:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:17:04 [DEBUG   ] Finished updating board flags in 1.994 seconds
2018-12-26 09:17:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 09:17:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 09:17:48 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 09:18:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:18:04 [WARNING ] (13, 1, 'bot')
2018-12-26 09:18:04 [WARNING ] (13, 1, 'bot')
2018-12-26 09:18:04 [WARNING ] (13, 1, 'bot')
2018-12-26 09:18:04 [WARNING ] (13, 1, 'bot')
2018-12-26 09:18:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:18:04 [DEBUG   ] Finished updating board flags in 1.794 seconds
2018-12-26 09:18:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 09:18:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 09:18:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 09:19:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:19:04 [WARNING ] (13, 1, 'bot')
2018-12-26 09:19:04 [WARNING ] (13, 1, 'bot')
2018-12-26 09:19:04 [WARNING ] (13, 1, 'bot')
2018-12-26 09:19:04 [WARNING ] (13, 1, 'bot')
2018-12-26 09:19:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:19:04 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-12-26 09:19:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 09:19:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 09:19:34 [DEBUG   ] Got command RPT from MCS: ref #956554
2018-12-26 09:19:34 [DEBUG   ] summary = ERROR
2018-12-26 09:19:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956554  13 58478 33574841 A  ERRORERROR'
2018-12-26 09:19:35 [DEBUG   ] Got command RPT from MCS: ref #956555
2018-12-26 09:19:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 09:19:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956555  77 58478 33575045 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 09:19:35 [DEBUG   ] Got command RPT from MCS: ref #956556
2018-12-26 09:19:35 [DEBUG   ] summary = ERROR
2018-12-26 09:19:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956556  13 58478 33575237 A  ERRORERROR'
2018-12-26 09:19:35 [DEBUG   ] Got command RPT from MCS: ref #956557
2018-12-26 09:19:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 09:19:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956557  77 58478 33575445 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 09:19:35 [DEBUG   ] Got command RPT from MCS: ref #956558
2018-12-26 09:19:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 09:19:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956558  12 58478 33575645 A  ERRORB–™š'
2018-12-26 09:19:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 09:20:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:20:04 [WARNING ] (13, 1, 'bot')
2018-12-26 09:20:04 [WARNING ] (13, 1, 'bot')
2018-12-26 09:20:04 [WARNING ] (13, 1, 'bot')
2018-12-26 09:20:04 [WARNING ] (13, 1, 'bot')
2018-12-26 09:20:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:20:04 [DEBUG   ] Finished updating board flags in 1.688 seconds
2018-12-26 09:20:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 09:20:28 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 09:20:48 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-26 09:20:58 [DEBUG   ] Got command RPT from MCS: ref #956559
2018-12-26 09:20:58 [DEBUG   ] summary = ERROR
2018-12-26 09:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956559  13 58478 33658633 A  ERRORERROR'
2018-12-26 09:20:58 [DEBUG   ] Got command RPT from MCS: ref #956560
2018-12-26 09:20:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 09:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956560  77 58478 33658634 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 09:21:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 09:21:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:21:04 [WARNING ] (13, 1, 'bot')
2018-12-26 09:21:04 [WARNING ] (13, 1, 'bot')
2018-12-26 09:21:04 [WARNING ] (13, 1, 'bot')
2018-12-26 09:21:04 [WARNING ] (13, 1, 'bot')
2018-12-26 09:21:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:21:04 [DEBUG   ] Finished updating board flags in 1.503 seconds
2018-12-26 09:21:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 09:21:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 09:21:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 09:22:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:22:04 [WARNING ] (13, 1, 'bot')
2018-12-26 09:22:04 [WARNING ] (13, 1, 'bot')
2018-12-26 09:22:04 [WARNING ] (13, 1, 'bot')
2018-12-26 09:22:04 [WARNING ] (13, 1, 'bot')
2018-12-26 09:22:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:22:04 [DEBUG   ] Finished updating board flags in 1.482 seconds
2018-12-26 09:22:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 09:22:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 09:22:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 09:23:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:23:04 [WARNING ] (13, 1, 'bot')
2018-12-26 09:23:04 [WARNING ] (13, 1, 'bot')
2018-12-26 09:23:04 [WARNING ] (13, 1, 'bot')
2018-12-26 09:23:04 [WARNING ] (13, 1, 'bot')
2018-12-26 09:23:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:23:04 [DEBUG   ] Finished updating board flags in 1.495 seconds
2018-12-26 09:23:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 09:23:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 09:23:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 09:24:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:24:04 [WARNING ] (13, 1, 'bot')
2018-12-26 09:24:04 [WARNING ] (13, 1, 'bot')
2018-12-26 09:24:04 [WARNING ] (13, 1, 'bot')
2018-12-26 09:24:04 [WARNING ] (13, 1, 'bot')
2018-12-26 09:24:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:24:04 [DEBUG   ] Finished updating board flags in 1.507 seconds
2018-12-26 09:24:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 09:24:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 09:24:34 [DEBUG   ] Got command RPT from MCS: ref #956582
2018-12-26 09:24:34 [DEBUG   ] summary = ERROR
2018-12-26 09:24:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956582  13 58478 33874921 A  ERRORERROR'
2018-12-26 09:24:35 [DEBUG   ] Got command RPT from MCS: ref #956583
2018-12-26 09:24:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 09:24:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956583  77 58478 33875121 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 09:24:35 [DEBUG   ] Got command RPT from MCS: ref #956584
2018-12-26 09:24:35 [DEBUG   ] summary = ERROR
2018-12-26 09:24:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956584  13 58478 33875325 A  ERRORERROR'
2018-12-26 09:24:35 [DEBUG   ] Got command RPT from MCS: ref #956586
2018-12-26 09:24:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 09:24:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956586  77 58478 33875529 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 09:24:35 [DEBUG   ] Got command RPT from MCS: ref #956587
2018-12-26 09:24:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 09:24:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956587  12 58478 33875721 A  ERRORB˜™š'
2018-12-26 09:24:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 09:25:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:25:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:25:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:25:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:25:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:25:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:25:05 [DEBUG   ] Finished updating board flags in 2.213 seconds
2018-12-26 09:25:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 09:25:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 09:25:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 09:25:58 [DEBUG   ] Got command RPT from MCS: ref #956596
2018-12-26 09:25:58 [DEBUG   ] summary = ERROR
2018-12-26 09:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956596  13 58478 33958629 A  ERRORERROR'
2018-12-26 09:25:58 [DEBUG   ] Got command RPT from MCS: ref #956597
2018-12-26 09:25:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 09:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956597  77 58478 33958630 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 09:26:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:26:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:26:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:26:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:26:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:26:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:26:05 [DEBUG   ] Finished updating board flags in 2.238 seconds
2018-12-26 09:26:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 09:26:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 09:26:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 09:27:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 09:27:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:27:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:27:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:27:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:27:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:27:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:27:05 [DEBUG   ] Finished updating board flags in 2.085 seconds
2018-12-26 09:27:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 09:27:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 09:27:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-26 09:28:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:28:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:28:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:28:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:28:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:28:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:28:05 [DEBUG   ] Finished updating board flags in 2.029 seconds
2018-12-26 09:28:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 09:28:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 09:28:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 09:29:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:29:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:29:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:29:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:29:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:29:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:29:05 [DEBUG   ] Finished updating board flags in 1.957 seconds
2018-12-26 09:29:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 09:29:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 09:29:35 [DEBUG   ] Got command RPT from MCS: ref #956617
2018-12-26 09:29:35 [DEBUG   ] summary = ERROR
2018-12-26 09:29:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956617  13 58478 34175001 A  ERRORERROR'
2018-12-26 09:29:35 [DEBUG   ] Got command RPT from MCS: ref #956618
2018-12-26 09:29:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 09:29:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956618  77 58478 34175205 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 09:29:35 [DEBUG   ] Got command RPT from MCS: ref #956619
2018-12-26 09:29:35 [DEBUG   ] summary = ERROR
2018-12-26 09:29:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956619  13 58478 34175409 A  ERRORERROR'
2018-12-26 09:29:35 [DEBUG   ] Got command RPT from MCS: ref #956620
2018-12-26 09:29:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 09:29:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956620  77 58478 34175601 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 09:29:35 [DEBUG   ] Got command RPT from MCS: ref #956621
2018-12-26 09:29:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 09:29:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956621  12 58478 34175805 A  ERRORB—™š'
2018-12-26 09:29:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 09:30:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:30:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:30:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:30:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:30:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:30:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:30:05 [DEBUG   ] Finished updating board flags in 1.821 seconds
2018-12-26 09:30:08 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-26 09:30:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 09:30:48 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-26 09:30:58 [DEBUG   ] Got command RPT from MCS: ref #956622
2018-12-26 09:30:58 [DEBUG   ] summary = ERROR
2018-12-26 09:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956622  13 58478 34258637 A  ERRORERROR'
2018-12-26 09:30:58 [DEBUG   ] Got command RPT from MCS: ref #956623
2018-12-26 09:30:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 09:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956623  77 58478 34258638 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 09:31:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:31:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:31:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:31:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:31:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:31:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:31:05 [DEBUG   ] Finished updating board flags in 1.791 seconds
2018-12-26 09:31:08 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-26 09:31:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 09:31:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 09:32:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:32:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:32:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:32:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:32:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:32:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:32:05 [DEBUG   ] Finished updating board flags in 1.621 seconds
2018-12-26 09:32:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 09:32:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 09:32:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 09:33:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:33:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:33:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:33:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:33:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:33:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:33:05 [DEBUG   ] Finished updating board flags in 1.660 seconds
2018-12-26 09:33:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 09:33:28 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 09:33:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 09:34:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:34:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:34:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:34:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:34:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:34:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:34:05 [DEBUG   ] Finished updating board flags in 1.527 seconds
2018-12-26 09:34:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 09:34:28 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-26 09:34:35 [DEBUG   ] Got command RPT from MCS: ref #956649
2018-12-26 09:34:35 [DEBUG   ] summary = ERROR
2018-12-26 09:34:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956649  13 58478 34475081 A  ERRORERROR'
2018-12-26 09:34:35 [DEBUG   ] Got command RPT from MCS: ref #956650
2018-12-26 09:34:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 09:34:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956650  77 58478 34475285 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 09:34:35 [DEBUG   ] Got command RPT from MCS: ref #956651
2018-12-26 09:34:35 [DEBUG   ] summary = ERROR
2018-12-26 09:34:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956651  13 58478 34475489 A  ERRORERROR'
2018-12-26 09:34:35 [DEBUG   ] Got command RPT from MCS: ref #956653
2018-12-26 09:34:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 09:34:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956653  77 58478 34475681 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 09:34:35 [DEBUG   ] Got command RPT from MCS: ref #956655
2018-12-26 09:34:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 09:34:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956655  12 58478 34475885 A  ERRORB–™š'
2018-12-26 09:34:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 09:35:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:35:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:35:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:35:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:35:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:35:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:35:05 [DEBUG   ] Finished updating board flags in 1.436 seconds
2018-12-26 09:35:08 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 09:35:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 09:35:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 09:35:58 [DEBUG   ] Got command RPT from MCS: ref #956659
2018-12-26 09:35:58 [DEBUG   ] summary = ERROR
2018-12-26 09:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956659  13 58478 34558633 A  ERRORERROR'
2018-12-26 09:35:58 [DEBUG   ] Got command RPT from MCS: ref #956660
2018-12-26 09:35:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 09:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956660  77 58478 34558634 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 09:36:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:36:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:36:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:36:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:36:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:36:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:36:05 [DEBUG   ] Finished updating board flags in 1.505 seconds
2018-12-26 09:36:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 09:36:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 09:36:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 09:37:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:37:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:37:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:37:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:37:05 [WARNING ] (13, 1, 'bot')
2018-12-26 09:37:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:37:05 [DEBUG   ] Finished updating board flags in 1.525 seconds
2018-12-26 09:37:08 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-26 09:37:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 09:37:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 09:38:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:38:06 [WARNING ] (13, 1, 'bot')
2018-12-26 09:38:06 [WARNING ] (13, 1, 'bot')
2018-12-26 09:38:06 [WARNING ] (13, 1, 'bot')
2018-12-26 09:38:06 [WARNING ] (13, 1, 'bot')
2018-12-26 09:38:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:38:06 [DEBUG   ] Finished updating board flags in 2.252 seconds
2018-12-26 09:38:08 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-26 09:38:28 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 09:38:48 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-26 09:39:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 09:39:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:39:06 [WARNING ] (13, 1, 'bot')
2018-12-26 09:39:06 [WARNING ] (13, 1, 'bot')
2018-12-26 09:39:06 [WARNING ] (13, 1, 'bot')
2018-12-26 09:39:06 [WARNING ] (13, 1, 'bot')
2018-12-26 09:39:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:39:06 [DEBUG   ] Finished updating board flags in 2.078 seconds
2018-12-26 09:39:09 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-26 09:39:29 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-26 09:39:35 [DEBUG   ] Got command RPT from MCS: ref #956680
2018-12-26 09:39:35 [DEBUG   ] summary = ERROR
2018-12-26 09:39:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956680  13 58478 34775165 A  ERRORERROR'
2018-12-26 09:39:35 [DEBUG   ] Got command RPT from MCS: ref #956681
2018-12-26 09:39:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 09:39:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956681  77 58478 34775369 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 09:39:35 [DEBUG   ] Got command RPT from MCS: ref #956682
2018-12-26 09:39:35 [DEBUG   ] summary = ERROR
2018-12-26 09:39:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956682  13 58478 34775561 A  ERRORERROR'
2018-12-26 09:39:35 [DEBUG   ] Got command RPT from MCS: ref #956683
2018-12-26 09:39:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 09:39:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956683  77 58478 34775765 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 09:39:35 [DEBUG   ] Got command RPT from MCS: ref #956684
2018-12-26 09:39:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 09:39:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956684  12 58478 34775969 A  ERRORB–™š'
2018-12-26 09:39:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 09:40:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 09:40:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:40:06 [WARNING ] (13, 1, 'bot')
2018-12-26 09:40:06 [WARNING ] (13, 1, 'bot')
2018-12-26 09:40:06 [WARNING ] (13, 1, 'bot')
2018-12-26 09:40:06 [WARNING ] (13, 1, 'bot')
2018-12-26 09:40:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:40:06 [DEBUG   ] Finished updating board flags in 2.017 seconds
2018-12-26 09:40:09 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 09:40:29 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-26 09:40:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 09:40:58 [DEBUG   ] Got command RPT from MCS: ref #956689
2018-12-26 09:40:58 [DEBUG   ] summary = ERROR
2018-12-26 09:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956689  13 58478 34858637 A  ERRORERROR'
2018-12-26 09:40:58 [DEBUG   ] Got command RPT from MCS: ref #956690
2018-12-26 09:40:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 09:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956690  77 58478 34858638 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 09:41:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:41:06 [WARNING ] (13, 1, 'bot')
2018-12-26 09:41:06 [WARNING ] (13, 1, 'bot')
2018-12-26 09:41:06 [WARNING ] (13, 1, 'bot')
2018-12-26 09:41:06 [WARNING ] (13, 1, 'bot')
2018-12-26 09:41:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:41:06 [DEBUG   ] Finished updating board flags in 1.980 seconds
2018-12-26 09:41:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 09:41:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 09:41:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 09:42:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:42:06 [WARNING ] (13, 1, 'bot')
2018-12-26 09:42:06 [WARNING ] (13, 1, 'bot')
2018-12-26 09:42:06 [WARNING ] (13, 1, 'bot')
2018-12-26 09:42:06 [WARNING ] (13, 1, 'bot')
2018-12-26 09:42:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:42:06 [DEBUG   ] Finished updating board flags in 1.823 seconds
2018-12-26 09:42:09 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-26 09:42:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 09:42:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 09:43:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:43:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 09:43:06 [WARNING ] (13, 1, 'bot')
2018-12-26 09:43:06 [WARNING ] (13, 1, 'bot')
2018-12-26 09:43:06 [WARNING ] (13, 1, 'bot')
2018-12-26 09:43:06 [WARNING ] (13, 1, 'bot')
2018-12-26 09:43:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:43:06 [DEBUG   ] Finished updating board flags in 1.786 seconds
2018-12-26 09:43:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 09:43:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 09:43:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 09:44:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 09:44:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:44:06 [WARNING ] (13, 1, 'bot')
2018-12-26 09:44:06 [WARNING ] (13, 1, 'bot')
2018-12-26 09:44:06 [WARNING ] (13, 1, 'bot')
2018-12-26 09:44:06 [WARNING ] (13, 1, 'bot')
2018-12-26 09:44:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:44:06 [DEBUG   ] Finished updating board flags in 1.624 seconds
2018-12-26 09:44:09 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 09:44:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 09:44:35 [DEBUG   ] Got command RPT from MCS: ref #956712
2018-12-26 09:44:35 [DEBUG   ] summary = ERROR
2018-12-26 09:44:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956712  13 58478 35075245 A  ERRORERROR'
2018-12-26 09:44:35 [DEBUG   ] Got command RPT from MCS: ref #956713
2018-12-26 09:44:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 09:44:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956713  77 58478 35075449 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 09:44:35 [DEBUG   ] Got command RPT from MCS: ref #956714
2018-12-26 09:44:35 [DEBUG   ] summary = ERROR
2018-12-26 09:44:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956714  13 58478 35075653 A  ERRORERROR'
2018-12-26 09:44:35 [DEBUG   ] Got command RPT from MCS: ref #956716
2018-12-26 09:44:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 09:44:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956716  77 58478 35075849 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 09:44:36 [DEBUG   ] Got command RPT from MCS: ref #956718
2018-12-26 09:44:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 09:44:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956718  12 58478 35076053 A  ERRORB—™š'
2018-12-26 09:44:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 09:45:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:45:06 [WARNING ] (13, 1, 'bot')
2018-12-26 09:45:06 [WARNING ] (13, 1, 'bot')
2018-12-26 09:45:06 [WARNING ] (13, 1, 'bot')
2018-12-26 09:45:06 [WARNING ] (13, 1, 'bot')
2018-12-26 09:45:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:45:06 [DEBUG   ] Finished updating board flags in 1.692 seconds
2018-12-26 09:45:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 09:45:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 09:45:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 09:45:58 [DEBUG   ] Got command RPT from MCS: ref #956722
2018-12-26 09:45:58 [DEBUG   ] summary = ERROR
2018-12-26 09:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956722  13 58478 35158641 A  ERRORERROR'
2018-12-26 09:45:58 [DEBUG   ] Got command RPT from MCS: ref #956723
2018-12-26 09:45:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 09:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956723  77 58478 35158642 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 09:46:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:46:06 [WARNING ] (13, 1, 'bot')
2018-12-26 09:46:06 [WARNING ] (13, 1, 'bot')
2018-12-26 09:46:06 [WARNING ] (13, 1, 'bot')
2018-12-26 09:46:06 [WARNING ] (13, 1, 'bot')
2018-12-26 09:46:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:46:06 [DEBUG   ] Finished updating board flags in 1.493 seconds
2018-12-26 09:46:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 09:46:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 09:46:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 09:47:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:47:06 [WARNING ] (13, 1, 'bot')
2018-12-26 09:47:06 [WARNING ] (13, 1, 'bot')
2018-12-26 09:47:06 [WARNING ] (13, 1, 'bot')
2018-12-26 09:47:06 [WARNING ] (13, 1, 'bot')
2018-12-26 09:47:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:47:06 [DEBUG   ] Finished updating board flags in 1.497 seconds
2018-12-26 09:47:09 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 09:47:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 09:47:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 09:48:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:48:06 [WARNING ] (13, 1, 'bot')
2018-12-26 09:48:06 [WARNING ] (13, 1, 'bot')
2018-12-26 09:48:06 [WARNING ] (13, 1, 'bot')
2018-12-26 09:48:06 [WARNING ] (13, 1, 'bot')
2018-12-26 09:48:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:48:06 [DEBUG   ] Finished updating board flags in 1.499 seconds
2018-12-26 09:48:09 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 09:48:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 09:48:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 09:49:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:49:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-26 09:49:06 [WARNING ] (13, 1, 'bot')
2018-12-26 09:49:06 [WARNING ] (13, 1, 'bot')
2018-12-26 09:49:06 [WARNING ] (13, 1, 'bot')
2018-12-26 09:49:06 [WARNING ] (13, 1, 'bot')
2018-12-26 09:49:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:49:06 [DEBUG   ] Finished updating board flags in 1.511 seconds
2018-12-26 09:49:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 09:49:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 09:49:35 [DEBUG   ] Got command RPT from MCS: ref #956747
2018-12-26 09:49:35 [DEBUG   ] summary = ERROR
2018-12-26 09:49:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956747  13 58478 35375325 A  ERRORERROR'
2018-12-26 09:49:35 [DEBUG   ] Got command RPT from MCS: ref #956748
2018-12-26 09:49:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 09:49:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956748  77 58478 35375529 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 09:49:35 [DEBUG   ] Got command RPT from MCS: ref #956749
2018-12-26 09:49:35 [DEBUG   ] summary = ERROR
2018-12-26 09:49:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956749  13 58478 35375733 A  ERRORERROR'
2018-12-26 09:49:35 [DEBUG   ] Got command RPT from MCS: ref #956750
2018-12-26 09:49:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 09:49:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956750  77 58478 35375937 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 09:49:36 [DEBUG   ] Got command RPT from MCS: ref #956751
2018-12-26 09:49:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 09:49:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956751  12 58478 35376129 A  ERRORB–™š'
2018-12-26 09:49:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 09:50:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:50:07 [WARNING ] (13, 1, 'bot')
2018-12-26 09:50:07 [WARNING ] (13, 1, 'bot')
2018-12-26 09:50:07 [WARNING ] (13, 1, 'bot')
2018-12-26 09:50:07 [WARNING ] (13, 1, 'bot')
2018-12-26 09:50:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:50:07 [DEBUG   ] Finished updating board flags in 2.217 seconds
2018-12-26 09:50:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 09:50:29 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-12-26 09:50:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 09:50:58 [DEBUG   ] Got command RPT from MCS: ref #956752
2018-12-26 09:50:58 [DEBUG   ] summary = ERROR
2018-12-26 09:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956752  13 58478 35458633 A  ERRORERROR'
2018-12-26 09:50:58 [DEBUG   ] Got command RPT from MCS: ref #956753
2018-12-26 09:50:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 09:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956753  77 58478 35458634 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 09:51:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:51:07 [WARNING ] (13, 1, 'bot')
2018-12-26 09:51:07 [WARNING ] (13, 1, 'bot')
2018-12-26 09:51:07 [WARNING ] (13, 1, 'bot')
2018-12-26 09:51:07 [WARNING ] (13, 1, 'bot')
2018-12-26 09:51:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:51:07 [DEBUG   ] Finished updating board flags in 2.208 seconds
2018-12-26 09:51:09 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2018-12-26 09:51:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 09:51:49 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-26 09:52:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:52:07 [WARNING ] (13, 1, 'bot')
2018-12-26 09:52:07 [WARNING ] (13, 1, 'bot')
2018-12-26 09:52:07 [WARNING ] (13, 1, 'bot')
2018-12-26 09:52:07 [WARNING ] (13, 1, 'bot')
2018-12-26 09:52:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:52:07 [DEBUG   ] Finished updating board flags in 2.074 seconds
2018-12-26 09:52:09 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 09:52:29 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 09:52:49 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-26 09:53:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:53:07 [WARNING ] (13, 1, 'bot')
2018-12-26 09:53:07 [WARNING ] (13, 1, 'bot')
2018-12-26 09:53:07 [WARNING ] (13, 1, 'bot')
2018-12-26 09:53:07 [WARNING ] (13, 1, 'bot')
2018-12-26 09:53:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:53:07 [DEBUG   ] Finished updating board flags in 2.023 seconds
2018-12-26 09:53:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 09:53:29 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 09:53:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 09:54:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 09:54:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:54:07 [WARNING ] (13, 1, 'bot')
2018-12-26 09:54:07 [WARNING ] (13, 1, 'bot')
2018-12-26 09:54:07 [WARNING ] (13, 1, 'bot')
2018-12-26 09:54:07 [WARNING ] (13, 1, 'bot')
2018-12-26 09:54:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:54:07 [DEBUG   ] Finished updating board flags in 1.982 seconds
2018-12-26 09:54:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 09:54:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 09:54:35 [DEBUG   ] Got command RPT from MCS: ref #956775
2018-12-26 09:54:35 [DEBUG   ] summary = ERROR
2018-12-26 09:54:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956775  13 58478 35675405 A  ERRORERROR'
2018-12-26 09:54:35 [DEBUG   ] Got command RPT from MCS: ref #956776
2018-12-26 09:54:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 09:54:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956776  77 58478 35675609 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 09:54:35 [DEBUG   ] Got command RPT from MCS: ref #956777
2018-12-26 09:54:35 [DEBUG   ] summary = ERROR
2018-12-26 09:54:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956777  13 58478 35675813 A  ERRORERROR'
2018-12-26 09:54:36 [DEBUG   ] Got command RPT from MCS: ref #956779
2018-12-26 09:54:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 09:54:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956779  77 58478 35676005 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 09:54:36 [DEBUG   ] Got command RPT from MCS: ref #956780
2018-12-26 09:54:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 09:54:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956780  12 58478 35676209 A  ERRORB–™š'
2018-12-26 09:54:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 09:55:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:55:07 [WARNING ] (13, 1, 'bot')
2018-12-26 09:55:07 [WARNING ] (13, 1, 'bot')
2018-12-26 09:55:07 [WARNING ] (13, 1, 'bot')
2018-12-26 09:55:07 [WARNING ] (13, 1, 'bot')
2018-12-26 09:55:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:55:07 [DEBUG   ] Finished updating board flags in 1.825 seconds
2018-12-26 09:55:09 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-26 09:55:29 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-12-26 09:55:50 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-26 09:55:58 [DEBUG   ] Got command RPT from MCS: ref #956789
2018-12-26 09:55:58 [DEBUG   ] summary = ERROR
2018-12-26 09:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956789  13 58478 35758637 A  ERRORERROR'
2018-12-26 09:55:58 [DEBUG   ] Got command RPT from MCS: ref #956790
2018-12-26 09:55:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 09:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956790  77 58478 35758638 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 09:56:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:56:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 09:56:07 [WARNING ] (13, 1, 'bot')
2018-12-26 09:56:07 [WARNING ] (13, 1, 'bot')
2018-12-26 09:56:07 [WARNING ] (13, 1, 'bot')
2018-12-26 09:56:07 [WARNING ] (13, 1, 'bot')
2018-12-26 09:56:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:56:07 [DEBUG   ] Finished updating board flags in 1.788 seconds
2018-12-26 09:56:10 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-26 09:56:30 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-26 09:56:50 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 09:57:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 09:57:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:57:07 [WARNING ] (13, 1, 'bot')
2018-12-26 09:57:07 [WARNING ] (13, 1, 'bot')
2018-12-26 09:57:07 [WARNING ] (13, 1, 'bot')
2018-12-26 09:57:07 [WARNING ] (13, 1, 'bot')
2018-12-26 09:57:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:57:07 [DEBUG   ] Finished updating board flags in 1.595 seconds
2018-12-26 09:57:10 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 09:57:30 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-12-26 09:57:50 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 09:58:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 09:58:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:58:07 [WARNING ] (13, 1, 'bot')
2018-12-26 09:58:07 [WARNING ] (13, 1, 'bot')
2018-12-26 09:58:07 [WARNING ] (13, 1, 'bot')
2018-12-26 09:58:07 [WARNING ] (13, 1, 'bot')
2018-12-26 09:58:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:58:07 [DEBUG   ] Finished updating board flags in 1.417 seconds
2018-12-26 09:58:10 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 09:58:30 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 09:58:50 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-12-26 09:59:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 09:59:07 [WARNING ] (13, 1, 'bot')
2018-12-26 09:59:07 [WARNING ] (13, 1, 'bot')
2018-12-26 09:59:07 [WARNING ] (13, 1, 'bot')
2018-12-26 09:59:07 [WARNING ] (13, 1, 'bot')
2018-12-26 09:59:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 09:59:07 [DEBUG   ] Finished updating board flags in 1.400 seconds
2018-12-26 09:59:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 09:59:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 09:59:35 [DEBUG   ] Got command RPT from MCS: ref #956810
2018-12-26 09:59:35 [DEBUG   ] summary = ERROR
2018-12-26 09:59:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956810  13 58478 35975489 A  ERRORERROR'
2018-12-26 09:59:35 [DEBUG   ] Got command RPT from MCS: ref #956811
2018-12-26 09:59:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 09:59:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956811  77 58478 35975681 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 09:59:35 [DEBUG   ] Got command RPT from MCS: ref #956812
2018-12-26 09:59:35 [DEBUG   ] summary = ERROR
2018-12-26 09:59:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956812  13 58478 35975885 A  ERRORERROR'
2018-12-26 09:59:36 [DEBUG   ] Got command RPT from MCS: ref #956813
2018-12-26 09:59:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 09:59:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956813  77 58478 35976089 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 09:59:36 [DEBUG   ] Got command RPT from MCS: ref #956814
2018-12-26 09:59:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 09:59:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956814  12 58478 35976281 A  ERRORB˜™š'
2018-12-26 09:59:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 10:00:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:00:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:00:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:00:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:00:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:00:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:00:08 [DEBUG   ] Finished updating board flags in 2.218 seconds
2018-12-26 10:00:10 [DEBUG   ] Finished updating ant stats in 0.673 seconds
2018-12-26 10:00:30 [DEBUG   ] Finished updating ant stats in 0.582 seconds
2018-12-26 10:00:51 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-12-26 10:00:58 [DEBUG   ] Got command RPT from MCS: ref #956815
2018-12-26 10:00:58 [DEBUG   ] summary = ERROR
2018-12-26 10:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956815  13 58478 36058641 A  ERRORERROR'
2018-12-26 10:00:58 [DEBUG   ] Got command RPT from MCS: ref #956816
2018-12-26 10:00:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 10:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956816  77 58478 36058642 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 10:01:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:01:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:01:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:01:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:01:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:01:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:01:08 [DEBUG   ] Finished updating board flags in 2.174 seconds
2018-12-26 10:01:11 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-26 10:01:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 10:01:51 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 10:02:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:02:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:02:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:02:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:02:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:02:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:02:08 [DEBUG   ] Finished updating board flags in 2.016 seconds
2018-12-26 10:02:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 10:02:31 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-26 10:02:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 10:03:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:03:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:03:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:03:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:03:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:03:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:03:08 [DEBUG   ] Finished updating board flags in 2.066 seconds
2018-12-26 10:03:11 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 10:03:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 10:03:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 10:04:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:04:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:04:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:04:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:04:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:04:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:04:08 [DEBUG   ] Finished updating board flags in 1.954 seconds
2018-12-26 10:04:11 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-26 10:04:31 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 10:04:35 [DEBUG   ] Got command RPT from MCS: ref #956842
2018-12-26 10:04:35 [DEBUG   ] summary = ERROR
2018-12-26 10:04:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956842  13 58478 36275561 A  ERRORERROR'
2018-12-26 10:04:35 [DEBUG   ] Got command RPT from MCS: ref #956843
2018-12-26 10:04:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 10:04:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956843  77 58478 36275765 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 10:04:35 [DEBUG   ] Got command RPT from MCS: ref #956844
2018-12-26 10:04:35 [DEBUG   ] summary = ERROR
2018-12-26 10:04:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956844  13 58478 36275969 A  ERRORERROR'
2018-12-26 10:04:36 [DEBUG   ] Got command RPT from MCS: ref #956846
2018-12-26 10:04:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 10:04:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956846  77 58478 36276161 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 10:04:36 [DEBUG   ] Got command RPT from MCS: ref #956847
2018-12-26 10:04:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 10:04:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956847  12 58478 36276365 A  ERRORB—™š'
2018-12-26 10:04:51 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-26 10:05:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:05:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:05:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:05:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:05:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:05:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:05:08 [DEBUG   ] Finished updating board flags in 1.778 seconds
2018-12-26 10:05:11 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-26 10:05:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 10:05:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 10:05:58 [DEBUG   ] Got command RPT from MCS: ref #956852
2018-12-26 10:05:58 [DEBUG   ] summary = ERROR
2018-12-26 10:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956852  13 58478 36358637 A  ERRORERROR'
2018-12-26 10:05:58 [DEBUG   ] Got command RPT from MCS: ref #956853
2018-12-26 10:05:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 10:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956853  77 58478 36358638 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 10:06:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:06:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:06:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:06:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:06:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:06:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:06:08 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-12-26 10:06:11 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-26 10:06:31 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-26 10:06:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 10:07:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:07:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:07:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:07:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:07:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:07:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:07:08 [DEBUG   ] Finished updating board flags in 1.576 seconds
2018-12-26 10:07:11 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 10:07:31 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-26 10:07:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 10:08:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:08:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:08:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:08:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:08:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:08:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:08:08 [DEBUG   ] Finished updating board flags in 1.436 seconds
2018-12-26 10:08:11 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-26 10:08:31 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 10:08:51 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-26 10:09:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:09:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-26 10:09:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:09:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:09:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:09:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:09:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:09:08 [DEBUG   ] Finished updating board flags in 1.416 seconds
2018-12-26 10:09:11 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-26 10:09:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 10:09:35 [DEBUG   ] Got command RPT from MCS: ref #956873
2018-12-26 10:09:35 [DEBUG   ] summary = ERROR
2018-12-26 10:09:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956873  13 58478 36575641 A  ERRORERROR'
2018-12-26 10:09:35 [DEBUG   ] Got command RPT from MCS: ref #956874
2018-12-26 10:09:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 10:09:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956874  77 58478 36575845 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 10:09:36 [DEBUG   ] Got command RPT from MCS: ref #956875
2018-12-26 10:09:36 [DEBUG   ] summary = ERROR
2018-12-26 10:09:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956875  13 58478 36576049 A  ERRORERROR'
2018-12-26 10:09:36 [DEBUG   ] Got command RPT from MCS: ref #956876
2018-12-26 10:09:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 10:09:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956876  77 58478 36576253 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 10:09:36 [DEBUG   ] Got command RPT from MCS: ref #956877
2018-12-26 10:09:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 10:09:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956877  12 58478 36576445 A  ERRORB–™š'
2018-12-26 10:09:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 10:10:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:10:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:10:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:10:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:10:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:10:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:10:08 [DEBUG   ] Finished updating board flags in 1.424 seconds
2018-12-26 10:10:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 10:10:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 10:10:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 10:10:58 [DEBUG   ] Got command RPT from MCS: ref #956882
2018-12-26 10:10:58 [DEBUG   ] summary = ERROR
2018-12-26 10:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956882  13 58478 36658645 A  ERRORERROR'
2018-12-26 10:10:58 [DEBUG   ] Got command RPT from MCS: ref #956883
2018-12-26 10:10:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 10:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956883  77 58478 36658646 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 10:11:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:11:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:11:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:11:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:11:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:11:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:11:08 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-12-26 10:11:11 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 10:11:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 10:11:51 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-26 10:12:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:12:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-12-26 10:12:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:12:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:12:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:12:08 [WARNING ] (13, 1, 'bot')
2018-12-26 10:12:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:12:08 [DEBUG   ] Finished updating board flags in 1.590 seconds
2018-12-26 10:12:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 10:12:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 10:12:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 10:13:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:13:09 [WARNING ] (13, 1, 'bot')
2018-12-26 10:13:09 [WARNING ] (13, 1, 'bot')
2018-12-26 10:13:09 [WARNING ] (13, 1, 'bot')
2018-12-26 10:13:09 [WARNING ] (13, 1, 'bot')
2018-12-26 10:13:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:13:09 [DEBUG   ] Finished updating board flags in 2.264 seconds
2018-12-26 10:13:11 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-26 10:13:31 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-26 10:13:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 10:14:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:14:09 [WARNING ] (13, 1, 'bot')
2018-12-26 10:14:09 [WARNING ] (13, 1, 'bot')
2018-12-26 10:14:09 [WARNING ] (13, 1, 'bot')
2018-12-26 10:14:09 [WARNING ] (13, 1, 'bot')
2018-12-26 10:14:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:14:09 [DEBUG   ] Finished updating board flags in 2.073 seconds
2018-12-26 10:14:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 10:14:31 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-26 10:14:35 [DEBUG   ] Got command RPT from MCS: ref #956905
2018-12-26 10:14:35 [DEBUG   ] summary = ERROR
2018-12-26 10:14:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956905  13 58478 36875721 A  ERRORERROR'
2018-12-26 10:14:35 [DEBUG   ] Got command RPT from MCS: ref #956906
2018-12-26 10:14:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 10:14:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956906  77 58478 36875925 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 10:14:36 [DEBUG   ] Got command RPT from MCS: ref #956907
2018-12-26 10:14:36 [DEBUG   ] summary = ERROR
2018-12-26 10:14:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956907  13 58478 36876129 A  ERRORERROR'
2018-12-26 10:14:36 [DEBUG   ] Got command RPT from MCS: ref #956909
2018-12-26 10:14:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 10:14:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956909  77 58478 36876321 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 10:14:36 [DEBUG   ] Got command RPT from MCS: ref #956910
2018-12-26 10:14:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 10:14:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956910  12 58478 36876525 A  ERRORB˜™š'
2018-12-26 10:14:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 10:15:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:15:09 [WARNING ] (13, 1, 'bot')
2018-12-26 10:15:09 [WARNING ] (13, 1, 'bot')
2018-12-26 10:15:09 [WARNING ] (13, 1, 'bot')
2018-12-26 10:15:09 [WARNING ] (13, 1, 'bot')
2018-12-26 10:15:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:15:09 [DEBUG   ] Finished updating board flags in 2.004 seconds
2018-12-26 10:15:11 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 10:15:32 [DEBUG   ] Finished updating ant stats in 1.602 seconds
2018-12-26 10:15:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 10:15:58 [DEBUG   ] Got command RPT from MCS: ref #956915
2018-12-26 10:15:58 [DEBUG   ] summary = ERROR
2018-12-26 10:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956915  13 58478 36958645 A  ERRORERROR'
2018-12-26 10:15:58 [DEBUG   ] Got command RPT from MCS: ref #956916
2018-12-26 10:15:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 10:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956916  77 58478 36958646 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 10:16:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:16:09 [WARNING ] (13, 1, 'bot')
2018-12-26 10:16:09 [WARNING ] (13, 1, 'bot')
2018-12-26 10:16:09 [WARNING ] (13, 1, 'bot')
2018-12-26 10:16:09 [WARNING ] (13, 1, 'bot')
2018-12-26 10:16:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:16:09 [DEBUG   ] Finished updating board flags in 2.007 seconds
2018-12-26 10:16:11 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-26 10:16:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 10:16:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 10:17:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:17:09 [WARNING ] (13, 1, 'bot')
2018-12-26 10:17:09 [WARNING ] (13, 1, 'bot')
2018-12-26 10:17:09 [WARNING ] (13, 1, 'bot')
2018-12-26 10:17:09 [WARNING ] (13, 1, 'bot')
2018-12-26 10:17:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:17:09 [DEBUG   ] Finished updating board flags in 1.989 seconds
2018-12-26 10:17:11 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-26 10:17:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 10:17:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 10:18:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:18:09 [WARNING ] (13, 1, 'bot')
2018-12-26 10:18:09 [WARNING ] (13, 1, 'bot')
2018-12-26 10:18:09 [WARNING ] (13, 1, 'bot')
2018-12-26 10:18:09 [WARNING ] (13, 1, 'bot')
2018-12-26 10:18:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:18:09 [DEBUG   ] Finished updating board flags in 1.892 seconds
2018-12-26 10:18:11 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 10:18:31 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-26 10:18:51 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-26 10:19:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:19:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 10:19:09 [WARNING ] (13, 1, 'bot')
2018-12-26 10:19:09 [WARNING ] (13, 1, 'bot')
2018-12-26 10:19:09 [WARNING ] (13, 1, 'bot')
2018-12-26 10:19:09 [WARNING ] (13, 1, 'bot')
2018-12-26 10:19:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:19:09 [DEBUG   ] Finished updating board flags in 1.728 seconds
2018-12-26 10:19:11 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 10:19:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 10:19:35 [DEBUG   ] Got command RPT from MCS: ref #956940
2018-12-26 10:19:35 [DEBUG   ] summary = ERROR
2018-12-26 10:19:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956940  13 58478 37175805 A  ERRORERROR'
2018-12-26 10:19:36 [DEBUG   ] Got command RPT from MCS: ref #956941
2018-12-26 10:19:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 10:19:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956941  77 58478 37176009 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 10:19:36 [DEBUG   ] Got command RPT from MCS: ref #956942
2018-12-26 10:19:36 [DEBUG   ] summary = ERROR
2018-12-26 10:19:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956942  13 58478 37176201 A  ERRORERROR'
2018-12-26 10:19:36 [DEBUG   ] Got command RPT from MCS: ref #956943
2018-12-26 10:19:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 10:19:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956943  77 58478 37176405 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 10:19:36 [DEBUG   ] Got command RPT from MCS: ref #956944
2018-12-26 10:19:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 10:19:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956944  12 58478 37176609 A  ERRORB—™š'
2018-12-26 10:19:51 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-26 10:20:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:20:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-26 10:20:09 [WARNING ] (13, 1, 'bot')
2018-12-26 10:20:09 [WARNING ] (13, 1, 'bot')
2018-12-26 10:20:09 [WARNING ] (13, 1, 'bot')
2018-12-26 10:20:09 [WARNING ] (13, 1, 'bot')
2018-12-26 10:20:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:20:09 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-12-26 10:20:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 10:20:31 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 10:20:51 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-12-26 10:20:58 [DEBUG   ] Got command RPT from MCS: ref #956945
2018-12-26 10:20:58 [DEBUG   ] summary = ERROR
2018-12-26 10:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956945  13 58478 37258645 A  ERRORERROR'
2018-12-26 10:20:58 [DEBUG   ] Got command RPT from MCS: ref #956946
2018-12-26 10:20:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 10:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956946  77 58478 37258646 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 10:21:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:21:09 [WARNING ] (13, 1, 'bot')
2018-12-26 10:21:09 [WARNING ] (13, 1, 'bot')
2018-12-26 10:21:09 [WARNING ] (13, 1, 'bot')
2018-12-26 10:21:09 [WARNING ] (13, 1, 'bot')
2018-12-26 10:21:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:21:09 [DEBUG   ] Finished updating board flags in 1.563 seconds
2018-12-26 10:21:11 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-12-26 10:21:32 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-26 10:21:52 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-26 10:22:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:22:09 [WARNING ] (13, 1, 'bot')
2018-12-26 10:22:09 [WARNING ] (13, 1, 'bot')
2018-12-26 10:22:09 [WARNING ] (13, 1, 'bot')
2018-12-26 10:22:09 [WARNING ] (13, 1, 'bot')
2018-12-26 10:22:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:22:09 [DEBUG   ] Finished updating board flags in 1.420 seconds
2018-12-26 10:22:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 10:22:32 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-26 10:22:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 10:23:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:23:09 [WARNING ] (13, 1, 'bot')
2018-12-26 10:23:09 [WARNING ] (13, 1, 'bot')
2018-12-26 10:23:09 [WARNING ] (13, 1, 'bot')
2018-12-26 10:23:09 [WARNING ] (13, 1, 'bot')
2018-12-26 10:23:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:23:09 [DEBUG   ] Finished updating board flags in 1.378 seconds
2018-12-26 10:23:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 10:23:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 10:23:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 10:24:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:24:09 [WARNING ] (13, 1, 'bot')
2018-12-26 10:24:09 [WARNING ] (13, 1, 'bot')
2018-12-26 10:24:09 [WARNING ] (13, 1, 'bot')
2018-12-26 10:24:09 [WARNING ] (13, 1, 'bot')
2018-12-26 10:24:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:24:09 [DEBUG   ] Finished updating board flags in 1.378 seconds
2018-12-26 10:24:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 10:24:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 10:24:35 [DEBUG   ] Got command RPT from MCS: ref #956968
2018-12-26 10:24:35 [DEBUG   ] summary = ERROR
2018-12-26 10:24:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956968  13 58478 37475885 A  ERRORERROR'
2018-12-26 10:24:36 [DEBUG   ] Got command RPT from MCS: ref #956969
2018-12-26 10:24:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 10:24:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956969  77 58478 37476089 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 10:24:36 [DEBUG   ] Got command RPT from MCS: ref #956970
2018-12-26 10:24:36 [DEBUG   ] summary = ERROR
2018-12-26 10:24:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956970  13 58478 37476281 A  ERRORERROR'
2018-12-26 10:24:36 [DEBUG   ] Got command RPT from MCS: ref #956972
2018-12-26 10:24:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 10:24:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956972  77 58478 37476485 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 10:24:36 [DEBUG   ] Got command RPT from MCS: ref #956973
2018-12-26 10:24:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 10:24:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956973  12 58478 37476689 A  ERRORB–™š'
2018-12-26 10:24:52 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-26 10:25:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:25:10 [WARNING ] (13, 1, 'bot')
2018-12-26 10:25:10 [WARNING ] (13, 1, 'bot')
2018-12-26 10:25:10 [WARNING ] (13, 1, 'bot')
2018-12-26 10:25:10 [WARNING ] (13, 1, 'bot')
2018-12-26 10:25:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:25:10 [DEBUG   ] Finished updating board flags in 2.121 seconds
2018-12-26 10:25:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 10:25:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 10:25:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 10:25:58 [DEBUG   ] Got command RPT from MCS: ref #956982
2018-12-26 10:25:58 [DEBUG   ] summary = ERROR
2018-12-26 10:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956982  13 58478 37558649 A  ERRORERROR'
2018-12-26 10:25:58 [DEBUG   ] Got command RPT from MCS: ref #956983
2018-12-26 10:25:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 10:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   956983  77 58478 37558650 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 10:26:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:26:10 [WARNING ] (13, 1, 'bot')
2018-12-26 10:26:10 [WARNING ] (13, 1, 'bot')
2018-12-26 10:26:10 [WARNING ] (13, 1, 'bot')
2018-12-26 10:26:10 [WARNING ] (13, 1, 'bot')
2018-12-26 10:26:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:26:10 [DEBUG   ] Finished updating board flags in 1.932 seconds
2018-12-26 10:26:12 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-12-26 10:26:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 10:26:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 10:27:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:27:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-26 10:27:10 [WARNING ] (13, 1, 'bot')
2018-12-26 10:27:10 [WARNING ] (13, 1, 'bot')
2018-12-26 10:27:10 [WARNING ] (13, 1, 'bot')
2018-12-26 10:27:10 [WARNING ] (13, 1, 'bot')
2018-12-26 10:27:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:27:10 [DEBUG   ] Finished updating board flags in 1.795 seconds
2018-12-26 10:27:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 10:27:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 10:27:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 10:28:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-26 10:28:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:28:10 [WARNING ] (13, 1, 'bot')
2018-12-26 10:28:10 [WARNING ] (13, 1, 'bot')
2018-12-26 10:28:10 [WARNING ] (13, 1, 'bot')
2018-12-26 10:28:10 [WARNING ] (13, 1, 'bot')
2018-12-26 10:28:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:28:10 [DEBUG   ] Finished updating board flags in 1.634 seconds
2018-12-26 10:28:12 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 10:28:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 10:28:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 10:29:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:29:10 [WARNING ] (13, 1, 'bot')
2018-12-26 10:29:10 [WARNING ] (13, 1, 'bot')
2018-12-26 10:29:10 [WARNING ] (13, 1, 'bot')
2018-12-26 10:29:10 [WARNING ] (13, 1, 'bot')
2018-12-26 10:29:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:29:10 [DEBUG   ] Finished updating board flags in 1.562 seconds
2018-12-26 10:29:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 10:29:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 10:29:35 [DEBUG   ] Got command RPT from MCS: ref #957003
2018-12-26 10:29:35 [DEBUG   ] summary = ERROR
2018-12-26 10:29:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957003  13 58478 37775961 A  ERRORERROR'
2018-12-26 10:29:36 [DEBUG   ] Got command RPT from MCS: ref #957004
2018-12-26 10:29:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 10:29:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957004  77 58478 37776165 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 10:29:36 [DEBUG   ] Got command RPT from MCS: ref #957005
2018-12-26 10:29:36 [DEBUG   ] summary = ERROR
2018-12-26 10:29:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957005  13 58478 37776369 A  ERRORERROR'
2018-12-26 10:29:36 [DEBUG   ] Got command RPT from MCS: ref #957006
2018-12-26 10:29:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 10:29:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957006  77 58478 37776561 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 10:29:36 [DEBUG   ] Got command RPT from MCS: ref #957007
2018-12-26 10:29:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 10:29:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957007  12 58478 37776765 A  ERRORB˜™š'
2018-12-26 10:29:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 10:30:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:30:10 [WARNING ] (13, 1, 'bot')
2018-12-26 10:30:10 [WARNING ] (13, 1, 'bot')
2018-12-26 10:30:10 [WARNING ] (13, 1, 'bot')
2018-12-26 10:30:10 [WARNING ] (13, 1, 'bot')
2018-12-26 10:30:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:30:10 [DEBUG   ] Finished updating board flags in 1.408 seconds
2018-12-26 10:30:12 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-26 10:30:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 10:30:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 10:30:58 [DEBUG   ] Got command RPT from MCS: ref #957008
2018-12-26 10:30:58 [DEBUG   ] summary = ERROR
2018-12-26 10:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957008  13 58478 37858645 A  ERRORERROR'
2018-12-26 10:30:58 [DEBUG   ] Got command RPT from MCS: ref #957009
2018-12-26 10:30:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 10:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957009  77 58478 37858646 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 10:31:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:31:10 [WARNING ] (13, 1, 'bot')
2018-12-26 10:31:10 [WARNING ] (13, 1, 'bot')
2018-12-26 10:31:10 [WARNING ] (13, 1, 'bot')
2018-12-26 10:31:10 [WARNING ] (13, 1, 'bot')
2018-12-26 10:31:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:31:10 [DEBUG   ] Finished updating board flags in 1.505 seconds
2018-12-26 10:31:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 10:31:32 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-26 10:31:52 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-26 10:32:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:32:10 [WARNING ] (13, 1, 'bot')
2018-12-26 10:32:10 [WARNING ] (13, 1, 'bot')
2018-12-26 10:32:10 [WARNING ] (13, 1, 'bot')
2018-12-26 10:32:10 [WARNING ] (13, 1, 'bot')
2018-12-26 10:32:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:32:10 [DEBUG   ] Finished updating board flags in 1.554 seconds
2018-12-26 10:32:12 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-26 10:32:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 10:32:52 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-26 10:33:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:33:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:33:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:33:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:33:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:33:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:33:11 [DEBUG   ] Finished updating board flags in 2.234 seconds
2018-12-26 10:33:12 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-26 10:33:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 10:33:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 10:34:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:34:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:34:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:34:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:34:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:34:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:34:11 [DEBUG   ] Finished updating board flags in 2.214 seconds
2018-12-26 10:34:12 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-26 10:34:32 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-26 10:34:36 [DEBUG   ] Got command RPT from MCS: ref #957035
2018-12-26 10:34:36 [DEBUG   ] summary = ERROR
2018-12-26 10:34:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957035  13 58478 38076037 A  ERRORERROR'
2018-12-26 10:34:36 [DEBUG   ] Got command RPT from MCS: ref #957036
2018-12-26 10:34:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 10:34:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957036  77 58478 38076241 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 10:34:36 [DEBUG   ] Got command RPT from MCS: ref #957037
2018-12-26 10:34:36 [DEBUG   ] summary = ERROR
2018-12-26 10:34:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957037  13 58478 38076445 A  ERRORERROR'
2018-12-26 10:34:36 [DEBUG   ] Got command RPT from MCS: ref #957039
2018-12-26 10:34:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 10:34:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957039  77 58478 38076649 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 10:34:36 [DEBUG   ] Got command RPT from MCS: ref #957041
2018-12-26 10:34:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 10:34:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957041  12 58478 38076841 A  ERRORB—™š'
2018-12-26 10:34:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 10:35:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:35:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:35:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:35:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:35:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:35:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:35:11 [DEBUG   ] Finished updating board flags in 2.147 seconds
2018-12-26 10:35:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 10:35:32 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-26 10:35:52 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-26 10:35:58 [DEBUG   ] Got command RPT from MCS: ref #957045
2018-12-26 10:35:58 [DEBUG   ] summary = ERROR
2018-12-26 10:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957045  13 58478 38158641 A  ERRORERROR'
2018-12-26 10:35:58 [DEBUG   ] Got command RPT from MCS: ref #957046
2018-12-26 10:35:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 10:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957046  77 58478 38158642 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 10:36:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:36:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:36:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:36:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:36:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:36:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:36:11 [DEBUG   ] Finished updating board flags in 1.998 seconds
2018-12-26 10:36:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 10:36:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 10:36:52 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-12-26 10:37:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:37:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:37:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:37:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:37:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:37:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:37:11 [DEBUG   ] Finished updating board flags in 1.777 seconds
2018-12-26 10:37:12 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-26 10:37:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 10:37:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 10:38:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:38:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:38:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:38:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:38:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:38:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:38:11 [DEBUG   ] Finished updating board flags in 1.609 seconds
2018-12-26 10:38:12 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-26 10:38:32 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-26 10:38:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 10:39:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:39:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:39:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:39:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:39:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:39:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:39:11 [DEBUG   ] Finished updating board flags in 1.604 seconds
2018-12-26 10:39:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 10:39:32 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-26 10:39:36 [DEBUG   ] Got command RPT from MCS: ref #957066
2018-12-26 10:39:36 [DEBUG   ] summary = ERROR
2018-12-26 10:39:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957066  13 58478 38376125 A  ERRORERROR'
2018-12-26 10:39:36 [DEBUG   ] Got command RPT from MCS: ref #957067
2018-12-26 10:39:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 10:39:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957067  77 58478 38376329 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 10:39:36 [DEBUG   ] Got command RPT from MCS: ref #957068
2018-12-26 10:39:36 [DEBUG   ] summary = ERROR
2018-12-26 10:39:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957068  13 58478 38376521 A  ERRORERROR'
2018-12-26 10:39:36 [DEBUG   ] Got command RPT from MCS: ref #957069
2018-12-26 10:39:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 10:39:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957069  77 58478 38376725 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 10:39:36 [DEBUG   ] Got command RPT from MCS: ref #957070
2018-12-26 10:39:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 10:39:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957070  12 58478 38376929 A  ERRORB–™š'
2018-12-26 10:39:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 10:40:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:40:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:40:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:40:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:40:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:40:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:40:11 [DEBUG   ] Finished updating board flags in 1.678 seconds
2018-12-26 10:40:12 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-26 10:40:32 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 10:40:52 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-12-26 10:40:58 [DEBUG   ] Got command RPT from MCS: ref #957075
2018-12-26 10:40:58 [DEBUG   ] summary = ERROR
2018-12-26 10:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957075  13 58478 38458649 A  ERRORERROR'
2018-12-26 10:40:58 [DEBUG   ] Got command RPT from MCS: ref #957076
2018-12-26 10:40:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 10:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957076  77 58478 38458650 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 10:41:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:41:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:41:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:41:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:41:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:41:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:41:11 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-12-26 10:41:12 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-12-26 10:41:32 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-26 10:41:52 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 10:42:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:42:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:42:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:42:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:42:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:42:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:42:11 [DEBUG   ] Finished updating board flags in 1.492 seconds
2018-12-26 10:42:13 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-26 10:42:33 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-26 10:42:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 10:43:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:43:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-26 10:43:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:43:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:43:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:43:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:43:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:43:11 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-12-26 10:43:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 10:43:33 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-26 10:43:53 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 10:44:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 10:44:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:44:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:44:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:44:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:44:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:44:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:44:11 [DEBUG   ] Finished updating board flags in 1.378 seconds
2018-12-26 10:44:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 10:44:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 10:44:36 [DEBUG   ] Got command RPT from MCS: ref #957098
2018-12-26 10:44:36 [DEBUG   ] summary = ERROR
2018-12-26 10:44:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957098  13 58478 38676201 A  ERRORERROR'
2018-12-26 10:44:36 [DEBUG   ] Got command RPT from MCS: ref #957099
2018-12-26 10:44:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 10:44:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957099  77 58478 38676405 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 10:44:36 [DEBUG   ] Got command RPT from MCS: ref #957100
2018-12-26 10:44:36 [DEBUG   ] summary = ERROR
2018-12-26 10:44:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957100  13 58478 38676609 A  ERRORERROR'
2018-12-26 10:44:36 [DEBUG   ] Got command RPT from MCS: ref #957102
2018-12-26 10:44:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 10:44:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957102  77 58478 38676801 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 10:44:37 [DEBUG   ] Got command RPT from MCS: ref #957103
2018-12-26 10:44:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 10:44:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957103  12 58478 38677005 A  ERRORB–™š'
2018-12-26 10:44:53 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-26 10:45:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:45:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:45:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:45:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:45:11 [WARNING ] (13, 1, 'bot')
2018-12-26 10:45:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:45:11 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-12-26 10:45:13 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 10:45:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 10:45:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 10:45:58 [DEBUG   ] Got command RPT from MCS: ref #957108
2018-12-26 10:45:58 [DEBUG   ] summary = ERROR
2018-12-26 10:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957108  13 58478 38758653 A  ERRORERROR'
2018-12-26 10:45:58 [DEBUG   ] Got command RPT from MCS: ref #957109
2018-12-26 10:45:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 10:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957109  77 58478 38758654 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 10:46:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:46:12 [WARNING ] (13, 1, 'bot')
2018-12-26 10:46:12 [WARNING ] (13, 1, 'bot')
2018-12-26 10:46:12 [WARNING ] (13, 1, 'bot')
2018-12-26 10:46:12 [WARNING ] (13, 1, 'bot')
2018-12-26 10:46:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:46:12 [DEBUG   ] Finished updating board flags in 2.242 seconds
2018-12-26 10:46:13 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-12-26 10:46:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 10:46:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 10:47:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:47:12 [WARNING ] (13, 1, 'bot')
2018-12-26 10:47:12 [WARNING ] (13, 1, 'bot')
2018-12-26 10:47:12 [WARNING ] (13, 1, 'bot')
2018-12-26 10:47:12 [WARNING ] (13, 1, 'bot')
2018-12-26 10:47:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:47:12 [DEBUG   ] Finished updating board flags in 2.186 seconds
2018-12-26 10:47:13 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-26 10:47:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 10:47:53 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 10:48:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 10:48:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:48:13 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-12-26 10:48:13 [WARNING ] (13, 1, 'bot')
2018-12-26 10:48:13 [WARNING ] (13, 1, 'bot')
2018-12-26 10:48:13 [WARNING ] (13, 1, 'bot')
2018-12-26 10:48:13 [WARNING ] (13, 1, 'bot')
2018-12-26 10:48:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:48:13 [DEBUG   ] Finished updating board flags in 2.925 seconds
2018-12-26 10:48:33 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-12-26 10:48:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 10:49:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:49:12 [WARNING ] (13, 1, 'bot')
2018-12-26 10:49:12 [WARNING ] (13, 1, 'bot')
2018-12-26 10:49:12 [WARNING ] (13, 1, 'bot')
2018-12-26 10:49:12 [WARNING ] (13, 1, 'bot')
2018-12-26 10:49:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:49:12 [DEBUG   ] Finished updating board flags in 1.896 seconds
2018-12-26 10:49:13 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-26 10:49:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 10:49:36 [DEBUG   ] Got command RPT from MCS: ref #957133
2018-12-26 10:49:36 [DEBUG   ] summary = ERROR
2018-12-26 10:49:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957133  13 58478 38976285 A  ERRORERROR'
2018-12-26 10:49:36 [DEBUG   ] Got command RPT from MCS: ref #957134
2018-12-26 10:49:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 10:49:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957134  77 58478 38976489 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 10:49:36 [DEBUG   ] Got command RPT from MCS: ref #957135
2018-12-26 10:49:36 [DEBUG   ] summary = ERROR
2018-12-26 10:49:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957135  13 58478 38976681 A  ERRORERROR'
2018-12-26 10:49:36 [DEBUG   ] Got command RPT from MCS: ref #957136
2018-12-26 10:49:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 10:49:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957136  77 58478 38976885 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 10:49:37 [DEBUG   ] Got command RPT from MCS: ref #957137
2018-12-26 10:49:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 10:49:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957137  12 58478 38977089 A  ERRORB˜™š'
2018-12-26 10:49:53 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-26 10:50:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:50:12 [WARNING ] (13, 1, 'bot')
2018-12-26 10:50:12 [WARNING ] (13, 1, 'bot')
2018-12-26 10:50:12 [WARNING ] (13, 1, 'bot')
2018-12-26 10:50:12 [WARNING ] (13, 1, 'bot')
2018-12-26 10:50:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:50:12 [DEBUG   ] Finished updating board flags in 1.798 seconds
2018-12-26 10:50:13 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-26 10:50:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 10:50:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 10:50:58 [DEBUG   ] Got command RPT from MCS: ref #957138
2018-12-26 10:50:58 [DEBUG   ] summary = ERROR
2018-12-26 10:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957138  13 58478 39058649 A  ERRORERROR'
2018-12-26 10:50:58 [DEBUG   ] Got command RPT from MCS: ref #957139
2018-12-26 10:50:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 10:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957139  77 58478 39058650 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 10:51:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:51:12 [WARNING ] (13, 1, 'bot')
2018-12-26 10:51:12 [WARNING ] (13, 1, 'bot')
2018-12-26 10:51:12 [WARNING ] (13, 1, 'bot')
2018-12-26 10:51:12 [WARNING ] (13, 1, 'bot')
2018-12-26 10:51:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:51:12 [DEBUG   ] Finished updating board flags in 1.610 seconds
2018-12-26 10:51:13 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-12-26 10:51:33 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-12-26 10:51:54 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-26 10:52:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:52:12 [WARNING ] (13, 1, 'bot')
2018-12-26 10:52:12 [WARNING ] (13, 1, 'bot')
2018-12-26 10:52:12 [WARNING ] (13, 1, 'bot')
2018-12-26 10:52:12 [WARNING ] (13, 1, 'bot')
2018-12-26 10:52:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:52:12 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-12-26 10:52:14 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-26 10:52:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 10:52:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 10:53:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:53:12 [WARNING ] (13, 1, 'bot')
2018-12-26 10:53:12 [WARNING ] (13, 1, 'bot')
2018-12-26 10:53:12 [WARNING ] (13, 1, 'bot')
2018-12-26 10:53:12 [WARNING ] (13, 1, 'bot')
2018-12-26 10:53:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:53:12 [DEBUG   ] Finished updating board flags in 1.529 seconds
2018-12-26 10:53:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-26 10:53:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 10:53:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 10:54:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:54:12 [WARNING ] (13, 1, 'bot')
2018-12-26 10:54:12 [WARNING ] (13, 1, 'bot')
2018-12-26 10:54:12 [WARNING ] (13, 1, 'bot')
2018-12-26 10:54:12 [WARNING ] (13, 1, 'bot')
2018-12-26 10:54:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:54:12 [DEBUG   ] Finished updating board flags in 1.441 seconds
2018-12-26 10:54:14 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 10:54:34 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-12-26 10:54:36 [DEBUG   ] Got command RPT from MCS: ref #957161
2018-12-26 10:54:36 [DEBUG   ] summary = ERROR
2018-12-26 10:54:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957161  13 58478 39276361 A  ERRORERROR'
2018-12-26 10:54:36 [DEBUG   ] Got command RPT from MCS: ref #957162
2018-12-26 10:54:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 10:54:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957162  77 58478 39276565 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 10:54:36 [DEBUG   ] Got command RPT from MCS: ref #957163
2018-12-26 10:54:36 [DEBUG   ] summary = ERROR
2018-12-26 10:54:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957163  13 58478 39276769 A  ERRORERROR'
2018-12-26 10:54:36 [DEBUG   ] Got command RPT from MCS: ref #957164
2018-12-26 10:54:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 10:54:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957164  77 58478 39276961 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 10:54:37 [DEBUG   ] Got command RPT from MCS: ref #957166
2018-12-26 10:54:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 10:54:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957166  12 58478 39277165 A  ERRORB—™š'
2018-12-26 10:54:54 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-26 10:55:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:55:12 [WARNING ] (13, 1, 'bot')
2018-12-26 10:55:12 [WARNING ] (13, 1, 'bot')
2018-12-26 10:55:12 [WARNING ] (13, 1, 'bot')
2018-12-26 10:55:12 [WARNING ] (13, 1, 'bot')
2018-12-26 10:55:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:55:12 [DEBUG   ] Finished updating board flags in 1.433 seconds
2018-12-26 10:55:14 [DEBUG   ] Finished updating ant stats in 0.986 seconds
2018-12-26 10:55:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 10:55:54 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-26 10:55:58 [DEBUG   ] Got command RPT from MCS: ref #957175
2018-12-26 10:55:58 [DEBUG   ] summary = ERROR
2018-12-26 10:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957175  13 58478 39358649 A  ERRORERROR'
2018-12-26 10:55:58 [DEBUG   ] Got command RPT from MCS: ref #957176
2018-12-26 10:55:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 10:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957176  77 58478 39358650 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 10:56:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:56:12 [WARNING ] (13, 1, 'bot')
2018-12-26 10:56:12 [WARNING ] (13, 1, 'bot')
2018-12-26 10:56:12 [WARNING ] (13, 1, 'bot')
2018-12-26 10:56:12 [WARNING ] (13, 1, 'bot')
2018-12-26 10:56:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:56:12 [DEBUG   ] Finished updating board flags in 1.433 seconds
2018-12-26 10:56:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 10:56:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 10:56:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 10:57:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 10:57:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:57:12 [WARNING ] (13, 1, 'bot')
2018-12-26 10:57:12 [WARNING ] (13, 1, 'bot')
2018-12-26 10:57:12 [WARNING ] (13, 1, 'bot')
2018-12-26 10:57:12 [WARNING ] (13, 1, 'bot')
2018-12-26 10:57:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:57:12 [DEBUG   ] Finished updating board flags in 1.455 seconds
2018-12-26 10:57:14 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-26 10:57:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 10:57:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 10:58:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:58:12 [WARNING ] (13, 1, 'bot')
2018-12-26 10:58:12 [WARNING ] (13, 1, 'bot')
2018-12-26 10:58:12 [WARNING ] (13, 1, 'bot')
2018-12-26 10:58:12 [WARNING ] (13, 1, 'bot')
2018-12-26 10:58:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:58:12 [DEBUG   ] Finished updating board flags in 1.565 seconds
2018-12-26 10:58:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 10:58:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 10:58:54 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-26 10:59:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 10:59:13 [WARNING ] (13, 1, 'bot')
2018-12-26 10:59:13 [WARNING ] (13, 1, 'bot')
2018-12-26 10:59:13 [WARNING ] (13, 1, 'bot')
2018-12-26 10:59:13 [WARNING ] (13, 1, 'bot')
2018-12-26 10:59:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 10:59:13 [DEBUG   ] Finished updating board flags in 2.221 seconds
2018-12-26 10:59:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 10:59:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 10:59:36 [DEBUG   ] Got command RPT from MCS: ref #957196
2018-12-26 10:59:36 [DEBUG   ] summary = ERROR
2018-12-26 10:59:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957196  13 58478 39576441 A  ERRORERROR'
2018-12-26 10:59:36 [DEBUG   ] Got command RPT from MCS: ref #957197
2018-12-26 10:59:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 10:59:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957197  77 58478 39576645 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 10:59:36 [DEBUG   ] Got command RPT from MCS: ref #957198
2018-12-26 10:59:36 [DEBUG   ] summary = ERROR
2018-12-26 10:59:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957198  13 58478 39576849 A  ERRORERROR'
2018-12-26 10:59:37 [DEBUG   ] Got command RPT from MCS: ref #957199
2018-12-26 10:59:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 10:59:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957199  77 58478 39577041 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 10:59:37 [DEBUG   ] Got command RPT from MCS: ref #957200
2018-12-26 10:59:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 10:59:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957200  12 58478 39577245 A  ERRORB—™š'
2018-12-26 10:59:54 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-26 11:00:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:00:13 [WARNING ] (13, 1, 'bot')
2018-12-26 11:00:13 [WARNING ] (13, 1, 'bot')
2018-12-26 11:00:13 [WARNING ] (13, 1, 'bot')
2018-12-26 11:00:13 [WARNING ] (13, 1, 'bot')
2018-12-26 11:00:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:00:13 [DEBUG   ] Finished updating board flags in 2.183 seconds
2018-12-26 11:00:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 11:00:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 11:00:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 11:00:58 [DEBUG   ] Got command RPT from MCS: ref #957201
2018-12-26 11:00:58 [DEBUG   ] summary = ERROR
2018-12-26 11:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957201  13 58478 39658645 A  ERRORERROR'
2018-12-26 11:00:58 [DEBUG   ] Got command RPT from MCS: ref #957202
2018-12-26 11:00:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 11:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957202  77 58478 39658646 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 11:01:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:01:13 [WARNING ] (13, 1, 'bot')
2018-12-26 11:01:13 [WARNING ] (13, 1, 'bot')
2018-12-26 11:01:13 [WARNING ] (13, 1, 'bot')
2018-12-26 11:01:13 [WARNING ] (13, 1, 'bot')
2018-12-26 11:01:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:01:13 [DEBUG   ] Finished updating board flags in 1.939 seconds
2018-12-26 11:01:14 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-12-26 11:01:34 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-26 11:01:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 11:02:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:02:13 [WARNING ] (13, 1, 'bot')
2018-12-26 11:02:13 [WARNING ] (13, 1, 'bot')
2018-12-26 11:02:13 [WARNING ] (13, 1, 'bot')
2018-12-26 11:02:13 [WARNING ] (13, 1, 'bot')
2018-12-26 11:02:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:02:13 [DEBUG   ] Finished updating board flags in 1.763 seconds
2018-12-26 11:02:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 11:02:34 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-26 11:02:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 11:03:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:03:13 [WARNING ] (13, 1, 'bot')
2018-12-26 11:03:13 [WARNING ] (13, 1, 'bot')
2018-12-26 11:03:13 [WARNING ] (13, 1, 'bot')
2018-12-26 11:03:13 [WARNING ] (13, 1, 'bot')
2018-12-26 11:03:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:03:13 [DEBUG   ] Finished updating board flags in 1.602 seconds
2018-12-26 11:03:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 11:03:34 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 11:03:54 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-26 11:04:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 11:04:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:04:13 [WARNING ] (13, 1, 'bot')
2018-12-26 11:04:13 [WARNING ] (13, 1, 'bot')
2018-12-26 11:04:13 [WARNING ] (13, 1, 'bot')
2018-12-26 11:04:13 [WARNING ] (13, 1, 'bot')
2018-12-26 11:04:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:04:13 [DEBUG   ] Finished updating board flags in 1.626 seconds
2018-12-26 11:04:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 11:04:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 11:04:36 [DEBUG   ] Got command RPT from MCS: ref #957228
2018-12-26 11:04:36 [DEBUG   ] summary = ERROR
2018-12-26 11:04:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957228  13 58478 39876521 A  ERRORERROR'
2018-12-26 11:04:36 [DEBUG   ] Got command RPT from MCS: ref #957229
2018-12-26 11:04:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 11:04:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957229  77 58478 39876725 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 11:04:36 [DEBUG   ] Got command RPT from MCS: ref #957230
2018-12-26 11:04:36 [DEBUG   ] summary = ERROR
2018-12-26 11:04:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957230  13 58478 39876929 A  ERRORERROR'
2018-12-26 11:04:37 [DEBUG   ] Got command RPT from MCS: ref #957232
2018-12-26 11:04:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 11:04:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957232  77 58478 39877121 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 11:04:37 [DEBUG   ] Got command RPT from MCS: ref #957234
2018-12-26 11:04:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 11:04:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957234  12 58478 39877325 A  ERRORB˜™š'
2018-12-26 11:04:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 11:05:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:05:13 [WARNING ] (13, 1, 'bot')
2018-12-26 11:05:13 [WARNING ] (13, 1, 'bot')
2018-12-26 11:05:13 [WARNING ] (13, 1, 'bot')
2018-12-26 11:05:13 [WARNING ] (13, 1, 'bot')
2018-12-26 11:05:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:05:13 [DEBUG   ] Finished updating board flags in 1.624 seconds
2018-12-26 11:05:14 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-26 11:05:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 11:05:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 11:05:58 [DEBUG   ] Got command RPT from MCS: ref #957238
2018-12-26 11:05:58 [DEBUG   ] summary = ERROR
2018-12-26 11:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957238  13 58478 39958653 A  ERRORERROR'
2018-12-26 11:05:58 [DEBUG   ] Got command RPT from MCS: ref #957239
2018-12-26 11:05:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 11:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957239  77 58478 39958654 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 11:06:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:06:13 [WARNING ] (13, 1, 'bot')
2018-12-26 11:06:13 [WARNING ] (13, 1, 'bot')
2018-12-26 11:06:13 [WARNING ] (13, 1, 'bot')
2018-12-26 11:06:13 [WARNING ] (13, 1, 'bot')
2018-12-26 11:06:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:06:13 [DEBUG   ] Finished updating board flags in 1.700 seconds
2018-12-26 11:06:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 11:06:34 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-26 11:06:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 11:07:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:07:13 [WARNING ] (13, 1, 'bot')
2018-12-26 11:07:13 [WARNING ] (13, 1, 'bot')
2018-12-26 11:07:13 [WARNING ] (13, 1, 'bot')
2018-12-26 11:07:13 [WARNING ] (13, 1, 'bot')
2018-12-26 11:07:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:07:13 [DEBUG   ] Finished updating board flags in 1.639 seconds
2018-12-26 11:07:14 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-26 11:07:34 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-26 11:07:54 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-12-26 11:08:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:08:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-26 11:08:13 [WARNING ] (13, 1, 'bot')
2018-12-26 11:08:13 [WARNING ] (13, 1, 'bot')
2018-12-26 11:08:13 [WARNING ] (13, 1, 'bot')
2018-12-26 11:08:13 [WARNING ] (13, 1, 'bot')
2018-12-26 11:08:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:08:13 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-12-26 11:08:14 [DEBUG   ] Finished updating ant stats in 0.397 seconds
2018-12-26 11:08:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 11:08:55 [DEBUG   ] Finished updating ant stats in 0.993 seconds
2018-12-26 11:09:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:09:13 [WARNING ] (13, 1, 'bot')
2018-12-26 11:09:13 [WARNING ] (13, 1, 'bot')
2018-12-26 11:09:13 [WARNING ] (13, 1, 'bot')
2018-12-26 11:09:13 [WARNING ] (13, 1, 'bot')
2018-12-26 11:09:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:09:13 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-12-26 11:09:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 11:09:35 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 11:09:36 [DEBUG   ] Got command RPT from MCS: ref #957259
2018-12-26 11:09:36 [DEBUG   ] summary = ERROR
2018-12-26 11:09:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957259  13 58478 40176609 A  ERRORERROR'
2018-12-26 11:09:36 [DEBUG   ] Got command RPT from MCS: ref #957260
2018-12-26 11:09:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 11:09:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957260  77 58478 40176801 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 11:09:37 [DEBUG   ] Got command RPT from MCS: ref #957261
2018-12-26 11:09:37 [DEBUG   ] summary = ERROR
2018-12-26 11:09:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957261  13 58478 40177005 A  ERRORERROR'
2018-12-26 11:09:37 [DEBUG   ] Got command RPT from MCS: ref #957262
2018-12-26 11:09:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 11:09:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957262  77 58478 40177209 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 11:09:37 [DEBUG   ] Got command RPT from MCS: ref #957263
2018-12-26 11:09:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 11:09:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957263  12 58478 40177413 A  ERRORB–™š'
2018-12-26 11:09:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-26 11:10:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:10:13 [WARNING ] (13, 1, 'bot')
2018-12-26 11:10:13 [WARNING ] (13, 1, 'bot')
2018-12-26 11:10:13 [WARNING ] (13, 1, 'bot')
2018-12-26 11:10:13 [WARNING ] (13, 1, 'bot')
2018-12-26 11:10:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:10:13 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-12-26 11:10:15 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-26 11:10:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 11:10:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 11:10:58 [DEBUG   ] Got command RPT from MCS: ref #957268
2018-12-26 11:10:58 [DEBUG   ] summary = ERROR
2018-12-26 11:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957268  13 58478 40258649 A  ERRORERROR'
2018-12-26 11:10:58 [DEBUG   ] Got command RPT from MCS: ref #957269
2018-12-26 11:10:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 11:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957269  77 58478 40258650 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 11:11:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:11:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-26 11:11:13 [WARNING ] (13, 1, 'bot')
2018-12-26 11:11:13 [WARNING ] (13, 1, 'bot')
2018-12-26 11:11:13 [WARNING ] (13, 1, 'bot')
2018-12-26 11:11:13 [WARNING ] (13, 1, 'bot')
2018-12-26 11:11:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:11:13 [DEBUG   ] Finished updating board flags in 1.399 seconds
2018-12-26 11:11:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 11:11:35 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-26 11:11:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 11:12:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:12:14 [WARNING ] (13, 1, 'bot')
2018-12-26 11:12:14 [WARNING ] (13, 1, 'bot')
2018-12-26 11:12:14 [WARNING ] (13, 1, 'bot')
2018-12-26 11:12:14 [WARNING ] (13, 1, 'bot')
2018-12-26 11:12:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:12:14 [DEBUG   ] Finished updating board flags in 2.249 seconds
2018-12-26 11:12:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 11:12:35 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-26 11:12:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-26 11:13:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:13:14 [WARNING ] (13, 1, 'bot')
2018-12-26 11:13:14 [WARNING ] (13, 1, 'bot')
2018-12-26 11:13:14 [WARNING ] (13, 1, 'bot')
2018-12-26 11:13:14 [WARNING ] (13, 1, 'bot')
2018-12-26 11:13:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:13:14 [DEBUG   ] Finished updating board flags in 2.157 seconds
2018-12-26 11:13:15 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-26 11:13:35 [DEBUG   ] Finished updating ant stats in 0.743 seconds
2018-12-26 11:13:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 11:14:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:14:14 [WARNING ] (13, 1, 'bot')
2018-12-26 11:14:14 [WARNING ] (13, 1, 'bot')
2018-12-26 11:14:14 [WARNING ] (13, 1, 'bot')
2018-12-26 11:14:14 [WARNING ] (13, 1, 'bot')
2018-12-26 11:14:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:14:14 [DEBUG   ] Finished updating board flags in 1.992 seconds
2018-12-26 11:14:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 11:14:35 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-26 11:14:36 [DEBUG   ] Got command RPT from MCS: ref #957291
2018-12-26 11:14:36 [DEBUG   ] summary = ERROR
2018-12-26 11:14:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957291  13 58478 40476685 A  ERRORERROR'
2018-12-26 11:14:36 [DEBUG   ] Got command RPT from MCS: ref #957292
2018-12-26 11:14:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 11:14:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957292  77 58478 40476889 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 11:14:37 [DEBUG   ] Got command RPT from MCS: ref #957293
2018-12-26 11:14:37 [DEBUG   ] summary = ERROR
2018-12-26 11:14:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957293  13 58478 40477093 A  ERRORERROR'
2018-12-26 11:14:37 [DEBUG   ] Got command RPT from MCS: ref #957295
2018-12-26 11:14:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 11:14:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957295  77 58478 40477285 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 11:14:37 [DEBUG   ] Got command RPT from MCS: ref #957296
2018-12-26 11:14:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 11:14:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957296  12 58478 40477489 A  ERRORB–™š'
2018-12-26 11:14:56 [DEBUG   ] Finished updating ant stats in 1.390 seconds
2018-12-26 11:15:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:15:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-26 11:15:14 [WARNING ] (13, 1, 'bot')
2018-12-26 11:15:14 [WARNING ] (13, 1, 'bot')
2018-12-26 11:15:14 [WARNING ] (13, 1, 'bot')
2018-12-26 11:15:14 [WARNING ] (13, 1, 'bot')
2018-12-26 11:15:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:15:14 [DEBUG   ] Finished updating board flags in 1.791 seconds
2018-12-26 11:15:16 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-26 11:15:36 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-26 11:15:56 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 11:15:58 [DEBUG   ] Got command RPT from MCS: ref #957301
2018-12-26 11:15:58 [DEBUG   ] summary = ERROR
2018-12-26 11:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957301  13 58478 40558653 A  ERRORERROR'
2018-12-26 11:15:58 [DEBUG   ] Got command RPT from MCS: ref #957302
2018-12-26 11:15:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 11:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957302  77 58478 40558654 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 11:16:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:16:14 [WARNING ] (13, 1, 'bot')
2018-12-26 11:16:14 [WARNING ] (13, 1, 'bot')
2018-12-26 11:16:14 [WARNING ] (13, 1, 'bot')
2018-12-26 11:16:14 [WARNING ] (13, 1, 'bot')
2018-12-26 11:16:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:16:14 [DEBUG   ] Finished updating board flags in 1.602 seconds
2018-12-26 11:16:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 11:16:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 11:16:56 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-26 11:17:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:17:14 [WARNING ] (13, 1, 'bot')
2018-12-26 11:17:14 [WARNING ] (13, 1, 'bot')
2018-12-26 11:17:14 [WARNING ] (13, 1, 'bot')
2018-12-26 11:17:14 [WARNING ] (13, 1, 'bot')
2018-12-26 11:17:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:17:14 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-12-26 11:17:16 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 11:17:36 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 11:17:56 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-26 11:18:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:18:14 [WARNING ] (13, 1, 'bot')
2018-12-26 11:18:14 [WARNING ] (13, 1, 'bot')
2018-12-26 11:18:14 [WARNING ] (13, 1, 'bot')
2018-12-26 11:18:14 [WARNING ] (13, 1, 'bot')
2018-12-26 11:18:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:18:14 [DEBUG   ] Finished updating board flags in 1.699 seconds
2018-12-26 11:18:16 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-26 11:18:36 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 11:18:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 11:19:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:19:14 [WARNING ] (13, 1, 'bot')
2018-12-26 11:19:14 [WARNING ] (13, 1, 'bot')
2018-12-26 11:19:14 [WARNING ] (13, 1, 'bot')
2018-12-26 11:19:14 [WARNING ] (13, 1, 'bot')
2018-12-26 11:19:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:19:14 [DEBUG   ] Finished updating board flags in 1.492 seconds
2018-12-26 11:19:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 11:19:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 11:19:36 [DEBUG   ] Got command RPT from MCS: ref #957326
2018-12-26 11:19:36 [DEBUG   ] summary = ERROR
2018-12-26 11:19:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957326  13 58478 40776769 A  ERRORERROR'
2018-12-26 11:19:36 [DEBUG   ] Got command RPT from MCS: ref #957327
2018-12-26 11:19:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 11:19:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957327  77 58478 40776973 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 11:19:37 [DEBUG   ] Got command RPT from MCS: ref #957328
2018-12-26 11:19:37 [DEBUG   ] summary = ERROR
2018-12-26 11:19:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957328  13 58478 40777165 A  ERRORERROR'
2018-12-26 11:19:37 [DEBUG   ] Got command RPT from MCS: ref #957329
2018-12-26 11:19:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 11:19:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957329  77 58478 40777369 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 11:19:37 [DEBUG   ] Got command RPT from MCS: ref #957330
2018-12-26 11:19:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 11:19:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957330  12 58478 40777573 A  ERRORB˜™š'
2018-12-26 11:19:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 11:20:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:20:14 [WARNING ] (13, 1, 'bot')
2018-12-26 11:20:14 [WARNING ] (13, 1, 'bot')
2018-12-26 11:20:14 [WARNING ] (13, 1, 'bot')
2018-12-26 11:20:14 [WARNING ] (13, 1, 'bot')
2018-12-26 11:20:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:20:14 [DEBUG   ] Finished updating board flags in 1.443 seconds
2018-12-26 11:20:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 11:20:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 11:20:56 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-26 11:20:58 [DEBUG   ] Got command RPT from MCS: ref #957331
2018-12-26 11:20:58 [DEBUG   ] summary = ERROR
2018-12-26 11:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957331  13 58478 40858661 A  ERRORERROR'
2018-12-26 11:20:58 [DEBUG   ] Got command RPT from MCS: ref #957332
2018-12-26 11:20:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 11:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957332  77 58478 40858662 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 11:21:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:21:14 [WARNING ] (13, 1, 'bot')
2018-12-26 11:21:14 [WARNING ] (13, 1, 'bot')
2018-12-26 11:21:14 [WARNING ] (13, 1, 'bot')
2018-12-26 11:21:14 [WARNING ] (13, 1, 'bot')
2018-12-26 11:21:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:21:14 [DEBUG   ] Finished updating board flags in 1.472 seconds
2018-12-26 11:21:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 11:21:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 11:21:56 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-26 11:22:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:22:14 [WARNING ] (13, 1, 'bot')
2018-12-26 11:22:14 [WARNING ] (13, 1, 'bot')
2018-12-26 11:22:14 [WARNING ] (13, 1, 'bot')
2018-12-26 11:22:14 [WARNING ] (13, 1, 'bot')
2018-12-26 11:22:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:22:14 [DEBUG   ] Finished updating board flags in 1.494 seconds
2018-12-26 11:22:16 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-26 11:22:36 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 11:22:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 11:23:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:23:14 [WARNING ] (13, 1, 'bot')
2018-12-26 11:23:14 [WARNING ] (13, 1, 'bot')
2018-12-26 11:23:14 [WARNING ] (13, 1, 'bot')
2018-12-26 11:23:14 [WARNING ] (13, 1, 'bot')
2018-12-26 11:23:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:23:14 [DEBUG   ] Finished updating board flags in 1.490 seconds
2018-12-26 11:23:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 11:23:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 11:23:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 11:24:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:24:15 [WARNING ] (13, 1, 'bot')
2018-12-26 11:24:15 [WARNING ] (13, 1, 'bot')
2018-12-26 11:24:15 [WARNING ] (13, 1, 'bot')
2018-12-26 11:24:15 [WARNING ] (13, 1, 'bot')
2018-12-26 11:24:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:24:15 [DEBUG   ] Finished updating board flags in 2.228 seconds
2018-12-26 11:24:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 11:24:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 11:24:36 [DEBUG   ] Got command RPT from MCS: ref #957354
2018-12-26 11:24:36 [DEBUG   ] summary = ERROR
2018-12-26 11:24:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957354  13 58478 41076845 A  ERRORERROR'
2018-12-26 11:24:37 [DEBUG   ] Got command RPT from MCS: ref #957355
2018-12-26 11:24:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 11:24:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957355  77 58478 41077049 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 11:24:37 [DEBUG   ] Got command RPT from MCS: ref #957356
2018-12-26 11:24:37 [DEBUG   ] summary = ERROR
2018-12-26 11:24:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957356  13 58478 41077253 A  ERRORERROR'
2018-12-26 11:24:37 [DEBUG   ] Got command RPT from MCS: ref #957358
2018-12-26 11:24:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 11:24:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957358  77 58478 41077445 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 11:24:37 [DEBUG   ] Got command RPT from MCS: ref #957359
2018-12-26 11:24:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 11:24:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957359  12 58478 41077649 A  ERRORB—™š'
2018-12-26 11:24:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 11:25:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:25:15 [WARNING ] (13, 1, 'bot')
2018-12-26 11:25:15 [WARNING ] (13, 1, 'bot')
2018-12-26 11:25:15 [WARNING ] (13, 1, 'bot')
2018-12-26 11:25:15 [WARNING ] (13, 1, 'bot')
2018-12-26 11:25:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:25:15 [DEBUG   ] Finished updating board flags in 2.156 seconds
2018-12-26 11:25:16 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-26 11:25:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 11:25:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 11:25:58 [DEBUG   ] Got command RPT from MCS: ref #957368
2018-12-26 11:25:58 [DEBUG   ] summary = ERROR
2018-12-26 11:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957368  13 58478 41158657 A  ERRORERROR'
2018-12-26 11:25:58 [DEBUG   ] Got command RPT from MCS: ref #957369
2018-12-26 11:25:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 11:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957369  77 58478 41158658 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 11:26:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:26:15 [WARNING ] (13, 1, 'bot')
2018-12-26 11:26:15 [WARNING ] (13, 1, 'bot')
2018-12-26 11:26:15 [WARNING ] (13, 1, 'bot')
2018-12-26 11:26:15 [WARNING ] (13, 1, 'bot')
2018-12-26 11:26:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:26:15 [DEBUG   ] Finished updating board flags in 1.949 seconds
2018-12-26 11:26:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 11:26:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 11:26:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 11:27:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:27:15 [WARNING ] (13, 1, 'bot')
2018-12-26 11:27:15 [WARNING ] (13, 1, 'bot')
2018-12-26 11:27:15 [WARNING ] (13, 1, 'bot')
2018-12-26 11:27:15 [WARNING ] (13, 1, 'bot')
2018-12-26 11:27:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:27:15 [DEBUG   ] Finished updating board flags in 1.793 seconds
2018-12-26 11:27:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 11:27:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 11:27:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 11:28:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 11:28:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:28:15 [WARNING ] (13, 1, 'bot')
2018-12-26 11:28:15 [WARNING ] (13, 1, 'bot')
2018-12-26 11:28:15 [WARNING ] (13, 1, 'bot')
2018-12-26 11:28:15 [WARNING ] (13, 1, 'bot')
2018-12-26 11:28:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:28:15 [DEBUG   ] Finished updating board flags in 1.600 seconds
2018-12-26 11:28:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 11:28:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 11:28:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 11:29:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:29:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 11:29:15 [WARNING ] (13, 1, 'bot')
2018-12-26 11:29:15 [WARNING ] (13, 1, 'bot')
2018-12-26 11:29:15 [WARNING ] (13, 1, 'bot')
2018-12-26 11:29:15 [WARNING ] (13, 1, 'bot')
2018-12-26 11:29:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:29:15 [DEBUG   ] Finished updating board flags in 1.602 seconds
2018-12-26 11:29:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 11:29:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 11:29:36 [DEBUG   ] Got command RPT from MCS: ref #957389
2018-12-26 11:29:36 [DEBUG   ] summary = ERROR
2018-12-26 11:29:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957389  13 58478 41376929 A  ERRORERROR'
2018-12-26 11:29:37 [DEBUG   ] Got command RPT from MCS: ref #957390
2018-12-26 11:29:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 11:29:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957390  77 58478 41377133 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 11:29:37 [DEBUG   ] Got command RPT from MCS: ref #957391
2018-12-26 11:29:37 [DEBUG   ] summary = ERROR
2018-12-26 11:29:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957391  13 58478 41377325 A  ERRORERROR'
2018-12-26 11:29:37 [DEBUG   ] Got command RPT from MCS: ref #957392
2018-12-26 11:29:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 11:29:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957392  77 58478 41377529 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 11:29:37 [DEBUG   ] Got command RPT from MCS: ref #957393
2018-12-26 11:29:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 11:29:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957393  12 58478 41377733 A  ERRORB—™š'
2018-12-26 11:29:56 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-26 11:30:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:30:15 [WARNING ] (13, 1, 'bot')
2018-12-26 11:30:15 [WARNING ] (13, 1, 'bot')
2018-12-26 11:30:15 [WARNING ] (13, 1, 'bot')
2018-12-26 11:30:15 [WARNING ] (13, 1, 'bot')
2018-12-26 11:30:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:30:15 [DEBUG   ] Finished updating board flags in 1.639 seconds
2018-12-26 11:30:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 11:30:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 11:30:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 11:30:58 [DEBUG   ] Got command RPT from MCS: ref #957394
2018-12-26 11:30:58 [DEBUG   ] summary = ERROR
2018-12-26 11:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957394  13 58478 41458657 A  ERRORERROR'
2018-12-26 11:30:58 [DEBUG   ] Got command RPT from MCS: ref #957395
2018-12-26 11:30:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 11:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957395  77 58478 41458658 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 11:31:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:31:15 [WARNING ] (13, 1, 'bot')
2018-12-26 11:31:15 [WARNING ] (13, 1, 'bot')
2018-12-26 11:31:15 [WARNING ] (13, 1, 'bot')
2018-12-26 11:31:15 [WARNING ] (13, 1, 'bot')
2018-12-26 11:31:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:31:15 [DEBUG   ] Finished updating board flags in 1.646 seconds
2018-12-26 11:31:16 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-26 11:31:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 11:31:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 11:32:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:32:15 [WARNING ] (13, 1, 'bot')
2018-12-26 11:32:15 [WARNING ] (13, 1, 'bot')
2018-12-26 11:32:15 [WARNING ] (13, 1, 'bot')
2018-12-26 11:32:15 [WARNING ] (13, 1, 'bot')
2018-12-26 11:32:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:32:15 [DEBUG   ] Finished updating board flags in 1.520 seconds
2018-12-26 11:32:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 11:32:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 11:32:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 11:33:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:33:15 [WARNING ] (13, 1, 'bot')
2018-12-26 11:33:15 [WARNING ] (13, 1, 'bot')
2018-12-26 11:33:15 [WARNING ] (13, 1, 'bot')
2018-12-26 11:33:15 [WARNING ] (13, 1, 'bot')
2018-12-26 11:33:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:33:15 [DEBUG   ] Finished updating board flags in 1.501 seconds
2018-12-26 11:33:16 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 11:33:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 11:33:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 11:34:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:34:15 [WARNING ] (13, 1, 'bot')
2018-12-26 11:34:15 [WARNING ] (13, 1, 'bot')
2018-12-26 11:34:15 [WARNING ] (13, 1, 'bot')
2018-12-26 11:34:15 [WARNING ] (13, 1, 'bot')
2018-12-26 11:34:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:34:15 [DEBUG   ] Finished updating board flags in 1.539 seconds
2018-12-26 11:34:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 11:34:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 11:34:37 [DEBUG   ] Got command RPT from MCS: ref #957421
2018-12-26 11:34:37 [DEBUG   ] summary = ERROR
2018-12-26 11:34:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957421  13 58478 41677013 A  ERRORERROR'
2018-12-26 11:34:37 [DEBUG   ] Got command RPT from MCS: ref #957422
2018-12-26 11:34:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 11:34:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957422  77 58478 41677205 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 11:34:37 [DEBUG   ] Got command RPT from MCS: ref #957423
2018-12-26 11:34:37 [DEBUG   ] summary = ERROR
2018-12-26 11:34:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957423  13 58478 41677409 A  ERRORERROR'
2018-12-26 11:34:37 [DEBUG   ] Got command RPT from MCS: ref #957425
2018-12-26 11:34:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 11:34:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957425  77 58478 41677613 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 11:34:37 [DEBUG   ] Got command RPT from MCS: ref #957426
2018-12-26 11:34:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 11:34:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957426  12 58478 41677817 A  ERRORB—™š'
2018-12-26 11:34:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 11:35:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:35:16 [DEBUG   ] Finished updating ant stats in 0.637 seconds
2018-12-26 11:35:16 [WARNING ] (13, 1, 'bot')
2018-12-26 11:35:16 [WARNING ] (13, 1, 'bot')
2018-12-26 11:35:16 [WARNING ] (13, 1, 'bot')
2018-12-26 11:35:16 [WARNING ] (13, 1, 'bot')
2018-12-26 11:35:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:35:16 [DEBUG   ] Finished updating board flags in 2.229 seconds
2018-12-26 11:35:36 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2018-12-26 11:35:57 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-26 11:35:58 [DEBUG   ] Got command RPT from MCS: ref #957431
2018-12-26 11:35:58 [DEBUG   ] summary = ERROR
2018-12-26 11:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957431  13 58478 41758661 A  ERRORERROR'
2018-12-26 11:35:58 [DEBUG   ] Got command RPT from MCS: ref #957432
2018-12-26 11:35:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 11:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957432  77 58478 41758662 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 11:36:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:36:16 [WARNING ] (13, 1, 'bot')
2018-12-26 11:36:16 [WARNING ] (13, 1, 'bot')
2018-12-26 11:36:16 [WARNING ] (13, 1, 'bot')
2018-12-26 11:36:16 [WARNING ] (13, 1, 'bot')
2018-12-26 11:36:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:36:16 [DEBUG   ] Finished updating board flags in 2.186 seconds
2018-12-26 11:36:17 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-26 11:36:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 11:36:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 11:37:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:37:16 [WARNING ] (13, 1, 'bot')
2018-12-26 11:37:16 [WARNING ] (13, 1, 'bot')
2018-12-26 11:37:16 [WARNING ] (13, 1, 'bot')
2018-12-26 11:37:16 [WARNING ] (13, 1, 'bot')
2018-12-26 11:37:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:37:16 [DEBUG   ] Finished updating board flags in 1.989 seconds
2018-12-26 11:37:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 11:37:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 11:37:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 11:38:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:38:16 [WARNING ] (13, 1, 'bot')
2018-12-26 11:38:16 [WARNING ] (13, 1, 'bot')
2018-12-26 11:38:16 [WARNING ] (13, 1, 'bot')
2018-12-26 11:38:16 [WARNING ] (13, 1, 'bot')
2018-12-26 11:38:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:38:16 [DEBUG   ] Finished updating board flags in 1.827 seconds
2018-12-26 11:38:17 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 11:38:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 11:38:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 11:39:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:39:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-26 11:39:16 [WARNING ] (13, 1, 'bot')
2018-12-26 11:39:16 [WARNING ] (13, 1, 'bot')
2018-12-26 11:39:16 [WARNING ] (13, 1, 'bot')
2018-12-26 11:39:16 [WARNING ] (13, 1, 'bot')
2018-12-26 11:39:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:39:16 [DEBUG   ] Finished updating board flags in 1.869 seconds
2018-12-26 11:39:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 11:39:37 [DEBUG   ] Got command RPT from MCS: ref #957452
2018-12-26 11:39:37 [DEBUG   ] summary = ERROR
2018-12-26 11:39:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957452  13 58478 41977089 A  ERRORERROR'
2018-12-26 11:39:37 [DEBUG   ] Got command RPT from MCS: ref #957453
2018-12-26 11:39:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 11:39:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957453  77 58478 41977293 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 11:39:37 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 11:39:37 [DEBUG   ] Got command RPT from MCS: ref #957454
2018-12-26 11:39:37 [DEBUG   ] summary = ERROR
2018-12-26 11:39:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957454  13 58478 41977489 A  ERRORERROR'
2018-12-26 11:39:37 [DEBUG   ] Got command RPT from MCS: ref #957455
2018-12-26 11:39:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 11:39:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957455  77 58478 41977693 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 11:39:37 [DEBUG   ] Got command RPT from MCS: ref #957456
2018-12-26 11:39:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 11:39:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957456  12 58478 41977897 A  ERRORB–™š'
2018-12-26 11:39:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 11:40:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:40:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 11:40:17 [WARNING ] (13, 1, 'bot')
2018-12-26 11:40:17 [WARNING ] (13, 1, 'bot')
2018-12-26 11:40:17 [WARNING ] (13, 1, 'bot')
2018-12-26 11:40:17 [WARNING ] (13, 1, 'bot')
2018-12-26 11:40:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:40:17 [DEBUG   ] Finished updating board flags in 2.907 seconds
2018-12-26 11:40:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 11:40:57 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 11:40:58 [DEBUG   ] Got command RPT from MCS: ref #957461
2018-12-26 11:40:58 [DEBUG   ] summary = ERROR
2018-12-26 11:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957461  13 58478 42058657 A  ERRORERROR'
2018-12-26 11:40:58 [DEBUG   ] Got command RPT from MCS: ref #957462
2018-12-26 11:40:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 11:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957462  77 58478 42058658 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 11:41:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:41:16 [WARNING ] (13, 1, 'bot')
2018-12-26 11:41:16 [WARNING ] (13, 1, 'bot')
2018-12-26 11:41:16 [WARNING ] (13, 1, 'bot')
2018-12-26 11:41:16 [WARNING ] (13, 1, 'bot')
2018-12-26 11:41:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:41:16 [DEBUG   ] Finished updating board flags in 1.588 seconds
2018-12-26 11:41:17 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-26 11:41:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 11:41:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 11:42:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:42:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-12-26 11:42:16 [WARNING ] (13, 1, 'bot')
2018-12-26 11:42:16 [WARNING ] (13, 1, 'bot')
2018-12-26 11:42:16 [WARNING ] (13, 1, 'bot')
2018-12-26 11:42:16 [WARNING ] (13, 1, 'bot')
2018-12-26 11:42:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:42:16 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-12-26 11:42:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 11:42:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 11:42:57 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-26 11:43:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-26 11:43:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:43:16 [WARNING ] (13, 1, 'bot')
2018-12-26 11:43:16 [WARNING ] (13, 1, 'bot')
2018-12-26 11:43:16 [WARNING ] (13, 1, 'bot')
2018-12-26 11:43:16 [WARNING ] (13, 1, 'bot')
2018-12-26 11:43:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:43:16 [DEBUG   ] Finished updating board flags in 1.397 seconds
2018-12-26 11:43:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 11:43:37 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 11:43:57 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-26 11:44:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:44:17 [DEBUG   ] Finished updating ant stats in 0.845 seconds
2018-12-26 11:44:17 [WARNING ] (13, 1, 'bot')
2018-12-26 11:44:17 [WARNING ] (13, 1, 'bot')
2018-12-26 11:44:17 [WARNING ] (13, 1, 'bot')
2018-12-26 11:44:17 [WARNING ] (13, 1, 'bot')
2018-12-26 11:44:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:44:17 [DEBUG   ] Finished updating board flags in 2.238 seconds
2018-12-26 11:44:37 [DEBUG   ] Got command RPT from MCS: ref #957484
2018-12-26 11:44:37 [DEBUG   ] summary = ERROR
2018-12-26 11:44:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957484  13 58478 42277169 A  ERRORERROR'
2018-12-26 11:44:37 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2018-12-26 11:44:37 [DEBUG   ] Got command RPT from MCS: ref #957485
2018-12-26 11:44:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 11:44:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957485  77 58478 42277373 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 11:44:37 [DEBUG   ] Got command RPT from MCS: ref #957486
2018-12-26 11:44:37 [DEBUG   ] summary = ERROR
2018-12-26 11:44:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957486  13 58478 42277577 A  ERRORERROR'
2018-12-26 11:44:37 [DEBUG   ] Got command RPT from MCS: ref #957488
2018-12-26 11:44:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 11:44:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957488  77 58478 42277769 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 11:44:37 [DEBUG   ] Got command RPT from MCS: ref #957489
2018-12-26 11:44:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 11:44:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957489  12 58478 42277973 A  ERRORB˜™š'
2018-12-26 11:44:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 11:45:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:45:17 [DEBUG   ] Finished updating ant stats in 0.646 seconds
2018-12-26 11:45:17 [WARNING ] (13, 1, 'bot')
2018-12-26 11:45:17 [WARNING ] (13, 1, 'bot')
2018-12-26 11:45:17 [WARNING ] (13, 1, 'bot')
2018-12-26 11:45:17 [WARNING ] (13, 1, 'bot')
2018-12-26 11:45:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:45:17 [DEBUG   ] Finished updating board flags in 2.186 seconds
2018-12-26 11:45:37 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2018-12-26 11:45:58 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-26 11:45:58 [DEBUG   ] Got command RPT from MCS: ref #957494
2018-12-26 11:45:58 [DEBUG   ] summary = ERROR
2018-12-26 11:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957494  13 58478 42358661 A  ERRORERROR'
2018-12-26 11:45:58 [DEBUG   ] Got command RPT from MCS: ref #957495
2018-12-26 11:45:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 11:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957495  77 58478 42358662 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 11:46:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:46:17 [WARNING ] (13, 1, 'bot')
2018-12-26 11:46:17 [WARNING ] (13, 1, 'bot')
2018-12-26 11:46:17 [WARNING ] (13, 1, 'bot')
2018-12-26 11:46:17 [WARNING ] (13, 1, 'bot')
2018-12-26 11:46:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:46:17 [DEBUG   ] Finished updating board flags in 2.007 seconds
2018-12-26 11:46:18 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-26 11:46:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 11:46:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 11:47:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:47:17 [WARNING ] (13, 1, 'bot')
2018-12-26 11:47:17 [WARNING ] (13, 1, 'bot')
2018-12-26 11:47:17 [WARNING ] (13, 1, 'bot')
2018-12-26 11:47:17 [WARNING ] (13, 1, 'bot')
2018-12-26 11:47:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:47:17 [DEBUG   ] Finished updating board flags in 1.990 seconds
2018-12-26 11:47:18 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 11:47:38 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-26 11:47:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 11:48:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:48:18 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 11:48:18 [WARNING ] (13, 1, 'bot')
2018-12-26 11:48:18 [WARNING ] (13, 1, 'bot')
2018-12-26 11:48:18 [WARNING ] (13, 1, 'bot')
2018-12-26 11:48:18 [WARNING ] (13, 1, 'bot')
2018-12-26 11:48:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:48:18 [DEBUG   ] Finished updating board flags in 2.934 seconds
2018-12-26 11:48:38 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-26 11:48:58 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-26 11:49:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:49:17 [WARNING ] (13, 1, 'bot')
2018-12-26 11:49:17 [WARNING ] (13, 1, 'bot')
2018-12-26 11:49:17 [WARNING ] (13, 1, 'bot')
2018-12-26 11:49:17 [WARNING ] (13, 1, 'bot')
2018-12-26 11:49:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:49:17 [DEBUG   ] Finished updating board flags in 1.698 seconds
2018-12-26 11:49:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 11:49:37 [DEBUG   ] Got command RPT from MCS: ref #957519
2018-12-26 11:49:37 [DEBUG   ] summary = ERROR
2018-12-26 11:49:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957519  13 58478 42577253 A  ERRORERROR'
2018-12-26 11:49:37 [DEBUG   ] Got command RPT from MCS: ref #957520
2018-12-26 11:49:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 11:49:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957520  77 58478 42577457 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 11:49:37 [DEBUG   ] Got command RPT from MCS: ref #957521
2018-12-26 11:49:37 [DEBUG   ] summary = ERROR
2018-12-26 11:49:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957521  13 58478 42577649 A  ERRORERROR'
2018-12-26 11:49:37 [DEBUG   ] Got command RPT from MCS: ref #957522
2018-12-26 11:49:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 11:49:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957522  77 58478 42577853 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 11:49:38 [DEBUG   ] Got command RPT from MCS: ref #957523
2018-12-26 11:49:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 11:49:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957523  12 58478 42578057 A  ERRORB—™š'
2018-12-26 11:49:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 11:49:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 11:50:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:50:17 [WARNING ] (13, 1, 'bot')
2018-12-26 11:50:17 [WARNING ] (13, 1, 'bot')
2018-12-26 11:50:17 [WARNING ] (13, 1, 'bot')
2018-12-26 11:50:17 [WARNING ] (13, 1, 'bot')
2018-12-26 11:50:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:50:17 [DEBUG   ] Finished updating board flags in 1.584 seconds
2018-12-26 11:50:18 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-26 11:50:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 11:50:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 11:50:58 [DEBUG   ] Got command RPT from MCS: ref #957524
2018-12-26 11:50:58 [DEBUG   ] summary = ERROR
2018-12-26 11:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957524  13 58478 42658665 A  ERRORERROR'
2018-12-26 11:50:58 [DEBUG   ] Got command RPT from MCS: ref #957525
2018-12-26 11:50:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 11:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957525  77 58478 42658666 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 11:51:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:51:17 [WARNING ] (13, 1, 'bot')
2018-12-26 11:51:17 [WARNING ] (13, 1, 'bot')
2018-12-26 11:51:17 [WARNING ] (13, 1, 'bot')
2018-12-26 11:51:17 [WARNING ] (13, 1, 'bot')
2018-12-26 11:51:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:51:17 [DEBUG   ] Finished updating board flags in 1.370 seconds
2018-12-26 11:51:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 11:51:38 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-26 11:51:58 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 11:52:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:52:18 [WARNING ] (13, 1, 'bot')
2018-12-26 11:52:18 [WARNING ] (13, 1, 'bot')
2018-12-26 11:52:18 [WARNING ] (13, 1, 'bot')
2018-12-26 11:52:18 [WARNING ] (13, 1, 'bot')
2018-12-26 11:52:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:52:18 [DEBUG   ] Finished updating board flags in 2.246 seconds
2018-12-26 11:52:19 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-26 11:52:39 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-26 11:52:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 11:53:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:53:18 [WARNING ] (13, 1, 'bot')
2018-12-26 11:53:18 [WARNING ] (13, 1, 'bot')
2018-12-26 11:53:18 [WARNING ] (13, 1, 'bot')
2018-12-26 11:53:18 [WARNING ] (13, 1, 'bot')
2018-12-26 11:53:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:53:18 [DEBUG   ] Finished updating board flags in 2.179 seconds
2018-12-26 11:53:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 11:53:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 11:53:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 11:54:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:54:18 [WARNING ] (13, 1, 'bot')
2018-12-26 11:54:18 [WARNING ] (13, 1, 'bot')
2018-12-26 11:54:18 [WARNING ] (13, 1, 'bot')
2018-12-26 11:54:18 [WARNING ] (13, 1, 'bot')
2018-12-26 11:54:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:54:18 [DEBUG   ] Finished updating board flags in 2.060 seconds
2018-12-26 11:54:19 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-26 11:54:37 [DEBUG   ] Got command RPT from MCS: ref #957547
2018-12-26 11:54:37 [DEBUG   ] summary = ERROR
2018-12-26 11:54:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957547  13 58478 42877329 A  ERRORERROR'
2018-12-26 11:54:37 [DEBUG   ] Got command RPT from MCS: ref #957548
2018-12-26 11:54:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 11:54:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957548  77 58478 42877533 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 11:54:37 [DEBUG   ] Got command RPT from MCS: ref #957549
2018-12-26 11:54:37 [DEBUG   ] summary = ERROR
2018-12-26 11:54:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957549  13 58478 42877737 A  ERRORERROR'
2018-12-26 11:54:37 [DEBUG   ] Got command RPT from MCS: ref #957551
2018-12-26 11:54:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 11:54:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957551  77 58478 42877929 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 11:54:38 [DEBUG   ] Got command RPT from MCS: ref #957552
2018-12-26 11:54:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 11:54:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957552  12 58478 42878133 A  ERRORB–™š'
2018-12-26 11:54:39 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 11:54:59 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-26 11:55:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:55:18 [WARNING ] (13, 1, 'bot')
2018-12-26 11:55:18 [WARNING ] (13, 1, 'bot')
2018-12-26 11:55:18 [WARNING ] (13, 1, 'bot')
2018-12-26 11:55:18 [WARNING ] (13, 1, 'bot')
2018-12-26 11:55:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:55:18 [DEBUG   ] Finished updating board flags in 2.036 seconds
2018-12-26 11:55:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 11:55:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 11:55:58 [DEBUG   ] Got command RPT from MCS: ref #957561
2018-12-26 11:55:58 [DEBUG   ] summary = ERROR
2018-12-26 11:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957561  13 58478 42958661 A  ERRORERROR'
2018-12-26 11:55:58 [DEBUG   ] Got command RPT from MCS: ref #957562
2018-12-26 11:55:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 11:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957562  77 58478 42958662 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 11:55:59 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 11:56:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:56:18 [WARNING ] (13, 1, 'bot')
2018-12-26 11:56:18 [WARNING ] (13, 1, 'bot')
2018-12-26 11:56:18 [WARNING ] (13, 1, 'bot')
2018-12-26 11:56:18 [WARNING ] (13, 1, 'bot')
2018-12-26 11:56:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:56:18 [DEBUG   ] Finished updating board flags in 1.903 seconds
2018-12-26 11:56:19 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-26 11:56:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 11:56:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 11:57:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 11:57:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:57:18 [WARNING ] (13, 1, 'bot')
2018-12-26 11:57:18 [WARNING ] (13, 1, 'bot')
2018-12-26 11:57:18 [WARNING ] (13, 1, 'bot')
2018-12-26 11:57:18 [WARNING ] (13, 1, 'bot')
2018-12-26 11:57:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:57:18 [DEBUG   ] Finished updating board flags in 1.815 seconds
2018-12-26 11:57:19 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 11:57:39 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-26 11:57:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 11:58:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:58:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 11:58:18 [WARNING ] (13, 1, 'bot')
2018-12-26 11:58:18 [WARNING ] (13, 1, 'bot')
2018-12-26 11:58:18 [WARNING ] (13, 1, 'bot')
2018-12-26 11:58:18 [WARNING ] (13, 1, 'bot')
2018-12-26 11:58:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:58:18 [DEBUG   ] Finished updating board flags in 1.782 seconds
2018-12-26 11:58:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 11:58:39 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 11:58:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 11:59:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 11:59:18 [WARNING ] (13, 1, 'bot')
2018-12-26 11:59:18 [WARNING ] (13, 1, 'bot')
2018-12-26 11:59:18 [WARNING ] (13, 1, 'bot')
2018-12-26 11:59:18 [WARNING ] (13, 1, 'bot')
2018-12-26 11:59:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 11:59:18 [DEBUG   ] Finished updating board flags in 1.647 seconds
2018-12-26 11:59:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 11:59:37 [DEBUG   ] Got command RPT from MCS: ref #957582
2018-12-26 11:59:37 [DEBUG   ] summary = ERROR
2018-12-26 11:59:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957582  13 58478 43177405 A  ERRORERROR'
2018-12-26 11:59:37 [DEBUG   ] Got command RPT from MCS: ref #957583
2018-12-26 11:59:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 11:59:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957583  77 58478 43177609 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 11:59:37 [DEBUG   ] Got command RPT from MCS: ref #957584
2018-12-26 11:59:37 [DEBUG   ] summary = ERROR
2018-12-26 11:59:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957584  13 58478 43177813 A  ERRORERROR'
2018-12-26 11:59:38 [DEBUG   ] Got command RPT from MCS: ref #957585
2018-12-26 11:59:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 11:59:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957585  77 58478 43178017 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 11:59:38 [DEBUG   ] Got command RPT from MCS: ref #957586
2018-12-26 11:59:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 11:59:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957586  12 58478 43178209 A  ERRORB˜™š'
2018-12-26 11:59:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 11:59:59 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 12:00:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:00:18 [WARNING ] (13, 1, 'bot')
2018-12-26 12:00:18 [WARNING ] (13, 1, 'bot')
2018-12-26 12:00:18 [WARNING ] (13, 1, 'bot')
2018-12-26 12:00:18 [WARNING ] (13, 1, 'bot')
2018-12-26 12:00:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:00:18 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-12-26 12:00:19 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-26 12:00:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 12:00:58 [DEBUG   ] Got command RPT from MCS: ref #957587
2018-12-26 12:00:58 [DEBUG   ] summary = ERROR
2018-12-26 12:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957587  13 58478 43258661 A  ERRORERROR'
2018-12-26 12:00:58 [DEBUG   ] Got command RPT from MCS: ref #957588
2018-12-26 12:00:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 12:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957588  77 58478 43258662 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 12:00:59 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-26 12:01:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:01:18 [WARNING ] (13, 1, 'bot')
2018-12-26 12:01:18 [WARNING ] (13, 1, 'bot')
2018-12-26 12:01:18 [WARNING ] (13, 1, 'bot')
2018-12-26 12:01:18 [WARNING ] (13, 1, 'bot')
2018-12-26 12:01:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:01:18 [DEBUG   ] Finished updating board flags in 1.551 seconds
2018-12-26 12:01:20 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-26 12:01:40 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-26 12:02:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 12:02:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:02:18 [WARNING ] (13, 1, 'bot')
2018-12-26 12:02:18 [WARNING ] (13, 1, 'bot')
2018-12-26 12:02:18 [WARNING ] (13, 1, 'bot')
2018-12-26 12:02:18 [WARNING ] (13, 1, 'bot')
2018-12-26 12:02:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:02:18 [DEBUG   ] Finished updating board flags in 1.420 seconds
2018-12-26 12:02:20 [DEBUG   ] Finished updating ant stats in 1.060 seconds
2018-12-26 12:02:40 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-26 12:03:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 12:03:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:03:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 12:03:18 [WARNING ] (13, 1, 'bot')
2018-12-26 12:03:18 [WARNING ] (13, 1, 'bot')
2018-12-26 12:03:18 [WARNING ] (13, 1, 'bot')
2018-12-26 12:03:18 [WARNING ] (13, 1, 'bot')
2018-12-26 12:03:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:03:18 [DEBUG   ] Finished updating board flags in 1.427 seconds
2018-12-26 12:03:20 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 12:03:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 12:04:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 12:04:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:04:18 [WARNING ] (13, 1, 'bot')
2018-12-26 12:04:18 [WARNING ] (13, 1, 'bot')
2018-12-26 12:04:18 [WARNING ] (13, 1, 'bot')
2018-12-26 12:04:18 [WARNING ] (13, 1, 'bot')
2018-12-26 12:04:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:04:18 [DEBUG   ] Finished updating board flags in 1.432 seconds
2018-12-26 12:04:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 12:04:37 [DEBUG   ] Got command RPT from MCS: ref #957614
2018-12-26 12:04:37 [DEBUG   ] summary = ERROR
2018-12-26 12:04:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957614  13 58478 43477485 A  ERRORERROR'
2018-12-26 12:04:37 [DEBUG   ] Got command RPT from MCS: ref #957615
2018-12-26 12:04:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 12:04:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957615  77 58478 43477689 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 12:04:37 [DEBUG   ] Got command RPT from MCS: ref #957616
2018-12-26 12:04:37 [DEBUG   ] summary = ERROR
2018-12-26 12:04:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957616  13 58478 43477893 A  ERRORERROR'
2018-12-26 12:04:38 [DEBUG   ] Got command RPT from MCS: ref #957618
2018-12-26 12:04:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 12:04:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957618  77 58478 43478097 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 12:04:38 [DEBUG   ] Got command RPT from MCS: ref #957619
2018-12-26 12:04:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 12:04:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957619  12 58478 43478289 A  ERRORB—™š'
2018-12-26 12:04:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 12:05:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 12:05:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:05:18 [WARNING ] (13, 1, 'bot')
2018-12-26 12:05:18 [WARNING ] (13, 1, 'bot')
2018-12-26 12:05:18 [WARNING ] (13, 1, 'bot')
2018-12-26 12:05:18 [WARNING ] (13, 1, 'bot')
2018-12-26 12:05:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:05:18 [DEBUG   ] Finished updating board flags in 1.430 seconds
2018-12-26 12:05:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 12:05:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 12:05:58 [DEBUG   ] Got command RPT from MCS: ref #957624
2018-12-26 12:05:58 [DEBUG   ] summary = ERROR
2018-12-26 12:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957624  13 58478 43558669 A  ERRORERROR'
2018-12-26 12:05:58 [DEBUG   ] Got command RPT from MCS: ref #957625
2018-12-26 12:05:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 12:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957625  77 58478 43558670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 12:06:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 12:06:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:06:18 [WARNING ] (13, 1, 'bot')
2018-12-26 12:06:18 [WARNING ] (13, 1, 'bot')
2018-12-26 12:06:18 [WARNING ] (13, 1, 'bot')
2018-12-26 12:06:18 [WARNING ] (13, 1, 'bot')
2018-12-26 12:06:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:06:18 [DEBUG   ] Finished updating board flags in 1.558 seconds
2018-12-26 12:06:20 [DEBUG   ] Finished updating ant stats in 0.783 seconds
2018-12-26 12:06:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 12:07:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 12:07:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:07:19 [WARNING ] (13, 1, 'bot')
2018-12-26 12:07:19 [WARNING ] (13, 1, 'bot')
2018-12-26 12:07:19 [WARNING ] (13, 1, 'bot')
2018-12-26 12:07:19 [WARNING ] (13, 1, 'bot')
2018-12-26 12:07:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:07:19 [DEBUG   ] Finished updating board flags in 2.200 seconds
2018-12-26 12:07:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 12:07:40 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 12:08:00 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-26 12:08:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:08:19 [WARNING ] (13, 1, 'bot')
2018-12-26 12:08:19 [WARNING ] (13, 1, 'bot')
2018-12-26 12:08:19 [WARNING ] (13, 1, 'bot')
2018-12-26 12:08:19 [WARNING ] (13, 1, 'bot')
2018-12-26 12:08:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:08:19 [DEBUG   ] Finished updating board flags in 2.138 seconds
2018-12-26 12:08:20 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-12-26 12:08:40 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 12:09:01 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-26 12:09:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:09:19 [WARNING ] (13, 1, 'bot')
2018-12-26 12:09:19 [WARNING ] (13, 1, 'bot')
2018-12-26 12:09:19 [WARNING ] (13, 1, 'bot')
2018-12-26 12:09:19 [WARNING ] (13, 1, 'bot')
2018-12-26 12:09:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:09:19 [DEBUG   ] Finished updating board flags in 1.991 seconds
2018-12-26 12:09:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 12:09:37 [DEBUG   ] Got command RPT from MCS: ref #957645
2018-12-26 12:09:37 [DEBUG   ] summary = ERROR
2018-12-26 12:09:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957645  13 58478 43777569 A  ERRORERROR'
2018-12-26 12:09:37 [DEBUG   ] Got command RPT from MCS: ref #957646
2018-12-26 12:09:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 12:09:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957646  77 58478 43777773 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 12:09:37 [DEBUG   ] Got command RPT from MCS: ref #957647
2018-12-26 12:09:37 [DEBUG   ] summary = ERROR
2018-12-26 12:09:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957647  13 58478 43777977 A  ERRORERROR'
2018-12-26 12:09:38 [DEBUG   ] Got command RPT from MCS: ref #957648
2018-12-26 12:09:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 12:09:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957648  77 58478 43778169 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 12:09:38 [DEBUG   ] Got command RPT from MCS: ref #957649
2018-12-26 12:09:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 12:09:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957649  12 58478 43778373 A  ERRORB–™š'
2018-12-26 12:09:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 12:10:01 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-26 12:10:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:10:19 [WARNING ] (13, 1, 'bot')
2018-12-26 12:10:19 [WARNING ] (13, 1, 'bot')
2018-12-26 12:10:19 [WARNING ] (13, 1, 'bot')
2018-12-26 12:10:19 [WARNING ] (13, 1, 'bot')
2018-12-26 12:10:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:10:19 [DEBUG   ] Finished updating board flags in 1.793 seconds
2018-12-26 12:10:21 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-26 12:10:42 [DEBUG   ] Finished updating ant stats in 2.003 seconds
2018-12-26 12:10:58 [DEBUG   ] Got command RPT from MCS: ref #957654
2018-12-26 12:10:58 [DEBUG   ] summary = ERROR
2018-12-26 12:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957654  13 58478 43858665 A  ERRORERROR'
2018-12-26 12:10:58 [DEBUG   ] Got command RPT from MCS: ref #957655
2018-12-26 12:10:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 12:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957655  77 58478 43858666 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 12:11:01 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-12-26 12:11:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:11:19 [WARNING ] (13, 1, 'bot')
2018-12-26 12:11:19 [WARNING ] (13, 1, 'bot')
2018-12-26 12:11:19 [WARNING ] (13, 1, 'bot')
2018-12-26 12:11:19 [WARNING ] (13, 1, 'bot')
2018-12-26 12:11:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:11:19 [DEBUG   ] Finished updating board flags in 1.604 seconds
2018-12-26 12:11:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-26 12:11:41 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-26 12:12:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 12:12:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:12:19 [WARNING ] (13, 1, 'bot')
2018-12-26 12:12:19 [WARNING ] (13, 1, 'bot')
2018-12-26 12:12:19 [WARNING ] (13, 1, 'bot')
2018-12-26 12:12:19 [WARNING ] (13, 1, 'bot')
2018-12-26 12:12:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:12:19 [DEBUG   ] Finished updating board flags in 1.593 seconds
2018-12-26 12:12:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 12:12:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 12:13:01 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-12-26 12:13:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 12:13:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:13:19 [WARNING ] (13, 1, 'bot')
2018-12-26 12:13:19 [WARNING ] (13, 1, 'bot')
2018-12-26 12:13:19 [WARNING ] (13, 1, 'bot')
2018-12-26 12:13:19 [WARNING ] (13, 1, 'bot')
2018-12-26 12:13:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:13:19 [DEBUG   ] Finished updating board flags in 1.452 seconds
2018-12-26 12:13:21 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-26 12:13:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 12:14:01 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-12-26 12:14:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:14:19 [WARNING ] (13, 1, 'bot')
2018-12-26 12:14:19 [WARNING ] (13, 1, 'bot')
2018-12-26 12:14:19 [WARNING ] (13, 1, 'bot')
2018-12-26 12:14:19 [WARNING ] (13, 1, 'bot')
2018-12-26 12:14:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:14:19 [DEBUG   ] Finished updating board flags in 1.432 seconds
2018-12-26 12:14:21 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-26 12:14:37 [DEBUG   ] Got command RPT from MCS: ref #957677
2018-12-26 12:14:37 [DEBUG   ] summary = ERROR
2018-12-26 12:14:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957677  13 58478 44077645 A  ERRORERROR'
2018-12-26 12:14:37 [DEBUG   ] Got command RPT from MCS: ref #957678
2018-12-26 12:14:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 12:14:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957678  77 58478 44077849 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 12:14:38 [DEBUG   ] Got command RPT from MCS: ref #957679
2018-12-26 12:14:38 [DEBUG   ] summary = ERROR
2018-12-26 12:14:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957679  13 58478 44078053 A  ERRORERROR'
2018-12-26 12:14:38 [DEBUG   ] Got command RPT from MCS: ref #957681
2018-12-26 12:14:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 12:14:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957681  77 58478 44078257 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 12:14:38 [DEBUG   ] Got command RPT from MCS: ref #957682
2018-12-26 12:14:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 12:14:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957682  12 58478 44078449 A  ERRORB˜™š'
2018-12-26 12:14:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 12:15:02 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-26 12:15:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:15:19 [WARNING ] (13, 1, 'bot')
2018-12-26 12:15:19 [WARNING ] (13, 1, 'bot')
2018-12-26 12:15:19 [WARNING ] (13, 1, 'bot')
2018-12-26 12:15:19 [WARNING ] (13, 1, 'bot')
2018-12-26 12:15:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:15:19 [DEBUG   ] Finished updating board flags in 1.432 seconds
2018-12-26 12:15:22 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-26 12:15:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 12:15:58 [DEBUG   ] Got command RPT from MCS: ref #957687
2018-12-26 12:15:58 [DEBUG   ] summary = ERROR
2018-12-26 12:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957687  13 58478 44158673 A  ERRORERROR'
2018-12-26 12:15:58 [DEBUG   ] Got command RPT from MCS: ref #957688
2018-12-26 12:15:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 12:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957688  77 58478 44158674 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 12:16:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 12:16:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:16:19 [WARNING ] (13, 1, 'bot')
2018-12-26 12:16:19 [WARNING ] (13, 1, 'bot')
2018-12-26 12:16:19 [WARNING ] (13, 1, 'bot')
2018-12-26 12:16:19 [WARNING ] (13, 1, 'bot')
2018-12-26 12:16:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:16:19 [DEBUG   ] Finished updating board flags in 1.432 seconds
2018-12-26 12:16:22 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 12:16:42 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-26 12:17:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 12:17:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:17:19 [WARNING ] (13, 1, 'bot')
2018-12-26 12:17:19 [WARNING ] (13, 1, 'bot')
2018-12-26 12:17:19 [WARNING ] (13, 1, 'bot')
2018-12-26 12:17:19 [WARNING ] (13, 1, 'bot')
2018-12-26 12:17:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:17:19 [DEBUG   ] Finished updating board flags in 1.433 seconds
2018-12-26 12:17:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 12:17:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 12:18:02 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-26 12:18:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:18:19 [WARNING ] (13, 1, 'bot')
2018-12-26 12:18:19 [WARNING ] (13, 1, 'bot')
2018-12-26 12:18:19 [WARNING ] (13, 1, 'bot')
2018-12-26 12:18:19 [WARNING ] (13, 1, 'bot')
2018-12-26 12:18:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:18:19 [DEBUG   ] Finished updating board flags in 1.507 seconds
2018-12-26 12:18:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 12:18:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 12:19:02 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 12:19:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:19:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:19:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:19:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:19:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:19:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:19:20 [DEBUG   ] Finished updating board flags in 2.211 seconds
2018-12-26 12:19:22 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-26 12:19:37 [DEBUG   ] Got command RPT from MCS: ref #957712
2018-12-26 12:19:37 [DEBUG   ] summary = ERROR
2018-12-26 12:19:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957712  13 58478 44377737 A  ERRORERROR'
2018-12-26 12:19:37 [DEBUG   ] Got command RPT from MCS: ref #957713
2018-12-26 12:19:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 12:19:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957713  77 58478 44377929 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 12:19:38 [DEBUG   ] Got command RPT from MCS: ref #957714
2018-12-26 12:19:38 [DEBUG   ] summary = ERROR
2018-12-26 12:19:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957714  13 58478 44378133 A  ERRORERROR'
2018-12-26 12:19:38 [DEBUG   ] Got command RPT from MCS: ref #957715
2018-12-26 12:19:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 12:19:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957715  77 58478 44378337 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 12:19:38 [DEBUG   ] Got command RPT from MCS: ref #957716
2018-12-26 12:19:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 12:19:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957716  12 58478 44378529 A  ERRORB–™š'
2018-12-26 12:19:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 12:20:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 12:20:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:20:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:20:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:20:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:20:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:20:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:20:20 [DEBUG   ] Finished updating board flags in 2.211 seconds
2018-12-26 12:20:22 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 12:20:42 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-26 12:20:58 [DEBUG   ] Got command RPT from MCS: ref #957717
2018-12-26 12:20:58 [DEBUG   ] summary = ERROR
2018-12-26 12:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957717  13 58478 44458669 A  ERRORERROR'
2018-12-26 12:20:58 [DEBUG   ] Got command RPT from MCS: ref #957718
2018-12-26 12:20:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 12:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957718  77 58478 44458670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 12:21:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 12:21:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:21:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:21:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:21:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:21:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:21:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:21:20 [DEBUG   ] Finished updating board flags in 2.104 seconds
2018-12-26 12:21:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 12:21:42 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 12:22:02 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-26 12:22:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:22:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:22:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:22:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:22:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:22:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:22:20 [DEBUG   ] Finished updating board flags in 2.042 seconds
2018-12-26 12:22:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 12:22:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 12:23:02 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 12:23:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:23:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:23:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:23:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:23:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:23:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:23:20 [DEBUG   ] Finished updating board flags in 1.964 seconds
2018-12-26 12:23:22 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-26 12:23:43 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-26 12:24:03 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-26 12:24:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:24:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 12:24:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:24:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:24:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:24:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:24:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:24:20 [DEBUG   ] Finished updating board flags in 1.822 seconds
2018-12-26 12:24:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 12:24:37 [DEBUG   ] Got command RPT from MCS: ref #957740
2018-12-26 12:24:37 [DEBUG   ] summary = ERROR
2018-12-26 12:24:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957740  13 58478 44677809 A  ERRORERROR'
2018-12-26 12:24:38 [DEBUG   ] Got command RPT from MCS: ref #957741
2018-12-26 12:24:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 12:24:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957741  77 58478 44678013 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 12:24:38 [DEBUG   ] Got command RPT from MCS: ref #957742
2018-12-26 12:24:38 [DEBUG   ] summary = ERROR
2018-12-26 12:24:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957742  13 58478 44678217 A  ERRORERROR'
2018-12-26 12:24:38 [DEBUG   ] Got command RPT from MCS: ref #957744
2018-12-26 12:24:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 12:24:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957744  77 58478 44678409 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 12:24:38 [DEBUG   ] Got command RPT from MCS: ref #957746
2018-12-26 12:24:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 12:24:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957746  12 58478 44678613 A  ERRORB˜™š'
2018-12-26 12:24:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 12:25:03 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 12:25:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 12:25:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:25:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:25:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:25:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:25:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:25:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:25:20 [DEBUG   ] Finished updating board flags in 1.793 seconds
2018-12-26 12:25:23 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-26 12:25:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 12:25:58 [DEBUG   ] Got command RPT from MCS: ref #957754
2018-12-26 12:25:58 [DEBUG   ] summary = ERROR
2018-12-26 12:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957754  13 58478 44758669 A  ERRORERROR'
2018-12-26 12:25:58 [DEBUG   ] Got command RPT from MCS: ref #957755
2018-12-26 12:25:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 12:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957755  77 58478 44758670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 12:26:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 12:26:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:26:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 12:26:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:26:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:26:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:26:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:26:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:26:20 [DEBUG   ] Finished updating board flags in 1.595 seconds
2018-12-26 12:26:23 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 12:26:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 12:27:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 12:27:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:27:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:27:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:27:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:27:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:27:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:27:20 [DEBUG   ] Finished updating board flags in 1.435 seconds
2018-12-26 12:27:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 12:27:43 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 12:28:03 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-26 12:28:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:28:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 12:28:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:28:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:28:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:28:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:28:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:28:20 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-12-26 12:28:23 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-26 12:28:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 12:29:03 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 12:29:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:29:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:29:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:29:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:29:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:29:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:29:20 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-12-26 12:29:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 12:29:37 [DEBUG   ] Got command RPT from MCS: ref #957775
2018-12-26 12:29:37 [DEBUG   ] summary = ERROR
2018-12-26 12:29:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957775  13 58478 44977889 A  ERRORERROR'
2018-12-26 12:29:38 [DEBUG   ] Got command RPT from MCS: ref #957776
2018-12-26 12:29:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 12:29:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957776  77 58478 44978093 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 12:29:38 [DEBUG   ] Got command RPT from MCS: ref #957777
2018-12-26 12:29:38 [DEBUG   ] summary = ERROR
2018-12-26 12:29:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957777  13 58478 44978297 A  ERRORERROR'
2018-12-26 12:29:38 [DEBUG   ] Got command RPT from MCS: ref #957778
2018-12-26 12:29:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 12:29:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957778  77 58478 44978489 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 12:29:38 [DEBUG   ] Got command RPT from MCS: ref #957779
2018-12-26 12:29:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 12:29:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957779  12 58478 44978693 A  ERRORB—™š'
2018-12-26 12:29:43 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-26 12:30:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 12:30:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:30:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:30:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:30:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:30:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:30:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:30:20 [DEBUG   ] Finished updating board flags in 1.511 seconds
2018-12-26 12:30:23 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 12:30:43 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-26 12:30:58 [DEBUG   ] Got command RPT from MCS: ref #957780
2018-12-26 12:30:58 [DEBUG   ] summary = ERROR
2018-12-26 12:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957780  13 58478 45058677 A  ERRORERROR'
2018-12-26 12:30:58 [DEBUG   ] Got command RPT from MCS: ref #957781
2018-12-26 12:30:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 12:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957781  77 58478 45058678 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 12:31:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 12:31:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:31:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:31:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:31:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:31:20 [WARNING ] (13, 1, 'bot')
2018-12-26 12:31:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:31:20 [DEBUG   ] Finished updating board flags in 1.509 seconds
2018-12-26 12:31:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 12:31:43 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 12:32:03 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-26 12:32:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:32:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:32:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:32:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:32:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:32:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:32:21 [DEBUG   ] Finished updating board flags in 2.247 seconds
2018-12-26 12:32:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 12:32:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 12:33:03 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-26 12:33:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:33:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:33:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:33:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:33:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:33:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:33:21 [DEBUG   ] Finished updating board flags in 2.092 seconds
2018-12-26 12:33:24 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2018-12-26 12:33:44 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-26 12:34:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 12:34:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:34:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:34:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:34:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:34:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:34:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:34:21 [DEBUG   ] Finished updating board flags in 2.009 seconds
2018-12-26 12:34:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 12:34:37 [DEBUG   ] Got command RPT from MCS: ref #957807
2018-12-26 12:34:37 [DEBUG   ] summary = ERROR
2018-12-26 12:34:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957807  13 58478 45277969 A  ERRORERROR'
2018-12-26 12:34:38 [DEBUG   ] Got command RPT from MCS: ref #957808
2018-12-26 12:34:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 12:34:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957808  77 58478 45278173 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 12:34:38 [DEBUG   ] Got command RPT from MCS: ref #957809
2018-12-26 12:34:38 [DEBUG   ] summary = ERROR
2018-12-26 12:34:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957809  13 58478 45278365 A  ERRORERROR'
2018-12-26 12:34:38 [DEBUG   ] Got command RPT from MCS: ref #957811
2018-12-26 12:34:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 12:34:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957811  77 58478 45278569 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 12:34:38 [DEBUG   ] Got command RPT from MCS: ref #957812
2018-12-26 12:34:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 12:34:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957812  12 58478 45278773 A  ERRORB–™š'
2018-12-26 12:34:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 12:35:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-26 12:35:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 12:35:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:35:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:35:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:35:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:35:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:35:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:35:21 [DEBUG   ] Finished updating board flags in 1.997 seconds
2018-12-26 12:35:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 12:35:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 12:35:58 [DEBUG   ] Got command RPT from MCS: ref #957817
2018-12-26 12:35:58 [DEBUG   ] summary = ERROR
2018-12-26 12:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957817  13 58478 45358677 A  ERRORERROR'
2018-12-26 12:35:58 [DEBUG   ] Got command RPT from MCS: ref #957818
2018-12-26 12:35:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 12:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957818  77 58478 45358678 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 12:36:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 12:36:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:36:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:36:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:36:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:36:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:36:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:36:21 [DEBUG   ] Finished updating board flags in 1.808 seconds
2018-12-26 12:36:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 12:36:44 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-26 12:37:04 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-26 12:37:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:37:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 12:37:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:37:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:37:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:37:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:37:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:37:21 [DEBUG   ] Finished updating board flags in 1.810 seconds
2018-12-26 12:37:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 12:37:44 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 12:38:04 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 12:38:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:38:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:38:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:38:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:38:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:38:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:38:21 [DEBUG   ] Finished updating board flags in 1.780 seconds
2018-12-26 12:38:24 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-26 12:38:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 12:39:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 12:39:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:39:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:39:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:39:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:39:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:39:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:39:21 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-12-26 12:39:24 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 12:39:38 [DEBUG   ] Got command RPT from MCS: ref #957838
2018-12-26 12:39:38 [DEBUG   ] summary = ERROR
2018-12-26 12:39:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957838  13 58478 45578045 A  ERRORERROR'
2018-12-26 12:39:38 [DEBUG   ] Got command RPT from MCS: ref #957839
2018-12-26 12:39:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 12:39:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957839  77 58478 45578249 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 12:39:38 [DEBUG   ] Got command RPT from MCS: ref #957840
2018-12-26 12:39:38 [DEBUG   ] summary = ERROR
2018-12-26 12:39:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957840  13 58478 45578453 A  ERRORERROR'
2018-12-26 12:39:38 [DEBUG   ] Got command RPT from MCS: ref #957841
2018-12-26 12:39:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 12:39:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957841  77 58478 45578657 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 12:39:38 [DEBUG   ] Got command RPT from MCS: ref #957842
2018-12-26 12:39:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 12:39:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957842  12 58478 45578849 A  ERRORB˜™š'
2018-12-26 12:39:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 12:40:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 12:40:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:40:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:40:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:40:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:40:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:40:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:40:21 [DEBUG   ] Finished updating board flags in 1.701 seconds
2018-12-26 12:40:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 12:40:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 12:40:58 [DEBUG   ] Got command RPT from MCS: ref #957847
2018-12-26 12:40:58 [DEBUG   ] summary = ERROR
2018-12-26 12:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957847  13 58478 45658669 A  ERRORERROR'
2018-12-26 12:40:58 [DEBUG   ] Got command RPT from MCS: ref #957848
2018-12-26 12:40:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 12:40:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957848  77 58478 45658670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 12:41:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 12:41:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:41:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:41:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:41:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:41:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:41:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:41:21 [DEBUG   ] Finished updating board flags in 1.502 seconds
2018-12-26 12:41:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 12:41:44 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 12:42:04 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-26 12:42:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:42:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:42:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:42:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:42:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:42:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:42:21 [DEBUG   ] Finished updating board flags in 1.476 seconds
2018-12-26 12:42:24 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-26 12:42:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 12:43:05 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-26 12:43:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:43:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:43:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:43:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:43:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:43:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:43:21 [DEBUG   ] Finished updating board flags in 1.472 seconds
2018-12-26 12:43:25 [DEBUG   ] Finished updating ant stats in 1.120 seconds
2018-12-26 12:43:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 12:44:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 12:44:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:44:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:44:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:44:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:44:21 [WARNING ] (13, 1, 'bot')
2018-12-26 12:44:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:44:21 [DEBUG   ] Finished updating board flags in 1.477 seconds
2018-12-26 12:44:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 12:44:38 [DEBUG   ] Got command RPT from MCS: ref #957870
2018-12-26 12:44:38 [DEBUG   ] summary = ERROR
2018-12-26 12:44:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957870  13 58478 45878130 A  ERRORERROR'
2018-12-26 12:44:38 [DEBUG   ] Got command RPT from MCS: ref #957871
2018-12-26 12:44:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 12:44:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957871  77 58478 45878333 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 12:44:38 [DEBUG   ] Got command RPT from MCS: ref #957872
2018-12-26 12:44:38 [DEBUG   ] summary = ERROR
2018-12-26 12:44:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957872  13 58478 45878537 A  ERRORERROR'
2018-12-26 12:44:38 [DEBUG   ] Got command RPT from MCS: ref #957874
2018-12-26 12:44:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 12:44:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957874  77 58478 45878729 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 12:44:38 [DEBUG   ] Got command RPT from MCS: ref #957875
2018-12-26 12:44:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 12:44:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957875  12 58478 45878933 A  ERRORB—™š'
2018-12-26 12:44:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 12:45:05 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2018-12-26 12:45:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:45:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:45:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:45:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:45:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:45:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:45:22 [DEBUG   ] Finished updating board flags in 2.211 seconds
2018-12-26 12:45:25 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-26 12:45:45 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 12:45:58 [DEBUG   ] Got command RPT from MCS: ref #957880
2018-12-26 12:45:58 [DEBUG   ] summary = ERROR
2018-12-26 12:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957880  13 58478 45958673 A  ERRORERROR'
2018-12-26 12:45:58 [DEBUG   ] Got command RPT from MCS: ref #957881
2018-12-26 12:45:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 12:45:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957881  77 58478 45958674 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 12:46:05 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-26 12:46:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:46:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:46:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:46:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:46:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:46:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:46:22 [DEBUG   ] Finished updating board flags in 2.171 seconds
2018-12-26 12:46:26 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-26 12:46:46 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-26 12:47:06 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-26 12:47:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:47:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:47:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:47:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:47:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:47:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:47:22 [DEBUG   ] Finished updating board flags in 2.032 seconds
2018-12-26 12:47:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 12:47:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 12:48:06 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 12:48:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:48:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:48:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:48:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:48:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:48:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:48:22 [DEBUG   ] Finished updating board flags in 1.960 seconds
2018-12-26 12:48:26 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2018-12-26 12:48:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 12:49:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 12:49:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:49:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:49:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:49:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:49:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:49:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:49:22 [DEBUG   ] Finished updating board flags in 1.824 seconds
2018-12-26 12:49:26 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 12:49:38 [DEBUG   ] Got command RPT from MCS: ref #957905
2018-12-26 12:49:38 [DEBUG   ] summary = ERROR
2018-12-26 12:49:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957905  13 58478 46178209 A  ERRORERROR'
2018-12-26 12:49:38 [DEBUG   ] Got command RPT from MCS: ref #957906
2018-12-26 12:49:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 12:49:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957906  77 58478 46178413 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 12:49:38 [DEBUG   ] Got command RPT from MCS: ref #957907
2018-12-26 12:49:38 [DEBUG   ] summary = ERROR
2018-12-26 12:49:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957907  13 58478 46178618 A  ERRORERROR'
2018-12-26 12:49:38 [DEBUG   ] Got command RPT from MCS: ref #957908
2018-12-26 12:49:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 12:49:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957908  77 58478 46178809 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 12:49:39 [DEBUG   ] Got command RPT from MCS: ref #957909
2018-12-26 12:49:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 12:49:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957909  12 58478 46179013 A  ERRORB–™š'
2018-12-26 12:49:46 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-26 12:50:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 12:50:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:50:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:50:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:50:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:50:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:50:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:50:22 [DEBUG   ] Finished updating board flags in 1.787 seconds
2018-12-26 12:50:26 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-26 12:50:46 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 12:50:58 [DEBUG   ] Got command RPT from MCS: ref #957910
2018-12-26 12:50:58 [DEBUG   ] summary = ERROR
2018-12-26 12:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957910  13 58478 46258677 A  ERRORERROR'
2018-12-26 12:50:58 [DEBUG   ] Got command RPT from MCS: ref #957911
2018-12-26 12:50:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 12:50:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957911  77 58478 46258678 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 12:51:06 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-26 12:51:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:51:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:51:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:51:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:51:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:51:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:51:22 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-12-26 12:51:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 12:51:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 12:52:06 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 12:52:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2018-12-26 12:52:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:52:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:52:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:52:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:52:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:52:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:52:22 [DEBUG   ] Finished updating board flags in 1.595 seconds
2018-12-26 12:52:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 12:52:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 12:53:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-26 12:53:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 12:53:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:53:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:53:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:53:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:53:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:53:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:53:22 [DEBUG   ] Finished updating board flags in 1.436 seconds
2018-12-26 12:53:26 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 12:53:46 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-26 12:54:06 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-26 12:54:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:54:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:54:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:54:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:54:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:54:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:54:22 [DEBUG   ] Finished updating board flags in 1.436 seconds
2018-12-26 12:54:26 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-26 12:54:38 [DEBUG   ] Got command RPT from MCS: ref #957933
2018-12-26 12:54:38 [DEBUG   ] summary = ERROR
2018-12-26 12:54:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957933  13 58478 46478293 A  ERRORERROR'
2018-12-26 12:54:38 [DEBUG   ] Got command RPT from MCS: ref #957934
2018-12-26 12:54:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 12:54:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957934  77 58478 46478497 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 12:54:38 [DEBUG   ] Got command RPT from MCS: ref #957935
2018-12-26 12:54:38 [DEBUG   ] summary = ERROR
2018-12-26 12:54:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957935  13 58478 46478689 A  ERRORERROR'
2018-12-26 12:54:38 [DEBUG   ] Got command RPT from MCS: ref #957937
2018-12-26 12:54:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 12:54:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957937  77 58478 46478894 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 12:54:39 [DEBUG   ] Got command RPT from MCS: ref #957939
2018-12-26 12:54:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 12:54:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957939  12 58478 46479097 A  ERRORB—™š'
2018-12-26 12:54:46 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-26 12:55:07 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-12-26 12:55:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:55:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:55:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:55:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:55:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:55:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:55:22 [DEBUG   ] Finished updating board flags in 1.444 seconds
2018-12-26 12:55:27 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-26 12:55:47 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-26 12:55:58 [DEBUG   ] Got command RPT from MCS: ref #957947
2018-12-26 12:55:58 [DEBUG   ] summary = ERROR
2018-12-26 12:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957947  13 58478 46558673 A  ERRORERROR'
2018-12-26 12:55:58 [DEBUG   ] Got command RPT from MCS: ref #957948
2018-12-26 12:55:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 12:55:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957948  77 58478 46558674 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 12:56:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 12:56:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:56:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:56:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:56:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:56:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:56:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:56:22 [DEBUG   ] Finished updating board flags in 1.442 seconds
2018-12-26 12:56:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 12:56:47 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 12:57:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 12:57:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:57:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:57:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:57:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:57:22 [WARNING ] (13, 1, 'bot')
2018-12-26 12:57:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:57:22 [DEBUG   ] Finished updating board flags in 1.567 seconds
2018-12-26 12:57:27 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-26 12:57:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 12:58:07 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 12:58:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:58:23 [WARNING ] (13, 1, 'bot')
2018-12-26 12:58:23 [WARNING ] (13, 1, 'bot')
2018-12-26 12:58:23 [WARNING ] (13, 1, 'bot')
2018-12-26 12:58:23 [WARNING ] (13, 1, 'bot')
2018-12-26 12:58:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:58:23 [DEBUG   ] Finished updating board flags in 2.209 seconds
2018-12-26 12:58:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 12:58:47 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-26 12:59:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 12:59:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 12:59:23 [WARNING ] (13, 1, 'bot')
2018-12-26 12:59:23 [WARNING ] (13, 1, 'bot')
2018-12-26 12:59:23 [WARNING ] (13, 1, 'bot')
2018-12-26 12:59:23 [WARNING ] (13, 1, 'bot')
2018-12-26 12:59:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 12:59:23 [DEBUG   ] Finished updating board flags in 2.208 seconds
2018-12-26 12:59:27 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 12:59:38 [DEBUG   ] Got command RPT from MCS: ref #957968
2018-12-26 12:59:38 [DEBUG   ] summary = ERROR
2018-12-26 12:59:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957968  13 58478 46778369 A  ERRORERROR'
2018-12-26 12:59:38 [DEBUG   ] Got command RPT from MCS: ref #957969
2018-12-26 12:59:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 12:59:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957969  77 58478 46778573 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 12:59:38 [DEBUG   ] Got command RPT from MCS: ref #957970
2018-12-26 12:59:38 [DEBUG   ] summary = ERROR
2018-12-26 12:59:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957970  13 58478 46778777 A  ERRORERROR'
2018-12-26 12:59:38 [DEBUG   ] Got command RPT from MCS: ref #957971
2018-12-26 12:59:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 12:59:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957971  77 58478 46778969 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 12:59:39 [DEBUG   ] Got command RPT from MCS: ref #957972
2018-12-26 12:59:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 12:59:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957972  12 58478 46779173 A  ERRORB—™š'
2018-12-26 12:59:47 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-26 13:00:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-26 13:00:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 13:00:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:00:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:00:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:00:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:00:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 13:00:23 [DEBUG   ] Finished updating board flags in 2.084 seconds
2018-12-26 13:00:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 13:00:47 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 13:00:58 [DEBUG   ] Got command RPT from MCS: ref #957973
2018-12-26 13:00:58 [DEBUG   ] summary = ERROR
2018-12-26 13:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957973  13 58478 46858681 A  ERRORERROR'
2018-12-26 13:00:58 [DEBUG   ] Got command RPT from MCS: ref #957974
2018-12-26 13:00:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 13:00:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   957974  77 58478 46858682 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 13:01:07 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-26 13:01:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 13:01:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:01:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:01:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:01:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:01:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 13:01:23 [DEBUG   ] Finished updating board flags in 2.019 seconds
2018-12-26 13:01:28 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-12-26 13:01:48 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-26 13:02:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 13:02:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 13:02:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:02:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:02:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:02:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:02:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 13:02:23 [DEBUG   ] Finished updating board flags in 1.983 seconds
2018-12-26 13:02:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 13:02:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 13:03:08 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 13:03:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 13:03:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-26 13:03:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:03:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:03:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:03:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:03:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 13:03:23 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-12-26 13:03:28 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-26 13:03:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 13:04:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 13:04:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 13:04:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:04:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:04:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:04:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:04:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 13:04:23 [DEBUG   ] Finished updating board flags in 1.782 seconds
2018-12-26 13:04:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 13:04:38 [DEBUG   ] Got command RPT from MCS: ref #958000
2018-12-26 13:04:38 [DEBUG   ] summary = ERROR
2018-12-26 13:04:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   958000  13 58478 47078449 A  ERRORERROR'
2018-12-26 13:04:38 [DEBUG   ] Got command RPT from MCS: ref #958001
2018-12-26 13:04:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 13:04:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   958001  77 58478 47078653 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 13:04:38 [DEBUG   ] Got command RPT from MCS: ref #958002
2018-12-26 13:04:38 [DEBUG   ] summary = ERROR
2018-12-26 13:04:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   958002  13 58478 47078857 A  ERRORERROR'
2018-12-26 13:04:39 [DEBUG   ] Got command RPT from MCS: ref #958004
2018-12-26 13:04:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 13:04:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   958004  77 58478 47079049 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 13:04:39 [DEBUG   ] Got command RPT from MCS: ref #958005
2018-12-26 13:04:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 13:04:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   958005  12 58478 47079253 A  ERRORB–™š'
2018-12-26 13:04:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-26 13:05:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 13:05:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 13:05:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:05:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:05:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:05:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:05:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 13:05:23 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-12-26 13:05:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 13:05:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 13:05:58 [DEBUG   ] Got command RPT from MCS: ref #958010
2018-12-26 13:05:58 [DEBUG   ] summary = ERROR
2018-12-26 13:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   958010  13 58478 47158677 A  ERRORERROR'
2018-12-26 13:05:58 [DEBUG   ] Got command RPT from MCS: ref #958011
2018-12-26 13:05:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 13:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   958011  77 58478 47158678 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 13:06:08 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-26 13:06:22 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 13:06:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 13:06:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 13:06:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:06:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:06:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:06:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:06:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 13:06:23 [DEBUG   ] Finished updating board flags in 1.620 seconds
2018-12-26 13:06:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 13:06:48 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 13:07:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 13:07:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 13:07:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:07:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:07:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:07:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:07:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 13:07:23 [DEBUG   ] Finished updating board flags in 1.584 seconds
2018-12-26 13:07:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 13:07:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 13:08:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 13:08:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 13:08:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-26 13:08:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 13:08:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:08:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:08:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:08:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:08:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 13:08:23 [DEBUG   ] Finished updating board flags in 1.448 seconds
2018-12-26 13:08:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 13:08:48 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-26 13:09:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-26 13:09:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 13:09:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:09:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:09:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:09:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:09:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 13:09:23 [DEBUG   ] Finished updating board flags in 1.420 seconds
2018-12-26 13:09:28 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 13:09:38 [DEBUG   ] Got command RPT from MCS: ref #958031
2018-12-26 13:09:38 [DEBUG   ] summary = ERROR
2018-12-26 13:09:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   958031  13 58478 47378525 A  ERRORERROR'
2018-12-26 13:09:38 [DEBUG   ] Got command RPT from MCS: ref #958032
2018-12-26 13:09:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 13:09:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   958032  77 58478 47378729 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 13:09:38 [DEBUG   ] Got command RPT from MCS: ref #958033
2018-12-26 13:09:38 [DEBUG   ] summary = ERROR
2018-12-26 13:09:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   958033  13 58478 47378933 A  ERRORERROR'
2018-12-26 13:09:39 [DEBUG   ] Got command RPT from MCS: ref #958034
2018-12-26 13:09:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 13:09:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   958034  77 58478 47379137 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 13:09:39 [DEBUG   ] Got command RPT from MCS: ref #958035
2018-12-26 13:09:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 13:09:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   958035  12 58478 47379329 A  ERRORB˜™š'
2018-12-26 13:09:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 13:10:08 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-26 13:10:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 13:10:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:10:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:10:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:10:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:10:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 13:10:23 [DEBUG   ] Finished updating board flags in 1.446 seconds
2018-12-26 13:10:28 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-12-26 13:10:48 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 13:10:58 [DEBUG   ] Got command RPT from MCS: ref #958040
2018-12-26 13:10:58 [DEBUG   ] summary = ERROR
2018-12-26 13:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   958040  13 58478 47458677 A  ERRORERROR'
2018-12-26 13:10:58 [DEBUG   ] Got command RPT from MCS: ref #958041
2018-12-26 13:10:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 13:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   958041  77 58478 47458678 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 13:11:09 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-26 13:11:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 13:11:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:11:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:11:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:11:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:11:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 13:11:23 [DEBUG   ] Finished updating board flags in 1.448 seconds
2018-12-26 13:11:29 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-26 13:11:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 13:12:09 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 13:12:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 13:12:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:12:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:12:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:12:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:12:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 13:12:23 [DEBUG   ] Finished updating board flags in 1.444 seconds
2018-12-26 13:12:29 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2018-12-26 13:12:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 13:13:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 13:13:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 13:13:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:13:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:13:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:13:23 [WARNING ] (13, 1, 'bot')
2018-12-26 13:13:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 13:13:23 [DEBUG   ] Finished updating board flags in 1.446 seconds
2018-12-26 13:13:29 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 13:13:49 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-26 13:14:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-26 13:14:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 13:14:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-26 13:14:24 [WARNING ] (13, 1, 'bot')
2018-12-26 13:14:24 [WARNING ] (13, 1, 'bot')
2018-12-26 13:14:24 [WARNING ] (13, 1, 'bot')
2018-12-26 13:14:24 [WARNING ] (13, 1, 'bot')
2018-12-26 13:14:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 13:14:24 [DEBUG   ] Finished updating board flags in 2.207 seconds
2018-12-26 13:14:29 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-26 13:14:38 [DEBUG   ] Got command RPT from MCS: ref #958063
2018-12-26 13:14:38 [DEBUG   ] summary = ERROR
2018-12-26 13:14:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   958063  13 58478 47678609 A  ERRORERROR'
2018-12-26 13:14:38 [DEBUG   ] Got command RPT from MCS: ref #958064
2018-12-26 13:14:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 13:14:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   958064  77 58478 47678813 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 13:14:39 [DEBUG   ] Got command RPT from MCS: ref #958065
2018-12-26 13:14:39 [DEBUG   ] summary = ERROR
2018-12-26 13:14:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   958065  13 58478 47679017 A  ERRORERROR'
2018-12-26 13:14:39 [DEBUG   ] Got command RPT from MCS: ref #958067
2018-12-26 13:14:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 13:14:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   958067  77 58478 47679225 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 13:14:39 [DEBUG   ] Got command RPT from MCS: ref #958068
2018-12-26 13:14:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 13:14:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   958068  12 58478 47679417 A  ERRORB˜™š'
2018-12-26 13:14:49 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-26 13:15:09 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-26 13:15:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 13:15:24 [WARNING ] (13, 1, 'bot')
2018-12-26 13:15:24 [WARNING ] (13, 1, 'bot')
2018-12-26 13:15:24 [WARNING ] (13, 1, 'bot')
2018-12-26 13:15:24 [WARNING ] (13, 1, 'bot')
2018-12-26 13:15:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 13:15:24 [DEBUG   ] Finished updating board flags in 2.162 seconds
2018-12-26 13:15:29 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 13:15:49 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-26 13:15:58 [DEBUG   ] Got command RPT from MCS: ref #958073
2018-12-26 13:15:58 [DEBUG   ] summary = ERROR
2018-12-26 13:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   958073  13 58478 47758677 A  ERRORERROR'
2018-12-26 13:15:58 [DEBUG   ] Got command RPT from MCS: ref #958074
2018-12-26 13:15:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 13:15:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   958074  77 58478 47758678 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 13:16:10 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-26 13:16:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 13:16:24 [WARNING ] (13, 1, 'bot')
2018-12-26 13:16:24 [WARNING ] (13, 1, 'bot')
2018-12-26 13:16:24 [WARNING ] (13, 1, 'bot')
2018-12-26 13:16:24 [WARNING ] (13, 1, 'bot')
2018-12-26 13:16:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 13:16:24 [DEBUG   ] Finished updating board flags in 2.013 seconds
2018-12-26 13:16:30 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-26 13:16:50 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-26 13:17:10 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 13:17:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 13:17:24 [WARNING ] (13, 1, 'bot')
2018-12-26 13:17:24 [WARNING ] (13, 1, 'bot')
2018-12-26 13:17:24 [WARNING ] (13, 1, 'bot')
2018-12-26 13:17:24 [WARNING ] (13, 1, 'bot')
2018-12-26 13:17:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 13:17:24 [DEBUG   ] Finished updating board flags in 2.003 seconds
2018-12-26 13:17:30 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-26 13:17:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 13:18:10 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 13:18:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 13:18:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-26 13:18:24 [WARNING ] (13, 1, 'bot')
2018-12-26 13:18:24 [WARNING ] (13, 1, 'bot')
2018-12-26 13:18:24 [WARNING ] (13, 1, 'bot')
2018-12-26 13:18:24 [WARNING ] (13, 1, 'bot')
2018-12-26 13:18:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 13:18:24 [DEBUG   ] Finished updating board flags in 1.989 seconds
2018-12-26 13:18:30 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 13:18:50 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-12-26 13:19:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-26 13:19:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 13:19:24 [WARNING ] (13, 1, 'bot')
2018-12-26 13:19:24 [WARNING ] (13, 1, 'bot')
2018-12-26 13:19:24 [WARNING ] (13, 1, 'bot')
2018-12-26 13:19:24 [WARNING ] (13, 1, 'bot')
2018-12-26 13:19:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 13:19:24 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-12-26 13:19:30 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-26 13:19:38 [DEBUG   ] Got command RPT from MCS: ref #958098
2018-12-26 13:19:38 [DEBUG   ] summary = ERROR
2018-12-26 13:19:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   958098  13 58478 47978689 A  ERRORERROR'
2018-12-26 13:19:38 [DEBUG   ] Got command RPT from MCS: ref #958099
2018-12-26 13:19:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 13:19:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   958099  77 58478 47978893 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 13:19:39 [DEBUG   ] Got command RPT from MCS: ref #958100
2018-12-26 13:19:39 [DEBUG   ] summary = ERROR
2018-12-26 13:19:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   958100  13 58478 47979097 A  ERRORERROR'
2018-12-26 13:19:39 [DEBUG   ] Got command RPT from MCS: ref #958101
2018-12-26 13:19:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 13:19:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   958101  77 58478 47979301 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 13:19:39 [DEBUG   ] Got command RPT from MCS: ref #958102
2018-12-26 13:19:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 13:19:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   958102  12 58478 47979493 A  ERRORB–™š'
2018-12-26 13:19:50 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-26 13:20:10 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-12-26 13:20:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 13:20:24 [WARNING ] (13, 1, 'bot')
2018-12-26 13:20:24 [WARNING ] (13, 1, 'bot')
2018-12-26 13:20:24 [WARNING ] (13, 1, 'bot')
2018-12-26 13:20:24 [WARNING ] (13, 1, 'bot')
2018-12-26 13:20:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 13:20:24 [DEBUG   ] Finished updating board flags in 1.783 seconds
2018-12-26 13:20:30 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-26 13:20:50 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-26 13:20:58 [DEBUG   ] Got command RPT from MCS: ref #958103
2018-12-26 13:20:58 [DEBUG   ] summary = ERROR
2018-12-26 13:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   958103  13 58478 48058677 A  ERRORERROR'
2018-12-26 13:20:58 [DEBUG   ] Got command RPT from MCS: ref #958104
2018-12-26 13:20:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 13:20:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   958104  77 58478 48058678 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 13:21:11 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-12-26 13:21:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 13:21:24 [WARNING ] (13, 1, 'bot')
2018-12-26 13:21:24 [WARNING ] (13, 1, 'bot')
2018-12-26 13:21:24 [WARNING ] (13, 1, 'bot')
2018-12-26 13:21:24 [WARNING ] (13, 1, 'bot')
2018-12-26 13:21:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 13:21:24 [DEBUG   ] Finished updating board flags in 1.624 seconds
2018-12-26 13:21:31 [DEBUG   ] Finished updating ant stats in 1.210 seconds
2018-12-26 13:21:51 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 13:22:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 13:22:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 13:22:24 [WARNING ] (13, 1, 'bot')
2018-12-26 13:22:24 [WARNING ] (13, 1, 'bot')
2018-12-26 13:22:24 [WARNING ] (13, 1, 'bot')
2018-12-26 13:22:24 [WARNING ] (13, 1, 'bot')
2018-12-26 13:22:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 13:22:24 [DEBUG   ] Finished updating board flags in 1.592 seconds
2018-12-26 13:22:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 13:22:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-26 13:23:11 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-26 13:23:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-26 13:23:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 13:23:24 [WARNING ] (13, 1, 'bot')
2018-12-26 13:23:24 [WARNING ] (13, 1, 'bot')
2018-12-26 13:23:24 [WARNING ] (13, 1, 'bot')
2018-12-26 13:23:24 [WARNING ] (13, 1, 'bot')
2018-12-26 13:23:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 13:23:24 [DEBUG   ] Finished updating board flags in 1.490 seconds
2018-12-26 13:23:31 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-26 13:23:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 13:24:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-26 13:24:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-26 13:24:24 [WARNING ] (13, 1, 'bot')
2018-12-26 13:24:24 [WARNING ] (13, 1, 'bot')
2018-12-26 13:24:24 [WARNING ] (13, 1, 'bot')
2018-12-26 13:24:24 [WARNING ] (13, 1, 'bot')
2018-12-26 13:24:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-26 13:24:24 [DEBUG   ] Finished updating board flags in 1.491 seconds
2018-12-26 13:24:31 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-26 13:24:38 [DEBUG   ] Got command RPT from MCS: ref #958126
2018-12-26 13:24:38 [DEBUG   ] summary = ERROR
2018-12-26 13:24:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   958126  13 58478 48278773 A  ERRORERROR'
2018-12-26 13:24:38 [DEBUG   ] Got command RPT from MCS: ref #958127
2018-12-26 13:24:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 13:24:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   958127  77 58478 48278977 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 13:24:39 [DEBUG   ] Got command RPT from MCS: ref #958128
2018-12-26 13:24:39 [DEBUG   ] summary = ERROR
2018-12-26 13:24:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   958128  13 58478 48279181 A  ERRORERROR'
2018-12-26 13:24:39 [DEBUG   ] Got command RPT from MCS: ref #958130
2018-12-26 13:24:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-26 13:24:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   958130  77 58478 48279373 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-26 13:24:39 [DEBUG   ] Got command RPT from MCS: ref #958132
2018-12-26 13:24:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-26 13:24:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   958132  12 58478 48279577 A  ERRORB—™š'
2018-12-26 13:24:51 [DEBUG   ] Finished updating ant stats in 0.999 seconds
