2019-02-05 13:25:09 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-05 13:25:29 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 13:25:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 13:25:31 [WARNING ] (13, 1, 'bot')
2019-02-05 13:25:31 [WARNING ] (13, 1, 'bot')
2019-02-05 13:25:31 [WARNING ] (13, 1, 'bot')
2019-02-05 13:25:31 [WARNING ] (13, 1, 'bot')
2019-02-05 13:25:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 13:25:31 [DEBUG   ] Finished updating board flags in 1.425 seconds
2019-02-05 13:25:49 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-05 13:26:09 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-05 13:26:11 [DEBUG   ] Got command RPT from MCS: ref #1409998
2019-02-05 13:26:11 [DEBUG   ] summary = ERROR
2019-02-05 13:26:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1409998  13 58519 48371921 A  ERRORERROR'
2019-02-05 13:26:11 [DEBUG   ] Got command RPT from MCS: ref #1409999
2019-02-05 13:26:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 13:26:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1409999  77 58519 48371922 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 13:26:29 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-02-05 13:26:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 13:26:31 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 13:26:31 [WARNING ] (13, 1, 'bot')
2019-02-05 13:26:31 [WARNING ] (13, 1, 'bot')
2019-02-05 13:26:31 [WARNING ] (13, 1, 'bot')
2019-02-05 13:26:31 [WARNING ] (13, 1, 'bot')
2019-02-05 13:26:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 13:26:31 [DEBUG   ] Finished updating board flags in 1.423 seconds
2019-02-05 13:26:49 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 13:27:10 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-02-05 13:27:30 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-05 13:27:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 13:27:31 [WARNING ] (13, 1, 'bot')
2019-02-05 13:27:31 [WARNING ] (13, 1, 'bot')
2019-02-05 13:27:31 [WARNING ] (13, 1, 'bot')
2019-02-05 13:27:31 [WARNING ] (13, 1, 'bot')
2019-02-05 13:27:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 13:27:31 [DEBUG   ] Finished updating board flags in 1.409 seconds
2019-02-05 13:27:50 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 13:28:10 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-02-05 13:28:30 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-05 13:28:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 13:28:31 [WARNING ] (13, 1, 'bot')
2019-02-05 13:28:31 [WARNING ] (13, 1, 'bot')
2019-02-05 13:28:31 [WARNING ] (13, 1, 'bot')
2019-02-05 13:28:31 [WARNING ] (13, 1, 'bot')
2019-02-05 13:28:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 13:28:31 [DEBUG   ] Finished updating board flags in 1.355 seconds
2019-02-05 13:28:50 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 13:29:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 13:29:30 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 13:29:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 13:29:31 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 13:29:31 [WARNING ] (13, 1, 'bot')
2019-02-05 13:29:31 [WARNING ] (13, 1, 'bot')
2019-02-05 13:29:31 [WARNING ] (13, 1, 'bot')
2019-02-05 13:29:31 [WARNING ] (13, 1, 'bot')
2019-02-05 13:29:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 13:29:31 [DEBUG   ] Finished updating board flags in 1.359 seconds
2019-02-05 13:29:49 [DEBUG   ] Got command RPT from MCS: ref #1410019
2019-02-05 13:29:49 [DEBUG   ] summary = ERROR
2019-02-05 13:29:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410019  13 58519 48589630 A  ERRORERROR'
2019-02-05 13:29:49 [DEBUG   ] Got command RPT from MCS: ref #1410020
2019-02-05 13:29:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 13:29:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410020  77 58519 48589833 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 13:29:50 [DEBUG   ] Got command RPT from MCS: ref #1410021
2019-02-05 13:29:50 [DEBUG   ] summary = ERROR
2019-02-05 13:29:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410021  13 58519 48590025 A  ERRORERROR'
2019-02-05 13:29:50 [DEBUG   ] Got command RPT from MCS: ref #1410022
2019-02-05 13:29:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 13:29:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410022  77 58519 48590229 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 13:29:50 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-05 13:29:50 [DEBUG   ] Got command RPT from MCS: ref #1410023
2019-02-05 13:29:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 13:29:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410023  12 58519 48590433 A  ERRORB™™š'
2019-02-05 13:30:10 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-05 13:30:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 13:30:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 13:30:32 [WARNING ] (13, 1, 'bot')
2019-02-05 13:30:32 [WARNING ] (13, 1, 'bot')
2019-02-05 13:30:32 [WARNING ] (13, 1, 'bot')
2019-02-05 13:30:32 [WARNING ] (13, 1, 'bot')
2019-02-05 13:30:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 13:30:32 [DEBUG   ] Finished updating board flags in 2.059 seconds
2019-02-05 13:30:50 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-05 13:31:10 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-05 13:31:11 [DEBUG   ] Got command RPT from MCS: ref #1410024
2019-02-05 13:31:11 [DEBUG   ] summary = ERROR
2019-02-05 13:31:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410024  13 58519 48671921 A  ERRORERROR'
2019-02-05 13:31:11 [DEBUG   ] Got command RPT from MCS: ref #1410025
2019-02-05 13:31:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 13:31:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410025  77 58519 48671922 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 13:31:31 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-02-05 13:31:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 13:31:32 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 13:31:32 [WARNING ] (13, 1, 'bot')
2019-02-05 13:31:32 [WARNING ] (13, 1, 'bot')
2019-02-05 13:31:32 [WARNING ] (13, 1, 'bot')
2019-02-05 13:31:32 [WARNING ] (13, 1, 'bot')
2019-02-05 13:31:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 13:31:32 [DEBUG   ] Finished updating board flags in 1.988 seconds
2019-02-05 13:31:51 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2019-02-05 13:32:11 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-05 13:32:31 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 13:32:31 [DEBUG   ] Finished updating ant stats in 0.848 seconds
2019-02-05 13:32:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 13:32:32 [WARNING ] (13, 1, 'bot')
2019-02-05 13:32:32 [WARNING ] (13, 1, 'bot')
2019-02-05 13:32:32 [WARNING ] (13, 1, 'bot')
2019-02-05 13:32:32 [WARNING ] (13, 1, 'bot')
2019-02-05 13:32:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 13:32:32 [DEBUG   ] Finished updating board flags in 1.812 seconds
2019-02-05 13:32:51 [DEBUG   ] Finished updating ant stats in 0.752 seconds
2019-02-05 13:33:11 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-05 13:33:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 13:33:31 [DEBUG   ] Finished updating ant stats in 0.644 seconds
2019-02-05 13:33:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 13:33:32 [WARNING ] (13, 1, 'bot')
2019-02-05 13:33:32 [WARNING ] (13, 1, 'bot')
2019-02-05 13:33:32 [WARNING ] (13, 1, 'bot')
2019-02-05 13:33:32 [WARNING ] (13, 1, 'bot')
2019-02-05 13:33:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 13:33:32 [DEBUG   ] Finished updating board flags in 1.787 seconds
2019-02-05 13:33:51 [DEBUG   ] Finished updating ant stats in 0.554 seconds
2019-02-05 13:34:12 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-02-05 13:34:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 13:34:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 13:34:32 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-02-05 13:34:32 [WARNING ] (13, 1, 'bot')
2019-02-05 13:34:32 [WARNING ] (13, 1, 'bot')
2019-02-05 13:34:32 [WARNING ] (13, 1, 'bot')
2019-02-05 13:34:32 [WARNING ] (13, 1, 'bot')
2019-02-05 13:34:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 13:34:32 [DEBUG   ] Finished updating board flags in 1.620 seconds
2019-02-05 13:34:49 [DEBUG   ] Got command RPT from MCS: ref #1410047
2019-02-05 13:34:49 [DEBUG   ] summary = ERROR
2019-02-05 13:34:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410047  13 58519 48889713 A  ERRORERROR'
2019-02-05 13:34:49 [DEBUG   ] Got command RPT from MCS: ref #1410048
2019-02-05 13:34:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 13:34:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410048  77 58519 48889917 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 13:34:50 [DEBUG   ] Got command RPT from MCS: ref #1410049
2019-02-05 13:34:50 [DEBUG   ] summary = ERROR
2019-02-05 13:34:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410049  13 58519 48890109 A  ERRORERROR'
2019-02-05 13:34:50 [DEBUG   ] Got command RPT from MCS: ref #1410051
2019-02-05 13:34:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 13:34:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410051  77 58519 48890313 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 13:34:50 [DEBUG   ] Got command RPT from MCS: ref #1410052
2019-02-05 13:34:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 13:34:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410052  12 58519 48890517 A  ERRORB™™š'
2019-02-05 13:34:52 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-02-05 13:35:12 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-05 13:35:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 13:35:32 [DEBUG   ] Finished updating ant stats in 1.047 seconds
2019-02-05 13:35:32 [WARNING ] (13, 1, 'bot')
2019-02-05 13:35:32 [WARNING ] (13, 1, 'bot')
2019-02-05 13:35:32 [WARNING ] (13, 1, 'bot')
2019-02-05 13:35:32 [WARNING ] (13, 1, 'bot')
2019-02-05 13:35:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 13:35:32 [DEBUG   ] Finished updating board flags in 1.657 seconds
2019-02-05 13:35:52 [DEBUG   ] Finished updating ant stats in 0.959 seconds
2019-02-05 13:36:11 [DEBUG   ] Got command RPT from MCS: ref #1410061
2019-02-05 13:36:11 [DEBUG   ] summary = ERROR
2019-02-05 13:36:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410061  13 58519 48971929 A  ERRORERROR'
2019-02-05 13:36:11 [DEBUG   ] Got command RPT from MCS: ref #1410062
2019-02-05 13:36:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 13:36:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410062  77 58519 48971930 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 13:36:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 13:36:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-02-05 13:36:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 13:36:32 [DEBUG   ] Finished updating ant stats in 0.845 seconds
2019-02-05 13:36:32 [WARNING ] (13, 1, 'bot')
2019-02-05 13:36:32 [WARNING ] (13, 1, 'bot')
2019-02-05 13:36:32 [WARNING ] (13, 1, 'bot')
2019-02-05 13:36:32 [WARNING ] (13, 1, 'bot')
2019-02-05 13:36:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 13:36:32 [DEBUG   ] Finished updating board flags in 1.594 seconds
2019-02-05 13:36:52 [DEBUG   ] Finished updating ant stats in 0.761 seconds
2019-02-05 13:37:12 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-05 13:37:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 13:37:32 [WARNING ] (13, 1, 'bot')
2019-02-05 13:37:32 [WARNING ] (13, 1, 'bot')
2019-02-05 13:37:32 [WARNING ] (13, 1, 'bot')
2019-02-05 13:37:32 [WARNING ] (13, 1, 'bot')
2019-02-05 13:37:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 13:37:32 [DEBUG   ] Finished updating board flags in 1.478 seconds
2019-02-05 13:37:33 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2019-02-05 13:37:53 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-02-05 13:38:13 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-05 13:38:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 13:38:32 [WARNING ] (13, 1, 'bot')
2019-02-05 13:38:32 [WARNING ] (13, 1, 'bot')
2019-02-05 13:38:32 [WARNING ] (13, 1, 'bot')
2019-02-05 13:38:32 [WARNING ] (13, 1, 'bot')
2019-02-05 13:38:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 13:38:32 [DEBUG   ] Finished updating board flags in 1.451 seconds
2019-02-05 13:38:33 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-02-05 13:38:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 13:39:13 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 13:39:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 13:39:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 13:39:32 [WARNING ] (13, 1, 'bot')
2019-02-05 13:39:32 [WARNING ] (13, 1, 'bot')
2019-02-05 13:39:32 [WARNING ] (13, 1, 'bot')
2019-02-05 13:39:32 [WARNING ] (13, 1, 'bot')
2019-02-05 13:39:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 13:39:32 [DEBUG   ] Finished updating board flags in 1.481 seconds
2019-02-05 13:39:33 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-02-05 13:39:49 [DEBUG   ] Got command RPT from MCS: ref #1410082
2019-02-05 13:39:49 [DEBUG   ] summary = ERROR
2019-02-05 13:39:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410082  13 58519 49189801 A  ERRORERROR'
2019-02-05 13:39:49 [DEBUG   ] Got command RPT from MCS: ref #1410083
2019-02-05 13:39:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 13:39:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410083  77 58519 49189993 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 13:39:50 [DEBUG   ] Got command RPT from MCS: ref #1410084
2019-02-05 13:39:50 [DEBUG   ] summary = ERROR
2019-02-05 13:39:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410084  13 58519 49190197 A  ERRORERROR'
2019-02-05 13:39:50 [DEBUG   ] Got command RPT from MCS: ref #1410085
2019-02-05 13:39:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 13:39:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410085  77 58519 49190401 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 13:39:50 [DEBUG   ] Got command RPT from MCS: ref #1410086
2019-02-05 13:39:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 13:39:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410086  12 58519 49190605 A  ERRORB™™š'
2019-02-05 13:39:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 13:40:13 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-05 13:40:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 13:40:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 13:40:33 [DEBUG   ] Finished updating ant stats in 0.840 seconds
2019-02-05 13:40:33 [WARNING ] (13, 1, 'bot')
2019-02-05 13:40:33 [WARNING ] (13, 1, 'bot')
2019-02-05 13:40:33 [WARNING ] (13, 1, 'bot')
2019-02-05 13:40:33 [WARNING ] (13, 1, 'bot')
2019-02-05 13:40:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 13:40:33 [DEBUG   ] Finished updating board flags in 2.203 seconds
2019-02-05 13:40:53 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2019-02-05 13:41:11 [DEBUG   ] Got command RPT from MCS: ref #1410091
2019-02-05 13:41:11 [DEBUG   ] summary = ERROR
2019-02-05 13:41:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410091  13 58519 49271925 A  ERRORERROR'
2019-02-05 13:41:11 [DEBUG   ] Got command RPT from MCS: ref #1410092
2019-02-05 13:41:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 13:41:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410092  77 58519 49271926 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 13:41:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 13:41:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 13:41:33 [DEBUG   ] Finished updating ant stats in 0.645 seconds
2019-02-05 13:41:33 [WARNING ] (13, 1, 'bot')
2019-02-05 13:41:33 [WARNING ] (13, 1, 'bot')
2019-02-05 13:41:33 [WARNING ] (13, 1, 'bot')
2019-02-05 13:41:33 [WARNING ] (13, 1, 'bot')
2019-02-05 13:41:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 13:41:33 [DEBUG   ] Finished updating board flags in 2.192 seconds
2019-02-05 13:41:53 [DEBUG   ] Finished updating ant stats in 0.560 seconds
2019-02-05 13:42:14 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2019-02-05 13:42:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 13:42:33 [WARNING ] (13, 1, 'bot')
2019-02-05 13:42:33 [WARNING ] (13, 1, 'bot')
2019-02-05 13:42:33 [WARNING ] (13, 1, 'bot')
2019-02-05 13:42:33 [WARNING ] (13, 1, 'bot')
2019-02-05 13:42:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 13:42:33 [DEBUG   ] Finished updating board flags in 2.023 seconds
2019-02-05 13:42:34 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 13:42:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 13:43:11 [DEBUG   ] Got command TBW from MCS: ref #1410109
2019-02-05 13:43:11 [DEBUG   ] tbw = exited with status True, code 0x00
2019-02-05 13:43:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW  1410109   8 58519 49391754 A  ERROR'
2019-02-05 13:43:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2019-02-05 13:43:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2019-02-05 13:43:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2019-02-05 13:43:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2019-02-05 13:43:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2019-02-05 13:43:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2019-02-05 13:43:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2019-02-05 13:43:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2019-02-05 13:43:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2019-02-05 13:43:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2019-02-05 13:43:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2019-02-05 13:43:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2019-02-05 13:43:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2019-02-05 13:43:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2019-02-05 13:43:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2019-02-05 13:43:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2019-02-05 13:43:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2019-02-05 13:43:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2019-02-05 13:43:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2019-02-05 13:43:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2019-02-05 13:43:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2019-02-05 13:43:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2019-02-05 13:43:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2019-02-05 13:43:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2019-02-05 13:43:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2019-02-05 13:43:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2019-02-05 13:43:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2019-02-05 13:43:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2019-02-05 13:43:15 [DEBUG   ] spawn_process: at 2019-02-05 13:43:15 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2019-02-05 13:43:15 [DEBUG   ] spawn_process: at 2019-02-05 13:43:15 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2019-02-05 13:43:15 [DEBUG   ] spawn_process: at 2019-02-05 13:43:15 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2019-02-05 13:43:15 [DEBUG   ] spawn_process: at 2019-02-05 13:43:15 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2019-02-05 13:43:15 [DEBUG   ] spawn_process: at 2019-02-05 13:43:15 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2019-02-05 13:43:15 [DEBUG   ] spawn_process: at 2019-02-05 13:43:15 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2019-02-05 13:43:15 [DEBUG   ] spawn_process: at 2019-02-05 13:43:15 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2019-02-05 13:43:15 [DEBUG   ] spawn_process: at 2019-02-05 13:43:15 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2019-02-05 13:43:15 [DEBUG   ] spawn_process: at 2019-02-05 13:43:15 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2019-02-05 13:43:15 [DEBUG   ] spawn_process: at 2019-02-05 13:43:15 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2019-02-05 13:43:15 [DEBUG   ] spawn_process: at 2019-02-05 13:43:15 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2019-02-05 13:43:15 [DEBUG   ] spawn_process: at 2019-02-05 13:43:15 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2019-02-05 13:43:15 [DEBUG   ] spawn_process: at 2019-02-05 13:43:15 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2019-02-05 13:43:15 [DEBUG   ] spawn_process: at 2019-02-05 13:43:15 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2019-02-05 13:43:15 [DEBUG   ] spawn_process: at 2019-02-05 13:43:15 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2019-02-05 13:43:15 [DEBUG   ] spawn_process: at 2019-02-05 13:43:15 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2019-02-05 13:43:15 [DEBUG   ] spawn_process: at 2019-02-05 13:43:15 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2019-02-05 13:43:15 [DEBUG   ] spawn_process: at 2019-02-05 13:43:15 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2019-02-05 13:43:15 [DEBUG   ] spawn_process: at 2019-02-05 13:43:15 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2019-02-05 13:43:15 [DEBUG   ] spawn_process: at 2019-02-05 13:43:15 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2019-02-05 13:43:15 [DEBUG   ] spawn_process: at 2019-02-05 13:43:15 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2019-02-05 13:43:15 [DEBUG   ] spawn_process: at 2019-02-05 13:43:15 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2019-02-05 13:43:15 [DEBUG   ] spawn_process: at 2019-02-05 13:43:15 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2019-02-05 13:43:15 [DEBUG   ] spawn_process: at 2019-02-05 13:43:15 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2019-02-05 13:43:15 [DEBUG   ] spawn_process: at 2019-02-05 13:43:15 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2019-02-05 13:43:15 [DEBUG   ] spawn_process: at 2019-02-05 13:43:15 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2019-02-05 13:43:15 [INFO    ] Finished spawning TBW
2019-02-05 13:43:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 13:43:33 [WARNING ] (13, 1, 'bot')
2019-02-05 13:43:33 [WARNING ] (13, 1, 'bot')
2019-02-05 13:43:33 [WARNING ] (13, 1, 'bot')
2019-02-05 13:43:33 [WARNING ] (13, 1, 'bot')
2019-02-05 13:43:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 13:43:33 [DEBUG   ] Finished updating board flags in 1.798 seconds
2019-02-05 13:44:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 13:44:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 13:44:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 13:44:33 [WARNING ] (13, 1, 'bot')
2019-02-05 13:44:33 [WARNING ] (13, 1, 'bot')
2019-02-05 13:44:33 [WARNING ] (13, 1, 'bot')
2019-02-05 13:44:33 [WARNING ] (13, 1, 'bot')
2019-02-05 13:44:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 13:44:33 [DEBUG   ] Finished updating board flags in 1.702 seconds
2019-02-05 13:44:49 [DEBUG   ] Got command RPT from MCS: ref #1410120
2019-02-05 13:44:49 [DEBUG   ] summary = ERROR
2019-02-05 13:44:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410120  13 58519 49489877 A  ERRORERROR'
2019-02-05 13:44:50 [DEBUG   ] Got command RPT from MCS: ref #1410121
2019-02-05 13:44:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 13:44:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410121  77 58519 49490081 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 13:44:50 [DEBUG   ] Got command RPT from MCS: ref #1410122
2019-02-05 13:44:50 [DEBUG   ] summary = ERROR
2019-02-05 13:44:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410122  13 58519 49490285 A  ERRORERROR'
2019-02-05 13:44:50 [DEBUG   ] Got command RPT from MCS: ref #1410124
2019-02-05 13:44:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 13:44:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410124  77 58519 49490489 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 13:44:50 [DEBUG   ] Got command RPT from MCS: ref #1410125
2019-02-05 13:44:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 13:44:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410125  12 58519 49490681 A  ERRORB˜™š'
2019-02-05 13:45:03 [INFO    ] __waitForTBW - TBW finished in 108.520 s
2019-02-05 13:45:04 [DEBUG   ] Finished updating ant stats in 0.422 seconds
2019-02-05 13:45:04 [INFO    ] Started antennas statistics background thread
2019-02-05 13:45:04 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2019-02-05 13:45:04 [DEBUG   ] spawn_process: at 2019-02-05 13:45:04 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1549374306']
2019-02-05 13:45:04 [DEBUG   ] spawn_process: at 2019-02-05 13:45:04 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1549374306']
2019-02-05 13:45:04 [DEBUG   ] spawn_process: at 2019-02-05 13:45:04 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1549374306']
2019-02-05 13:45:04 [DEBUG   ] spawn_process: at 2019-02-05 13:45:04 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1549374306']
2019-02-05 13:45:04 [DEBUG   ] spawn_process: at 2019-02-05 13:45:04 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1549374306']
2019-02-05 13:45:04 [DEBUG   ] spawn_process: at 2019-02-05 13:45:04 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1549374306']
2019-02-05 13:45:04 [DEBUG   ] spawn_process: at 2019-02-05 13:45:04 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1549374306']
2019-02-05 13:45:04 [DEBUG   ] spawn_process: at 2019-02-05 13:45:04 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1549374306']
2019-02-05 13:45:04 [DEBUG   ] spawn_process: at 2019-02-05 13:45:04 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1549374306']
2019-02-05 13:45:04 [DEBUG   ] spawn_process: at 2019-02-05 13:45:04 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1549374306']
2019-02-05 13:45:04 [DEBUG   ] spawn_process: at 2019-02-05 13:45:04 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1549374306']
2019-02-05 13:45:04 [DEBUG   ] spawn_process: at 2019-02-05 13:45:04 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1549374306']
2019-02-05 13:45:04 [DEBUG   ] spawn_process: at 2019-02-05 13:45:04 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1549374306']
2019-02-05 13:45:04 [DEBUG   ] spawn_process: at 2019-02-05 13:45:04 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1549374306']
2019-02-05 13:45:04 [DEBUG   ] spawn_process: at 2019-02-05 13:45:04 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1549374306']
2019-02-05 13:45:04 [DEBUG   ] spawn_process: at 2019-02-05 13:45:04 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1549374306']
2019-02-05 13:45:04 [DEBUG   ] spawn_process: at 2019-02-05 13:45:04 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1549374306']
2019-02-05 13:45:04 [DEBUG   ] spawn_process: at 2019-02-05 13:45:04 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1549374306']
2019-02-05 13:45:04 [DEBUG   ] spawn_process: at 2019-02-05 13:45:04 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1549374306']
2019-02-05 13:45:04 [DEBUG   ] spawn_process: at 2019-02-05 13:45:04 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1549374306']
2019-02-05 13:45:04 [DEBUG   ] spawn_process: at 2019-02-05 13:45:04 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1549374306']
2019-02-05 13:45:04 [DEBUG   ] spawn_process: at 2019-02-05 13:45:04 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1549374306']
2019-02-05 13:45:04 [DEBUG   ] spawn_process: at 2019-02-05 13:45:04 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1549374306']
2019-02-05 13:45:04 [DEBUG   ] spawn_process: at 2019-02-05 13:45:04 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1549374306']
2019-02-05 13:45:04 [DEBUG   ] spawn_process: at 2019-02-05 13:45:04 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1549374306']
2019-02-05 13:45:04 [DEBUG   ] spawn_process: at 2019-02-05 13:45:04 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1549374306']
2019-02-05 13:45:04 [INFO    ] Finished spawning TBN in 0.049 s
2019-02-05 13:45:24 [DEBUG   ] Finished updating ant stats in 0.470 seconds
2019-02-05 13:45:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 13:45:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 13:45:33 [WARNING ] (13, 1, 'bot')
2019-02-05 13:45:33 [WARNING ] (13, 1, 'bot')
2019-02-05 13:45:33 [WARNING ] (13, 1, 'bot')
2019-02-05 13:45:33 [WARNING ] (13, 1, 'bot')
2019-02-05 13:45:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 13:45:33 [DEBUG   ] Finished updating board flags in 1.778 seconds
2019-02-05 13:45:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-05 13:46:04 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-02-05 13:46:11 [DEBUG   ] Got command RPT from MCS: ref #1410133
2019-02-05 13:46:11 [DEBUG   ] summary = ERROR
2019-02-05 13:46:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410133  13 58519 49571933 A  ERRORERROR'
2019-02-05 13:46:11 [DEBUG   ] Got command RPT from MCS: ref #1410134
2019-02-05 13:46:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 13:46:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410134  77 58519 49571934 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 13:46:25 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2019-02-05 13:46:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 13:46:33 [WARNING ] (13, 1, 'bot')
2019-02-05 13:46:33 [WARNING ] (13, 1, 'bot')
2019-02-05 13:46:33 [WARNING ] (13, 1, 'bot')
2019-02-05 13:46:33 [WARNING ] (13, 1, 'bot')
2019-02-05 13:46:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 13:46:33 [DEBUG   ] Finished updating board flags in 1.632 seconds
2019-02-05 13:46:45 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-02-05 13:47:05 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 13:47:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 13:47:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 13:47:33 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 13:47:33 [WARNING ] (13, 1, 'bot')
2019-02-05 13:47:33 [WARNING ] (13, 1, 'bot')
2019-02-05 13:47:33 [WARNING ] (13, 1, 'bot')
2019-02-05 13:47:33 [WARNING ] (13, 1, 'bot')
2019-02-05 13:47:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 13:47:33 [DEBUG   ] Finished updating board flags in 1.631 seconds
2019-02-05 13:47:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 13:48:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 13:48:25 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 13:48:32 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-02-05 13:48:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 13:48:33 [WARNING ] (13, 1, 'bot')
2019-02-05 13:48:33 [WARNING ] (13, 1, 'bot')
2019-02-05 13:48:33 [WARNING ] (13, 1, 'bot')
2019-02-05 13:48:33 [WARNING ] (13, 1, 'bot')
2019-02-05 13:48:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 13:48:33 [DEBUG   ] Finished updating board flags in 1.635 seconds
2019-02-05 13:48:45 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-05 13:49:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-05 13:49:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 13:49:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 13:49:33 [WARNING ] (13, 1, 'bot')
2019-02-05 13:49:33 [WARNING ] (13, 1, 'bot')
2019-02-05 13:49:33 [WARNING ] (13, 1, 'bot')
2019-02-05 13:49:33 [WARNING ] (13, 1, 'bot')
2019-02-05 13:49:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 13:49:33 [DEBUG   ] Finished updating board flags in 1.635 seconds
2019-02-05 13:49:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 13:49:49 [DEBUG   ] Got command RPT from MCS: ref #1410154
2019-02-05 13:49:49 [DEBUG   ] summary = ERROR
2019-02-05 13:49:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410154  13 58519 49789969 A  ERRORERROR'
2019-02-05 13:49:50 [DEBUG   ] Got command RPT from MCS: ref #1410155
2019-02-05 13:49:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 13:49:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410155  77 58519 49790173 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 13:49:50 [DEBUG   ] Got command RPT from MCS: ref #1410156
2019-02-05 13:49:50 [DEBUG   ] summary = ERROR
2019-02-05 13:49:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410156  13 58519 49790365 A  ERRORERROR'
2019-02-05 13:49:50 [DEBUG   ] Got command RPT from MCS: ref #1410157
2019-02-05 13:49:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 13:49:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410157  77 58519 49790569 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 13:49:50 [DEBUG   ] Got command RPT from MCS: ref #1410158
2019-02-05 13:49:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 13:49:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410158  12 58519 49790773 A  ERRORB™™š'
2019-02-05 13:50:05 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-05 13:50:25 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-05 13:50:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 13:50:33 [WARNING ] (13, 1, 'bot')
2019-02-05 13:50:33 [WARNING ] (13, 1, 'bot')
2019-02-05 13:50:33 [WARNING ] (13, 1, 'bot')
2019-02-05 13:50:33 [WARNING ] (13, 1, 'bot')
2019-02-05 13:50:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 13:50:33 [DEBUG   ] Finished updating board flags in 1.647 seconds
2019-02-05 13:50:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 13:51:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-05 13:51:11 [DEBUG   ] Got command RPT from MCS: ref #1410163
2019-02-05 13:51:11 [DEBUG   ] summary = ERROR
2019-02-05 13:51:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410163  13 58519 49871925 A  ERRORERROR'
2019-02-05 13:51:11 [DEBUG   ] Got command RPT from MCS: ref #1410164
2019-02-05 13:51:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 13:51:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410164  77 58519 49871926 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 13:51:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 13:51:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 13:51:33 [WARNING ] (13, 1, 'bot')
2019-02-05 13:51:33 [WARNING ] (13, 1, 'bot')
2019-02-05 13:51:33 [WARNING ] (13, 1, 'bot')
2019-02-05 13:51:33 [WARNING ] (13, 1, 'bot')
2019-02-05 13:51:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 13:51:33 [DEBUG   ] Finished updating board flags in 1.643 seconds
2019-02-05 13:51:45 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-02-05 13:52:05 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-05 13:52:25 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2019-02-05 13:52:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 13:52:34 [WARNING ] (13, 1, 'bot')
2019-02-05 13:52:34 [WARNING ] (13, 1, 'bot')
2019-02-05 13:52:34 [WARNING ] (13, 1, 'bot')
2019-02-05 13:52:34 [WARNING ] (13, 1, 'bot')
2019-02-05 13:52:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 13:52:34 [DEBUG   ] Finished updating board flags in 1.635 seconds
2019-02-05 13:52:45 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-02-05 13:53:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 13:53:26 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 13:53:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 13:53:34 [WARNING ] (13, 1, 'bot')
2019-02-05 13:53:34 [WARNING ] (13, 1, 'bot')
2019-02-05 13:53:34 [WARNING ] (13, 1, 'bot')
2019-02-05 13:53:34 [WARNING ] (13, 1, 'bot')
2019-02-05 13:53:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 13:53:34 [DEBUG   ] Finished updating board flags in 1.635 seconds
2019-02-05 13:53:46 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-02-05 13:54:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 13:54:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 13:54:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 13:54:34 [WARNING ] (13, 1, 'bot')
2019-02-05 13:54:34 [WARNING ] (13, 1, 'bot')
2019-02-05 13:54:34 [WARNING ] (13, 1, 'bot')
2019-02-05 13:54:34 [WARNING ] (13, 1, 'bot')
2019-02-05 13:54:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 13:54:34 [DEBUG   ] Finished updating board flags in 2.345 seconds
2019-02-05 13:54:46 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 13:54:50 [DEBUG   ] Got command RPT from MCS: ref #1410186
2019-02-05 13:54:50 [DEBUG   ] summary = ERROR
2019-02-05 13:54:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410186  13 58519 50090053 A  ERRORERROR'
2019-02-05 13:54:50 [DEBUG   ] Got command RPT from MCS: ref #1410187
2019-02-05 13:54:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 13:54:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410187  77 58519 50090257 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 13:54:50 [DEBUG   ] Got command RPT from MCS: ref #1410188
2019-02-05 13:54:50 [DEBUG   ] summary = ERROR
2019-02-05 13:54:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410188  13 58519 50090461 A  ERRORERROR'
2019-02-05 13:54:50 [DEBUG   ] Got command RPT from MCS: ref #1410190
2019-02-05 13:54:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 13:54:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410190  77 58519 50090664 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 13:54:50 [DEBUG   ] Got command RPT from MCS: ref #1410192
2019-02-05 13:54:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 13:54:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410192  12 58519 50090853 A  ERRORB™™š'
2019-02-05 13:55:06 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2019-02-05 13:55:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 13:55:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 13:55:34 [WARNING ] (13, 1, 'bot')
2019-02-05 13:55:34 [WARNING ] (13, 1, 'bot')
2019-02-05 13:55:34 [WARNING ] (13, 1, 'bot')
2019-02-05 13:55:34 [WARNING ] (13, 1, 'bot')
2019-02-05 13:55:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 13:55:34 [DEBUG   ] Finished updating board flags in 2.055 seconds
2019-02-05 13:55:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 13:56:06 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-05 13:56:11 [DEBUG   ] Got command RPT from MCS: ref #1410200
2019-02-05 13:56:11 [DEBUG   ] summary = ERROR
2019-02-05 13:56:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410200  13 58519 50171933 A  ERRORERROR'
2019-02-05 13:56:11 [DEBUG   ] Got command RPT from MCS: ref #1410201
2019-02-05 13:56:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 13:56:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410201  77 58519 50171934 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 13:56:26 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-05 13:56:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 13:56:34 [WARNING ] (13, 1, 'bot')
2019-02-05 13:56:34 [WARNING ] (13, 1, 'bot')
2019-02-05 13:56:34 [WARNING ] (13, 1, 'bot')
2019-02-05 13:56:34 [WARNING ] (13, 1, 'bot')
2019-02-05 13:56:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 13:56:34 [DEBUG   ] Finished updating board flags in 2.000 seconds
2019-02-05 13:56:46 [DEBUG   ] Finished updating ant stats in 0.534 seconds
2019-02-05 13:57:06 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 13:57:26 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-02-05 13:57:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 13:57:34 [WARNING ] (13, 1, 'bot')
2019-02-05 13:57:34 [WARNING ] (13, 1, 'bot')
2019-02-05 13:57:34 [WARNING ] (13, 1, 'bot')
2019-02-05 13:57:34 [WARNING ] (13, 1, 'bot')
2019-02-05 13:57:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 13:57:34 [DEBUG   ] Finished updating board flags in 1.812 seconds
2019-02-05 13:57:47 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-02-05 13:58:07 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 13:58:27 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-05 13:58:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 13:58:34 [WARNING ] (13, 1, 'bot')
2019-02-05 13:58:34 [WARNING ] (13, 1, 'bot')
2019-02-05 13:58:34 [WARNING ] (13, 1, 'bot')
2019-02-05 13:58:34 [WARNING ] (13, 1, 'bot')
2019-02-05 13:58:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 13:58:34 [DEBUG   ] Finished updating board flags in 1.781 seconds
2019-02-05 13:58:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 13:59:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 13:59:27 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 13:59:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 13:59:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 13:59:34 [WARNING ] (13, 1, 'bot')
2019-02-05 13:59:34 [WARNING ] (13, 1, 'bot')
2019-02-05 13:59:34 [WARNING ] (13, 1, 'bot')
2019-02-05 13:59:34 [WARNING ] (13, 1, 'bot')
2019-02-05 13:59:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 13:59:34 [DEBUG   ] Finished updating board flags in 1.612 seconds
2019-02-05 13:59:47 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-05 13:59:50 [DEBUG   ] Got command RPT from MCS: ref #1410221
2019-02-05 13:59:50 [DEBUG   ] summary = ERROR
2019-02-05 13:59:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410221  13 58519 50390145 A  ERRORERROR'
2019-02-05 13:59:50 [DEBUG   ] Got command RPT from MCS: ref #1410222
2019-02-05 13:59:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 13:59:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410222  77 58519 50390337 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 13:59:50 [DEBUG   ] Got command RPT from MCS: ref #1410223
2019-02-05 13:59:50 [DEBUG   ] summary = ERROR
2019-02-05 13:59:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410223  13 58519 50390541 A  ERRORERROR'
2019-02-05 13:59:50 [DEBUG   ] Got command RPT from MCS: ref #1410224
2019-02-05 13:59:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 13:59:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410224  77 58519 50390745 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 13:59:50 [DEBUG   ] Got command RPT from MCS: ref #1410225
2019-02-05 13:59:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 13:59:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410225  12 58519 50390949 A  ERRORB™™š'
2019-02-05 14:00:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 14:00:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 14:00:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 14:00:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-02-05 14:00:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:00:34 [WARNING ] (13, 1, 'bot')
2019-02-05 14:00:34 [WARNING ] (13, 1, 'bot')
2019-02-05 14:00:34 [WARNING ] (13, 1, 'bot')
2019-02-05 14:00:34 [WARNING ] (13, 1, 'bot')
2019-02-05 14:00:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:00:34 [DEBUG   ] Finished updating board flags in 1.593 seconds
2019-02-05 14:00:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-05 14:01:07 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-05 14:01:11 [DEBUG   ] Got command RPT from MCS: ref #1410231
2019-02-05 14:01:11 [DEBUG   ] summary = ERROR
2019-02-05 14:01:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410231  13 58519 50471937 A  ERRORERROR'
2019-02-05 14:01:11 [DEBUG   ] Got command RPT from MCS: ref #1410232
2019-02-05 14:01:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 14:01:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410232  77 58519 50471938 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 14:01:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 14:01:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 14:01:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:01:34 [WARNING ] (13, 1, 'bot')
2019-02-05 14:01:34 [WARNING ] (13, 1, 'bot')
2019-02-05 14:01:34 [WARNING ] (13, 1, 'bot')
2019-02-05 14:01:34 [WARNING ] (13, 1, 'bot')
2019-02-05 14:01:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:01:34 [DEBUG   ] Finished updating board flags in 1.405 seconds
2019-02-05 14:01:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 14:02:07 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-05 14:02:27 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 14:02:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 14:02:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:02:34 [WARNING ] (13, 1, 'bot')
2019-02-05 14:02:34 [WARNING ] (13, 1, 'bot')
2019-02-05 14:02:34 [WARNING ] (13, 1, 'bot')
2019-02-05 14:02:34 [WARNING ] (13, 1, 'bot')
2019-02-05 14:02:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:02:34 [DEBUG   ] Finished updating board flags in 1.418 seconds
2019-02-05 14:02:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-05 14:03:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 14:03:27 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-05 14:03:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:03:34 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 14:03:34 [WARNING ] (13, 1, 'bot')
2019-02-05 14:03:34 [WARNING ] (13, 1, 'bot')
2019-02-05 14:03:34 [WARNING ] (13, 1, 'bot')
2019-02-05 14:03:34 [WARNING ] (13, 1, 'bot')
2019-02-05 14:03:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:03:34 [DEBUG   ] Finished updating board flags in 1.373 seconds
2019-02-05 14:03:47 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-02-05 14:04:08 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-02-05 14:04:27 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2019-02-05 14:04:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 14:04:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:04:34 [WARNING ] (13, 1, 'bot')
2019-02-05 14:04:34 [WARNING ] (13, 1, 'bot')
2019-02-05 14:04:34 [WARNING ] (13, 1, 'bot')
2019-02-05 14:04:34 [WARNING ] (13, 1, 'bot')
2019-02-05 14:04:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:04:34 [DEBUG   ] Finished updating board flags in 1.365 seconds
2019-02-05 14:04:47 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-02-05 14:04:50 [DEBUG   ] Got command RPT from MCS: ref #1410259
2019-02-05 14:04:50 [DEBUG   ] summary = ERROR
2019-02-05 14:04:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410259  13 58519 50690225 A  ERRORERROR'
2019-02-05 14:04:50 [DEBUG   ] Got command RPT from MCS: ref #1410260
2019-02-05 14:04:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 14:04:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410260  77 58519 50690429 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 14:04:50 [DEBUG   ] Got command RPT from MCS: ref #1410261
2019-02-05 14:04:50 [DEBUG   ] summary = ERROR
2019-02-05 14:04:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410261  13 58519 50690645 A  ERRORERROR'
2019-02-05 14:04:50 [DEBUG   ] Got command RPT from MCS: ref #1410263
2019-02-05 14:04:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 14:04:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410263  77 58519 50690833 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 14:04:51 [DEBUG   ] Got command RPT from MCS: ref #1410264
2019-02-05 14:04:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 14:04:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410264  12 58519 50691037 A  ERRORB™™š'
2019-02-05 14:05:08 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-02-05 14:05:28 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-02-05 14:05:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:05:35 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 14:05:35 [WARNING ] (13, 1, 'bot')
2019-02-05 14:05:35 [WARNING ] (13, 1, 'bot')
2019-02-05 14:05:35 [WARNING ] (13, 1, 'bot')
2019-02-05 14:05:35 [WARNING ] (13, 1, 'bot')
2019-02-05 14:05:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:05:35 [DEBUG   ] Finished updating board flags in 2.053 seconds
2019-02-05 14:05:48 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 14:06:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 14:06:11 [DEBUG   ] Got command RPT from MCS: ref #1410273
2019-02-05 14:06:11 [DEBUG   ] summary = ERROR
2019-02-05 14:06:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410273  13 58519 50771933 A  ERRORERROR'
2019-02-05 14:06:11 [DEBUG   ] Got command RPT from MCS: ref #1410274
2019-02-05 14:06:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 14:06:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410274  77 58519 50771934 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 14:06:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 14:06:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 14:06:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:06:35 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 14:06:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2019-02-05 14:06:35 [WARNING ] (13, 1, 'bot')
2019-02-05 14:06:35 [WARNING ] (13, 1, 'bot')
2019-02-05 14:06:35 [WARNING ] (13, 1, 'bot')
2019-02-05 14:06:35 [WARNING ] (13, 1, 'bot')
2019-02-05 14:06:35 [WARNING ] (25, 5, 'bot')
2019-02-05 14:06:35 [WARNING ] (25, 5, 'bot')
2019-02-05 14:06:35 [WARNING ] (25, 5, 'bot')
2019-02-05 14:06:35 [WARNING ] (25, 5, 'bot')
2019-02-05 14:06:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:06:35 [DEBUG   ] Finished updating board flags in 2.058 seconds
2019-02-05 14:06:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 14:07:08 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 14:07:28 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-05 14:07:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 14:07:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:07:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 14:07:35 [WARNING ] (13, 1, 'bot')
2019-02-05 14:07:35 [WARNING ] (13, 1, 'bot')
2019-02-05 14:07:35 [WARNING ] (13, 1, 'bot')
2019-02-05 14:07:35 [WARNING ] (13, 1, 'bot')
2019-02-05 14:07:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:07:35 [DEBUG   ] Finished updating board flags in 1.941 seconds
2019-02-05 14:07:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 14:08:08 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 14:08:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 14:08:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 14:08:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:08:35 [WARNING ] (13, 1, 'bot')
2019-02-05 14:08:35 [WARNING ] (13, 1, 'bot')
2019-02-05 14:08:35 [WARNING ] (13, 1, 'bot')
2019-02-05 14:08:35 [WARNING ] (13, 1, 'bot')
2019-02-05 14:08:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:08:35 [DEBUG   ] Finished updating board flags in 1.855 seconds
2019-02-05 14:08:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 14:09:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 14:09:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 14:09:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:09:35 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 14:09:35 [WARNING ] (13, 1, 'bot')
2019-02-05 14:09:35 [WARNING ] (13, 1, 'bot')
2019-02-05 14:09:35 [WARNING ] (13, 1, 'bot')
2019-02-05 14:09:35 [WARNING ] (13, 1, 'bot')
2019-02-05 14:09:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:09:35 [DEBUG   ] Finished updating board flags in 1.810 seconds
2019-02-05 14:09:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 14:09:50 [DEBUG   ] Got command RPT from MCS: ref #1410294
2019-02-05 14:09:50 [DEBUG   ] summary = ERROR
2019-02-05 14:09:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410294  13 58519 50990318 A  ERRORERROR'
2019-02-05 14:09:50 [DEBUG   ] Got command RPT from MCS: ref #1410295
2019-02-05 14:09:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 14:09:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410295  77 58519 50990509 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 14:09:50 [DEBUG   ] Got command RPT from MCS: ref #1410296
2019-02-05 14:09:50 [DEBUG   ] summary = ERROR
2019-02-05 14:09:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410296  13 58519 50990713 A  ERRORERROR'
2019-02-05 14:09:50 [DEBUG   ] Got command RPT from MCS: ref #1410297
2019-02-05 14:09:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 14:09:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410297  77 58519 50990917 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 14:09:51 [DEBUG   ] Got command RPT from MCS: ref #1410298
2019-02-05 14:09:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 14:09:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410298  12 58519 50991121 A  ERRORB™™š'
2019-02-05 14:10:08 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-05 14:10:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 14:10:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:10:35 [WARNING ] (13, 1, 'bot')
2019-02-05 14:10:35 [WARNING ] (13, 1, 'bot')
2019-02-05 14:10:35 [WARNING ] (13, 1, 'bot')
2019-02-05 14:10:35 [WARNING ] (13, 1, 'bot')
2019-02-05 14:10:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:10:35 [DEBUG   ] Finished updating board flags in 1.731 seconds
2019-02-05 14:10:48 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-05 14:11:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-05 14:11:11 [DEBUG   ] Got command RPT from MCS: ref #1410303
2019-02-05 14:11:11 [DEBUG   ] summary = ERROR
2019-02-05 14:11:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410303  13 58519 51071929 A  ERRORERROR'
2019-02-05 14:11:11 [DEBUG   ] Got command RPT from MCS: ref #1410304
2019-02-05 14:11:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 14:11:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410304  77 58519 51071930 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 14:11:28 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-05 14:11:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:11:35 [WARNING ] (13, 1, 'bot')
2019-02-05 14:11:35 [WARNING ] (13, 1, 'bot')
2019-02-05 14:11:35 [WARNING ] (13, 1, 'bot')
2019-02-05 14:11:35 [WARNING ] (13, 1, 'bot')
2019-02-05 14:11:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:11:35 [DEBUG   ] Finished updating board flags in 1.620 seconds
2019-02-05 14:11:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 14:12:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 14:12:28 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-05 14:12:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:12:35 [WARNING ] (13, 1, 'bot')
2019-02-05 14:12:35 [WARNING ] (13, 1, 'bot')
2019-02-05 14:12:35 [WARNING ] (13, 1, 'bot')
2019-02-05 14:12:35 [WARNING ] (13, 1, 'bot')
2019-02-05 14:12:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:12:35 [DEBUG   ] Finished updating board flags in 1.598 seconds
2019-02-05 14:12:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 14:13:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 14:13:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 14:13:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:13:35 [WARNING ] (13, 1, 'bot')
2019-02-05 14:13:35 [WARNING ] (13, 1, 'bot')
2019-02-05 14:13:35 [WARNING ] (13, 1, 'bot')
2019-02-05 14:13:35 [WARNING ] (13, 1, 'bot')
2019-02-05 14:13:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:13:35 [DEBUG   ] Finished updating board flags in 1.400 seconds
2019-02-05 14:13:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-05 14:14:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 14:14:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 14:14:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:14:35 [WARNING ] (13, 1, 'bot')
2019-02-05 14:14:35 [WARNING ] (13, 1, 'bot')
2019-02-05 14:14:35 [WARNING ] (13, 1, 'bot')
2019-02-05 14:14:35 [WARNING ] (13, 1, 'bot')
2019-02-05 14:14:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:14:35 [DEBUG   ] Finished updating board flags in 1.425 seconds
2019-02-05 14:14:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 14:14:50 [DEBUG   ] Got command RPT from MCS: ref #1410326
2019-02-05 14:14:50 [DEBUG   ] summary = ERROR
2019-02-05 14:14:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410326  13 58519 51290397 A  ERRORERROR'
2019-02-05 14:14:50 [DEBUG   ] Got command RPT from MCS: ref #1410327
2019-02-05 14:14:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 14:14:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410327  77 58519 51290602 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 14:14:50 [DEBUG   ] Got command RPT from MCS: ref #1410328
2019-02-05 14:14:50 [DEBUG   ] summary = ERROR
2019-02-05 14:14:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410328  13 58519 51290805 A  ERRORERROR'
2019-02-05 14:14:50 [DEBUG   ] Got command RPT from MCS: ref #1410330
2019-02-05 14:14:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 14:14:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410330  77 58519 51290997 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 14:14:51 [DEBUG   ] Got command RPT from MCS: ref #1410331
2019-02-05 14:14:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 14:14:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410331  12 58519 51291201 A  ERRORB˜™š'
2019-02-05 14:15:08 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-05 14:15:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 14:15:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:15:36 [WARNING ] (13, 1, 'bot')
2019-02-05 14:15:36 [WARNING ] (13, 1, 'bot')
2019-02-05 14:15:36 [WARNING ] (13, 1, 'bot')
2019-02-05 14:15:36 [WARNING ] (13, 1, 'bot')
2019-02-05 14:15:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:15:36 [DEBUG   ] Finished updating board flags in 2.304 seconds
2019-02-05 14:15:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 14:16:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 14:16:11 [DEBUG   ] Got command RPT from MCS: ref #1410336
2019-02-05 14:16:11 [DEBUG   ] summary = ERROR
2019-02-05 14:16:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410336  13 58519 51371933 A  ERRORERROR'
2019-02-05 14:16:11 [DEBUG   ] Got command RPT from MCS: ref #1410337
2019-02-05 14:16:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 14:16:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410337  77 58519 51371934 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 14:16:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 14:16:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:16:36 [WARNING ] (13, 1, 'bot')
2019-02-05 14:16:36 [WARNING ] (13, 1, 'bot')
2019-02-05 14:16:36 [WARNING ] (13, 1, 'bot')
2019-02-05 14:16:36 [WARNING ] (13, 1, 'bot')
2019-02-05 14:16:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:16:36 [DEBUG   ] Finished updating board flags in 2.096 seconds
2019-02-05 14:16:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 14:17:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 14:17:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 14:17:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:17:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2019-02-05 14:17:36 [WARNING ] (13, 1, 'bot')
2019-02-05 14:17:36 [WARNING ] (13, 1, 'bot')
2019-02-05 14:17:36 [WARNING ] (13, 1, 'bot')
2019-02-05 14:17:36 [WARNING ] (13, 1, 'bot')
2019-02-05 14:17:36 [WARNING ] (25, 5, 'bot')
2019-02-05 14:17:36 [WARNING ] (25, 5, 'bot')
2019-02-05 14:17:36 [WARNING ] (25, 5, 'bot')
2019-02-05 14:17:36 [WARNING ] (25, 5, 'bot')
2019-02-05 14:17:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:17:36 [DEBUG   ] Finished updating board flags in 2.010 seconds
2019-02-05 14:17:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-05 14:18:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 14:18:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 14:18:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:18:36 [WARNING ] (13, 1, 'bot')
2019-02-05 14:18:36 [WARNING ] (13, 1, 'bot')
2019-02-05 14:18:36 [WARNING ] (13, 1, 'bot')
2019-02-05 14:18:36 [WARNING ] (13, 1, 'bot')
2019-02-05 14:18:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:18:36 [DEBUG   ] Finished updating board flags in 1.980 seconds
2019-02-05 14:18:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 14:19:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 14:19:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 14:19:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 14:19:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:19:36 [WARNING ] (13, 1, 'bot')
2019-02-05 14:19:36 [WARNING ] (13, 1, 'bot')
2019-02-05 14:19:36 [WARNING ] (13, 1, 'bot')
2019-02-05 14:19:36 [WARNING ] (13, 1, 'bot')
2019-02-05 14:19:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:19:36 [DEBUG   ] Finished updating board flags in 1.816 seconds
2019-02-05 14:19:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 14:19:50 [DEBUG   ] Got command RPT from MCS: ref #1410357
2019-02-05 14:19:50 [DEBUG   ] summary = ERROR
2019-02-05 14:19:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410357  13 58519 51590485 A  ERRORERROR'
2019-02-05 14:19:50 [DEBUG   ] Got command RPT from MCS: ref #1410358
2019-02-05 14:19:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 14:19:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410358  77 58519 51590689 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 14:19:50 [DEBUG   ] Got command RPT from MCS: ref #1410359
2019-02-05 14:19:50 [DEBUG   ] summary = ERROR
2019-02-05 14:19:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410359  13 58519 51590893 A  ERRORERROR'
2019-02-05 14:19:51 [DEBUG   ] Got command RPT from MCS: ref #1410360
2019-02-05 14:19:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 14:19:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410360  77 58519 51591085 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 14:19:51 [DEBUG   ] Got command RPT from MCS: ref #1410361
2019-02-05 14:19:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 14:19:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410361  12 58519 51591289 A  ERRORB™™š'
2019-02-05 14:20:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 14:20:28 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-02-05 14:20:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:20:36 [WARNING ] (13, 1, 'bot')
2019-02-05 14:20:36 [WARNING ] (13, 1, 'bot')
2019-02-05 14:20:36 [WARNING ] (13, 1, 'bot')
2019-02-05 14:20:36 [WARNING ] (13, 1, 'bot')
2019-02-05 14:20:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:20:36 [DEBUG   ] Finished updating board flags in 1.875 seconds
2019-02-05 14:20:48 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-05 14:21:09 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-02-05 14:21:11 [DEBUG   ] Got command RPT from MCS: ref #1410366
2019-02-05 14:21:11 [DEBUG   ] summary = ERROR
2019-02-05 14:21:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410366  13 58519 51671933 A  ERRORERROR'
2019-02-05 14:21:11 [DEBUG   ] Got command RPT from MCS: ref #1410367
2019-02-05 14:21:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 14:21:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410367  77 58519 51671934 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 14:21:29 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-02-05 14:21:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:21:36 [WARNING ] (13, 1, 'bot')
2019-02-05 14:21:36 [WARNING ] (13, 1, 'bot')
2019-02-05 14:21:36 [WARNING ] (13, 1, 'bot')
2019-02-05 14:21:36 [WARNING ] (13, 1, 'bot')
2019-02-05 14:21:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:21:36 [DEBUG   ] Finished updating board flags in 1.718 seconds
2019-02-05 14:21:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 14:22:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 14:22:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 14:22:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:22:36 [WARNING ] (13, 1, 'bot')
2019-02-05 14:22:36 [WARNING ] (13, 1, 'bot')
2019-02-05 14:22:36 [WARNING ] (13, 1, 'bot')
2019-02-05 14:22:36 [WARNING ] (13, 1, 'bot')
2019-02-05 14:22:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:22:36 [DEBUG   ] Finished updating board flags in 1.606 seconds
2019-02-05 14:22:49 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 14:23:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 14:23:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 14:23:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:23:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 14:23:36 [WARNING ] (13, 1, 'bot')
2019-02-05 14:23:36 [WARNING ] (13, 1, 'bot')
2019-02-05 14:23:36 [WARNING ] (13, 1, 'bot')
2019-02-05 14:23:36 [WARNING ] (13, 1, 'bot')
2019-02-05 14:23:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:23:36 [DEBUG   ] Finished updating board flags in 1.619 seconds
2019-02-05 14:23:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 14:24:09 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 14:24:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 14:24:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 14:24:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:24:36 [WARNING ] (13, 1, 'bot')
2019-02-05 14:24:36 [WARNING ] (13, 1, 'bot')
2019-02-05 14:24:36 [WARNING ] (13, 1, 'bot')
2019-02-05 14:24:36 [WARNING ] (13, 1, 'bot')
2019-02-05 14:24:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:24:36 [DEBUG   ] Finished updating board flags in 1.585 seconds
2019-02-05 14:24:49 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-05 14:24:50 [DEBUG   ] Got command RPT from MCS: ref #1410389
2019-02-05 14:24:50 [DEBUG   ] summary = ERROR
2019-02-05 14:24:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410389  13 58519 51890569 A  ERRORERROR'
2019-02-05 14:24:50 [DEBUG   ] Got command RPT from MCS: ref #1410390
2019-02-05 14:24:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 14:24:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410390  77 58519 51890773 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 14:24:50 [DEBUG   ] Got command RPT from MCS: ref #1410391
2019-02-05 14:24:50 [DEBUG   ] summary = ERROR
2019-02-05 14:24:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410391  13 58519 51890977 A  ERRORERROR'
2019-02-05 14:24:51 [DEBUG   ] Got command RPT from MCS: ref #1410393
2019-02-05 14:24:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 14:24:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410393  77 58519 51891169 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 14:24:51 [DEBUG   ] Got command RPT from MCS: ref #1410394
2019-02-05 14:24:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 14:24:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410394  12 58519 51891373 A  ERRORB™™š'
2019-02-05 14:25:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 14:25:29 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 14:25:35 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 14:25:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:25:36 [WARNING ] (13, 1, 'bot')
2019-02-05 14:25:36 [WARNING ] (13, 1, 'bot')
2019-02-05 14:25:36 [WARNING ] (13, 1, 'bot')
2019-02-05 14:25:36 [WARNING ] (13, 1, 'bot')
2019-02-05 14:25:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:25:36 [DEBUG   ] Finished updating board flags in 1.533 seconds
2019-02-05 14:25:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 14:26:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 14:26:11 [DEBUG   ] Got command RPT from MCS: ref #1410403
2019-02-05 14:26:11 [DEBUG   ] summary = ERROR
2019-02-05 14:26:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410403  13 58519 51971941 A  ERRORERROR'
2019-02-05 14:26:11 [DEBUG   ] Got command RPT from MCS: ref #1410404
2019-02-05 14:26:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 14:26:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410404  77 58519 51971942 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 14:26:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 14:26:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:26:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2019-02-05 14:26:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-02-05 14:26:36 [WARNING ] (13, 1, 'bot')
2019-02-05 14:26:36 [WARNING ] (13, 1, 'bot')
2019-02-05 14:26:36 [WARNING ] (13, 1, 'bot')
2019-02-05 14:26:36 [WARNING ] (13, 1, 'bot')
2019-02-05 14:26:36 [WARNING ] (25, 5, 'bot')
2019-02-05 14:26:36 [WARNING ] (25, 5, 'bot')
2019-02-05 14:26:36 [WARNING ] (25, 5, 'bot')
2019-02-05 14:26:36 [WARNING ] (25, 5, 'bot')
2019-02-05 14:26:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:26:36 [DEBUG   ] Finished updating board flags in 1.581 seconds
2019-02-05 14:26:49 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 14:27:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 14:27:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 14:27:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:27:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-05 14:27:37 [WARNING ] (13, 1, 'bot')
2019-02-05 14:27:37 [WARNING ] (13, 1, 'bot')
2019-02-05 14:27:37 [WARNING ] (13, 1, 'bot')
2019-02-05 14:27:37 [WARNING ] (13, 1, 'bot')
2019-02-05 14:27:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:27:37 [DEBUG   ] Finished updating board flags in 2.190 seconds
2019-02-05 14:27:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 14:28:09 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 14:28:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 14:28:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:28:37 [WARNING ] (13, 1, 'bot')
2019-02-05 14:28:37 [WARNING ] (13, 1, 'bot')
2019-02-05 14:28:37 [WARNING ] (13, 1, 'bot')
2019-02-05 14:28:37 [WARNING ] (13, 1, 'bot')
2019-02-05 14:28:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:28:37 [DEBUG   ] Finished updating board flags in 2.026 seconds
2019-02-05 14:28:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 14:29:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 14:29:29 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 14:29:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 14:29:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:29:37 [WARNING ] (13, 1, 'bot')
2019-02-05 14:29:37 [WARNING ] (13, 1, 'bot')
2019-02-05 14:29:37 [WARNING ] (13, 1, 'bot')
2019-02-05 14:29:37 [WARNING ] (13, 1, 'bot')
2019-02-05 14:29:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:29:37 [DEBUG   ] Finished updating board flags in 1.869 seconds
2019-02-05 14:29:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 14:29:50 [DEBUG   ] Got command RPT from MCS: ref #1410424
2019-02-05 14:29:50 [DEBUG   ] summary = ERROR
2019-02-05 14:29:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410424  13 58519 52190653 A  ERRORERROR'
2019-02-05 14:29:50 [DEBUG   ] Got command RPT from MCS: ref #1410425
2019-02-05 14:29:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 14:29:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410425  77 58519 52190857 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 14:29:51 [DEBUG   ] Got command RPT from MCS: ref #1410426
2019-02-05 14:29:51 [DEBUG   ] summary = ERROR
2019-02-05 14:29:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410426  13 58519 52191049 A  ERRORERROR'
2019-02-05 14:29:51 [DEBUG   ] Got command RPT from MCS: ref #1410427
2019-02-05 14:29:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 14:29:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410427  77 58519 52191253 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 14:29:51 [DEBUG   ] Got command RPT from MCS: ref #1410428
2019-02-05 14:29:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 14:29:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410428  12 58519 52191457 A  ERRORB™™š'
2019-02-05 14:30:09 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-05 14:30:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 14:30:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:30:37 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 14:30:37 [WARNING ] (13, 1, 'bot')
2019-02-05 14:30:37 [WARNING ] (13, 1, 'bot')
2019-02-05 14:30:37 [WARNING ] (13, 1, 'bot')
2019-02-05 14:30:37 [WARNING ] (13, 1, 'bot')
2019-02-05 14:30:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:30:37 [DEBUG   ] Finished updating board flags in 1.834 seconds
2019-02-05 14:30:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 14:31:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 14:31:11 [DEBUG   ] Got command RPT from MCS: ref #1410429
2019-02-05 14:31:11 [DEBUG   ] summary = ERROR
2019-02-05 14:31:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410429  13 58519 52271933 A  ERRORERROR'
2019-02-05 14:31:11 [DEBUG   ] Got command RPT from MCS: ref #1410430
2019-02-05 14:31:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 14:31:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410430  77 58519 52271934 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 14:31:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 14:31:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:31:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-02-05 14:31:37 [WARNING ] (13, 1, 'bot')
2019-02-05 14:31:37 [WARNING ] (13, 1, 'bot')
2019-02-05 14:31:37 [WARNING ] (13, 1, 'bot')
2019-02-05 14:31:37 [WARNING ] (13, 1, 'bot')
2019-02-05 14:31:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:31:37 [DEBUG   ] Finished updating board flags in 1.765 seconds
2019-02-05 14:31:49 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-02-05 14:32:09 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 14:32:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 14:32:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 14:32:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:32:37 [WARNING ] (13, 1, 'bot')
2019-02-05 14:32:37 [WARNING ] (13, 1, 'bot')
2019-02-05 14:32:37 [WARNING ] (13, 1, 'bot')
2019-02-05 14:32:37 [WARNING ] (13, 1, 'bot')
2019-02-05 14:32:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:32:37 [DEBUG   ] Finished updating board flags in 1.620 seconds
2019-02-05 14:32:49 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-05 14:33:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 14:33:29 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 14:33:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:33:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-02-05 14:33:37 [WARNING ] (13, 1, 'bot')
2019-02-05 14:33:37 [WARNING ] (13, 1, 'bot')
2019-02-05 14:33:37 [WARNING ] (13, 1, 'bot')
2019-02-05 14:33:37 [WARNING ] (13, 1, 'bot')
2019-02-05 14:33:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:33:37 [DEBUG   ] Finished updating board flags in 1.590 seconds
2019-02-05 14:33:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 14:34:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 14:34:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 14:34:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:34:37 [WARNING ] (13, 1, 'bot')
2019-02-05 14:34:37 [WARNING ] (13, 1, 'bot')
2019-02-05 14:34:37 [WARNING ] (13, 1, 'bot')
2019-02-05 14:34:37 [WARNING ] (13, 1, 'bot')
2019-02-05 14:34:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:34:37 [DEBUG   ] Finished updating board flags in 1.583 seconds
2019-02-05 14:34:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 14:34:50 [DEBUG   ] Got command RPT from MCS: ref #1410452
2019-02-05 14:34:50 [DEBUG   ] summary = ERROR
2019-02-05 14:34:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410452  13 58519 52490733 A  ERRORERROR'
2019-02-05 14:34:50 [DEBUG   ] Got command RPT from MCS: ref #1410453
2019-02-05 14:34:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 14:34:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410453  77 58519 52490937 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 14:34:51 [DEBUG   ] Got command RPT from MCS: ref #1410454
2019-02-05 14:34:51 [DEBUG   ] summary = ERROR
2019-02-05 14:34:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410454  13 58519 52491141 A  ERRORERROR'
2019-02-05 14:34:51 [DEBUG   ] Got command RPT from MCS: ref #1410456
2019-02-05 14:34:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 14:34:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410456  77 58519 52491333 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 14:34:51 [DEBUG   ] Got command RPT from MCS: ref #1410457
2019-02-05 14:34:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 14:34:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410457  12 58519 52491537 A  ERRORB™™š'
2019-02-05 14:35:09 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 14:35:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 14:35:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:35:37 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 14:35:38 [WARNING ] (13, 1, 'bot')
2019-02-05 14:35:38 [WARNING ] (13, 1, 'bot')
2019-02-05 14:35:38 [WARNING ] (13, 1, 'bot')
2019-02-05 14:35:38 [WARNING ] (13, 1, 'bot')
2019-02-05 14:35:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:35:38 [DEBUG   ] Finished updating board flags in 1.582 seconds
2019-02-05 14:35:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 14:36:00 [DEBUG   ] Got command TBN from MCS: ref #1410466
2019-02-05 14:36:00 [DEBUG   ] spawn_process: at 2019-02-05 14:36:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1549377362']
2019-02-05 14:36:00 [DEBUG   ] spawn_process: at 2019-02-05 14:36:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1549377362']
2019-02-05 14:36:00 [DEBUG   ] tbn = exited with status True, code 0x00
2019-02-05 14:36:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN  1410466   8 58519 52560514 A  ERROR'
2019-02-05 14:36:00 [DEBUG   ] spawn_process: at 2019-02-05 14:36:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1549377362']
2019-02-05 14:36:00 [DEBUG   ] spawn_process: at 2019-02-05 14:36:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1549377362']
2019-02-05 14:36:00 [DEBUG   ] spawn_process: at 2019-02-05 14:36:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1549377362']
2019-02-05 14:36:00 [DEBUG   ] spawn_process: at 2019-02-05 14:36:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1549377362']
2019-02-05 14:36:00 [DEBUG   ] spawn_process: at 2019-02-05 14:36:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1549377362']
2019-02-05 14:36:00 [DEBUG   ] spawn_process: at 2019-02-05 14:36:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1549377362']
2019-02-05 14:36:00 [DEBUG   ] spawn_process: at 2019-02-05 14:36:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1549377362']
2019-02-05 14:36:00 [DEBUG   ] spawn_process: at 2019-02-05 14:36:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1549377362']
2019-02-05 14:36:00 [DEBUG   ] spawn_process: at 2019-02-05 14:36:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1549377362']
2019-02-05 14:36:00 [DEBUG   ] spawn_process: at 2019-02-05 14:36:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1549377362']
2019-02-05 14:36:00 [DEBUG   ] spawn_process: at 2019-02-05 14:36:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1549377362']
2019-02-05 14:36:00 [DEBUG   ] spawn_process: at 2019-02-05 14:36:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1549377362']
2019-02-05 14:36:00 [DEBUG   ] spawn_process: at 2019-02-05 14:36:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1549377362']
2019-02-05 14:36:00 [DEBUG   ] spawn_process: at 2019-02-05 14:36:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1549377362']
2019-02-05 14:36:00 [DEBUG   ] spawn_process: at 2019-02-05 14:36:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1549377362']
2019-02-05 14:36:00 [DEBUG   ] spawn_process: at 2019-02-05 14:36:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1549377362']
2019-02-05 14:36:00 [DEBUG   ] spawn_process: at 2019-02-05 14:36:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1549377362']
2019-02-05 14:36:00 [DEBUG   ] spawn_process: at 2019-02-05 14:36:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1549377362']
2019-02-05 14:36:00 [DEBUG   ] spawn_process: at 2019-02-05 14:36:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1549377362']
2019-02-05 14:36:00 [DEBUG   ] spawn_process: at 2019-02-05 14:36:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1549377362']
2019-02-05 14:36:00 [DEBUG   ] spawn_process: at 2019-02-05 14:36:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1549377362']
2019-02-05 14:36:00 [DEBUG   ] spawn_process: at 2019-02-05 14:36:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1549377362']
2019-02-05 14:36:00 [DEBUG   ] spawn_process: at 2019-02-05 14:36:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1549377362']
2019-02-05 14:36:00 [DEBUG   ] spawn_process: at 2019-02-05 14:36:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1549377362']
2019-02-05 14:36:00 [INFO    ] Finished spawning TBN in 0.056 s
2019-02-05 14:36:09 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 14:36:11 [DEBUG   ] Got command RPT from MCS: ref #1410467
2019-02-05 14:36:11 [DEBUG   ] summary = ERROR
2019-02-05 14:36:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410467  13 58519 52571933 A  ERRORERROR'
2019-02-05 14:36:11 [DEBUG   ] Got command RPT from MCS: ref #1410468
2019-02-05 14:36:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 14:36:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410468  77 58519 52571934 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 14:36:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 14:36:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:36:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 14:36:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2019-02-05 14:36:38 [WARNING ] (13, 1, 'bot')
2019-02-05 14:36:38 [WARNING ] (13, 1, 'bot')
2019-02-05 14:36:38 [WARNING ] (13, 1, 'bot')
2019-02-05 14:36:38 [WARNING ] (13, 1, 'bot')
2019-02-05 14:36:38 [WARNING ] (25, 5, 'bot')
2019-02-05 14:36:38 [WARNING ] (25, 5, 'bot')
2019-02-05 14:36:38 [WARNING ] (25, 5, 'bot')
2019-02-05 14:36:38 [WARNING ] (25, 5, 'bot')
2019-02-05 14:36:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:36:38 [DEBUG   ] Finished updating board flags in 2.167 seconds
2019-02-05 14:36:49 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-05 14:37:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 14:37:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 14:37:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:37:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 14:37:38 [WARNING ] (13, 1, 'bot')
2019-02-05 14:37:38 [WARNING ] (13, 1, 'bot')
2019-02-05 14:37:38 [WARNING ] (13, 1, 'bot')
2019-02-05 14:37:38 [WARNING ] (13, 1, 'bot')
2019-02-05 14:37:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:37:38 [DEBUG   ] Finished updating board flags in 1.875 seconds
2019-02-05 14:37:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 14:38:09 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-02-05 14:38:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 14:38:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:38:38 [WARNING ] (13, 1, 'bot')
2019-02-05 14:38:38 [WARNING ] (13, 1, 'bot')
2019-02-05 14:38:38 [WARNING ] (13, 1, 'bot')
2019-02-05 14:38:38 [WARNING ] (13, 1, 'bot')
2019-02-05 14:38:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:38:38 [DEBUG   ] Finished updating board flags in 1.821 seconds
2019-02-05 14:38:49 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-05 14:39:09 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 14:39:29 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-05 14:39:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:39:38 [WARNING ] (13, 1, 'bot')
2019-02-05 14:39:38 [WARNING ] (13, 1, 'bot')
2019-02-05 14:39:38 [WARNING ] (13, 1, 'bot')
2019-02-05 14:39:38 [WARNING ] (13, 1, 'bot')
2019-02-05 14:39:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:39:38 [DEBUG   ] Finished updating board flags in 1.784 seconds
2019-02-05 14:39:49 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-05 14:39:50 [DEBUG   ] Got command RPT from MCS: ref #1410488
2019-02-05 14:39:50 [DEBUG   ] summary = ERROR
2019-02-05 14:39:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410488  13 58519 52790817 A  ERRORERROR'
2019-02-05 14:39:51 [DEBUG   ] Got command RPT from MCS: ref #1410489
2019-02-05 14:39:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 14:39:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410489  77 58519 52791021 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 14:39:51 [DEBUG   ] Got command RPT from MCS: ref #1410490
2019-02-05 14:39:51 [DEBUG   ] summary = ERROR
2019-02-05 14:39:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410490  13 58519 52791225 A  ERRORERROR'
2019-02-05 14:39:51 [DEBUG   ] Got command RPT from MCS: ref #1410491
2019-02-05 14:39:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 14:39:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410491  77 58519 52791417 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 14:39:51 [DEBUG   ] Got command RPT from MCS: ref #1410492
2019-02-05 14:39:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 14:39:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410492  12 58519 52791621 A  ERRORB˜™š'
2019-02-05 14:40:09 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-05 14:40:11 [DEBUG   ] Got command TBW from MCS: ref #1410494
2019-02-05 14:40:11 [DEBUG   ] tbw = exited with status True, code 0x00
2019-02-05 14:40:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW  1410494   8 58519 52811578 A  ERROR'
2019-02-05 14:40:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2019-02-05 14:40:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2019-02-05 14:40:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2019-02-05 14:40:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2019-02-05 14:40:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2019-02-05 14:40:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2019-02-05 14:40:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2019-02-05 14:40:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2019-02-05 14:40:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2019-02-05 14:40:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2019-02-05 14:40:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2019-02-05 14:40:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2019-02-05 14:40:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2019-02-05 14:40:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2019-02-05 14:40:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2019-02-05 14:40:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2019-02-05 14:40:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2019-02-05 14:40:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2019-02-05 14:40:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2019-02-05 14:40:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2019-02-05 14:40:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2019-02-05 14:40:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2019-02-05 14:40:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2019-02-05 14:40:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2019-02-05 14:40:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2019-02-05 14:40:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2019-02-05 14:40:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2019-02-05 14:40:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2019-02-05 14:40:15 [DEBUG   ] spawn_process: at 2019-02-05 14:40:15 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2019-02-05 14:40:15 [DEBUG   ] spawn_process: at 2019-02-05 14:40:15 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2019-02-05 14:40:15 [DEBUG   ] spawn_process: at 2019-02-05 14:40:15 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2019-02-05 14:40:15 [DEBUG   ] spawn_process: at 2019-02-05 14:40:15 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2019-02-05 14:40:15 [DEBUG   ] spawn_process: at 2019-02-05 14:40:15 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2019-02-05 14:40:15 [DEBUG   ] spawn_process: at 2019-02-05 14:40:15 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2019-02-05 14:40:15 [DEBUG   ] spawn_process: at 2019-02-05 14:40:15 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2019-02-05 14:40:15 [DEBUG   ] spawn_process: at 2019-02-05 14:40:15 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2019-02-05 14:40:15 [DEBUG   ] spawn_process: at 2019-02-05 14:40:15 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2019-02-05 14:40:15 [DEBUG   ] spawn_process: at 2019-02-05 14:40:15 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2019-02-05 14:40:15 [DEBUG   ] spawn_process: at 2019-02-05 14:40:15 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2019-02-05 14:40:15 [DEBUG   ] spawn_process: at 2019-02-05 14:40:15 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2019-02-05 14:40:15 [DEBUG   ] spawn_process: at 2019-02-05 14:40:15 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2019-02-05 14:40:15 [DEBUG   ] spawn_process: at 2019-02-05 14:40:15 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2019-02-05 14:40:15 [DEBUG   ] spawn_process: at 2019-02-05 14:40:15 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2019-02-05 14:40:15 [DEBUG   ] spawn_process: at 2019-02-05 14:40:15 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2019-02-05 14:40:15 [DEBUG   ] spawn_process: at 2019-02-05 14:40:15 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2019-02-05 14:40:15 [DEBUG   ] spawn_process: at 2019-02-05 14:40:15 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2019-02-05 14:40:15 [DEBUG   ] spawn_process: at 2019-02-05 14:40:15 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2019-02-05 14:40:15 [DEBUG   ] spawn_process: at 2019-02-05 14:40:15 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2019-02-05 14:40:15 [DEBUG   ] spawn_process: at 2019-02-05 14:40:15 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2019-02-05 14:40:15 [DEBUG   ] spawn_process: at 2019-02-05 14:40:15 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2019-02-05 14:40:15 [DEBUG   ] spawn_process: at 2019-02-05 14:40:15 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2019-02-05 14:40:15 [DEBUG   ] spawn_process: at 2019-02-05 14:40:15 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2019-02-05 14:40:15 [DEBUG   ] spawn_process: at 2019-02-05 14:40:15 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2019-02-05 14:40:15 [DEBUG   ] spawn_process: at 2019-02-05 14:40:15 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2019-02-05 14:40:15 [INFO    ] Finished spawning TBW
2019-02-05 14:40:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:40:38 [WARNING ] (13, 1, 'bot')
2019-02-05 14:40:38 [WARNING ] (13, 1, 'bot')
2019-02-05 14:40:38 [WARNING ] (13, 1, 'bot')
2019-02-05 14:40:38 [WARNING ] (13, 1, 'bot')
2019-02-05 14:40:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:40:38 [DEBUG   ] Finished updating board flags in 1.439 seconds
2019-02-05 14:41:11 [DEBUG   ] Got command RPT from MCS: ref #1410502
2019-02-05 14:41:11 [DEBUG   ] summary = ERROR
2019-02-05 14:41:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410502  13 58519 52871941 A  ERRORERROR'
2019-02-05 14:41:11 [DEBUG   ] Got command RPT from MCS: ref #1410503
2019-02-05 14:41:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 14:41:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410503  77 58519 52871942 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 14:41:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 14:41:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:41:38 [WARNING ] (13, 1, 'bot')
2019-02-05 14:41:38 [WARNING ] (13, 1, 'bot')
2019-02-05 14:41:38 [WARNING ] (13, 1, 'bot')
2019-02-05 14:41:38 [WARNING ] (13, 1, 'bot')
2019-02-05 14:41:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:41:38 [DEBUG   ] Finished updating board flags in 1.536 seconds
2019-02-05 14:42:03 [INFO    ] __waitForTBW - TBW finished in 108.831 s
2019-02-05 14:42:04 [DEBUG   ] Finished updating ant stats in 0.358 seconds
2019-02-05 14:42:04 [INFO    ] Started antennas statistics background thread
2019-02-05 14:42:04 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2019-02-05 14:42:04 [DEBUG   ] spawn_process: at 2019-02-05 14:42:04 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1549377726']
2019-02-05 14:42:04 [DEBUG   ] spawn_process: at 2019-02-05 14:42:04 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1549377726']
2019-02-05 14:42:04 [DEBUG   ] spawn_process: at 2019-02-05 14:42:04 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1549377726']
2019-02-05 14:42:04 [DEBUG   ] spawn_process: at 2019-02-05 14:42:04 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1549377726']
2019-02-05 14:42:04 [DEBUG   ] spawn_process: at 2019-02-05 14:42:04 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1549377726']
2019-02-05 14:42:04 [DEBUG   ] spawn_process: at 2019-02-05 14:42:04 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1549377726']
2019-02-05 14:42:04 [DEBUG   ] spawn_process: at 2019-02-05 14:42:04 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1549377726']
2019-02-05 14:42:04 [DEBUG   ] spawn_process: at 2019-02-05 14:42:04 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1549377726']
2019-02-05 14:42:04 [DEBUG   ] spawn_process: at 2019-02-05 14:42:04 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1549377726']
2019-02-05 14:42:04 [DEBUG   ] spawn_process: at 2019-02-05 14:42:04 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1549377726']
2019-02-05 14:42:04 [DEBUG   ] spawn_process: at 2019-02-05 14:42:04 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1549377726']
2019-02-05 14:42:04 [DEBUG   ] spawn_process: at 2019-02-05 14:42:04 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1549377726']
2019-02-05 14:42:04 [DEBUG   ] spawn_process: at 2019-02-05 14:42:04 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1549377726']
2019-02-05 14:42:04 [DEBUG   ] spawn_process: at 2019-02-05 14:42:04 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1549377726']
2019-02-05 14:42:04 [DEBUG   ] spawn_process: at 2019-02-05 14:42:04 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1549377726']
2019-02-05 14:42:04 [DEBUG   ] spawn_process: at 2019-02-05 14:42:04 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1549377726']
2019-02-05 14:42:04 [DEBUG   ] spawn_process: at 2019-02-05 14:42:04 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1549377726']
2019-02-05 14:42:04 [DEBUG   ] spawn_process: at 2019-02-05 14:42:04 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1549377726']
2019-02-05 14:42:04 [DEBUG   ] spawn_process: at 2019-02-05 14:42:04 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1549377726']
2019-02-05 14:42:04 [DEBUG   ] spawn_process: at 2019-02-05 14:42:04 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1549377726']
2019-02-05 14:42:04 [DEBUG   ] spawn_process: at 2019-02-05 14:42:04 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1549377726']
2019-02-05 14:42:04 [DEBUG   ] spawn_process: at 2019-02-05 14:42:04 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1549377726']
2019-02-05 14:42:04 [DEBUG   ] spawn_process: at 2019-02-05 14:42:04 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1549377726']
2019-02-05 14:42:04 [DEBUG   ] spawn_process: at 2019-02-05 14:42:04 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1549377726']
2019-02-05 14:42:04 [DEBUG   ] spawn_process: at 2019-02-05 14:42:04 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1549377726']
2019-02-05 14:42:04 [DEBUG   ] spawn_process: at 2019-02-05 14:42:04 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1549377726']
2019-02-05 14:42:04 [INFO    ] Finished spawning TBN in 0.049 s
2019-02-05 14:42:25 [DEBUG   ] Finished updating ant stats in 1.270 seconds
2019-02-05 14:42:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-02-05 14:42:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:42:38 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 14:42:38 [WARNING ] (13, 1, 'bot')
2019-02-05 14:42:38 [WARNING ] (13, 1, 'bot')
2019-02-05 14:42:38 [WARNING ] (13, 1, 'bot')
2019-02-05 14:42:38 [WARNING ] (13, 1, 'bot')
2019-02-05 14:42:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:42:38 [DEBUG   ] Finished updating board flags in 1.640 seconds
2019-02-05 14:42:45 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 14:43:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 14:43:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 14:43:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 14:43:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:43:38 [WARNING ] (13, 1, 'bot')
2019-02-05 14:43:38 [WARNING ] (13, 1, 'bot')
2019-02-05 14:43:38 [WARNING ] (13, 1, 'bot')
2019-02-05 14:43:38 [WARNING ] (13, 1, 'bot')
2019-02-05 14:43:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:43:38 [DEBUG   ] Finished updating board flags in 1.644 seconds
2019-02-05 14:43:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 14:44:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 14:44:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 14:44:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:44:38 [WARNING ] (13, 1, 'bot')
2019-02-05 14:44:38 [WARNING ] (13, 1, 'bot')
2019-02-05 14:44:38 [WARNING ] (13, 1, 'bot')
2019-02-05 14:44:38 [WARNING ] (13, 1, 'bot')
2019-02-05 14:44:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:44:38 [DEBUG   ] Finished updating board flags in 1.646 seconds
2019-02-05 14:44:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-05 14:44:50 [DEBUG   ] Got command RPT from MCS: ref #1410529
2019-02-05 14:44:50 [DEBUG   ] summary = ERROR
2019-02-05 14:44:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410529  13 58519 53090901 A  ERRORERROR'
2019-02-05 14:44:51 [DEBUG   ] Got command RPT from MCS: ref #1410530
2019-02-05 14:44:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 14:44:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410530  77 58519 53091105 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 14:44:51 [DEBUG   ] Got command RPT from MCS: ref #1410531
2019-02-05 14:44:51 [DEBUG   ] summary = ERROR
2019-02-05 14:44:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410531  13 58519 53091309 A  ERRORERROR'
2019-02-05 14:44:51 [DEBUG   ] Got command RPT from MCS: ref #1410533
2019-02-05 14:44:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 14:44:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410533  77 58519 53091501 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 14:44:51 [DEBUG   ] Got command RPT from MCS: ref #1410535
2019-02-05 14:44:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 14:44:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410535  12 58519 53091705 A  ERRORB™™š'
2019-02-05 14:45:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 14:45:25 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 14:45:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 14:45:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:45:38 [WARNING ] (13, 1, 'bot')
2019-02-05 14:45:38 [WARNING ] (13, 1, 'bot')
2019-02-05 14:45:38 [WARNING ] (13, 1, 'bot')
2019-02-05 14:45:38 [WARNING ] (13, 1, 'bot')
2019-02-05 14:45:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:45:38 [DEBUG   ] Finished updating board flags in 1.646 seconds
2019-02-05 14:45:45 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-02-05 14:46:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 14:46:11 [DEBUG   ] Got command RPT from MCS: ref #1410539
2019-02-05 14:46:11 [DEBUG   ] summary = ERROR
2019-02-05 14:46:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410539  13 58519 53171937 A  ERRORERROR'
2019-02-05 14:46:11 [DEBUG   ] Got command RPT from MCS: ref #1410540
2019-02-05 14:46:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 14:46:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410540  77 58519 53171938 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 14:46:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 14:46:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 14:46:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:46:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:46:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:46:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:46:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:46:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:46:39 [DEBUG   ] Finished updating board flags in 1.639 seconds
2019-02-05 14:46:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 14:47:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 14:47:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 14:47:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:47:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:47:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:47:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:47:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:47:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:47:39 [DEBUG   ] Finished updating board flags in 1.640 seconds
2019-02-05 14:47:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 14:48:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 14:48:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 14:48:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:48:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:48:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:48:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:48:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:48:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:48:39 [DEBUG   ] Finished updating board flags in 2.343 seconds
2019-02-05 14:48:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 14:49:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 14:49:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 14:49:38 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 14:49:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:49:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:49:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:49:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:49:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:49:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:49:39 [DEBUG   ] Finished updating board flags in 2.058 seconds
2019-02-05 14:49:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 14:49:50 [DEBUG   ] Got command RPT from MCS: ref #1410560
2019-02-05 14:49:50 [DEBUG   ] summary = ERROR
2019-02-05 14:49:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410560  13 58519 53390986 A  ERRORERROR'
2019-02-05 14:49:51 [DEBUG   ] Got command RPT from MCS: ref #1410561
2019-02-05 14:49:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 14:49:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410561  77 58519 53391189 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 14:49:51 [DEBUG   ] Got command RPT from MCS: ref #1410562
2019-02-05 14:49:51 [DEBUG   ] summary = ERROR
2019-02-05 14:49:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410562  13 58519 53391393 A  ERRORERROR'
2019-02-05 14:49:51 [DEBUG   ] Got command RPT from MCS: ref #1410563
2019-02-05 14:49:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 14:49:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410563  77 58519 53391585 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 14:49:51 [DEBUG   ] Got command RPT from MCS: ref #1410564
2019-02-05 14:49:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 14:49:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410564  12 58519 53391790 A  ERRORB™™š'
2019-02-05 14:50:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 14:50:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 14:50:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:50:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-05 14:50:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:50:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:50:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:50:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:50:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:50:39 [DEBUG   ] Finished updating board flags in 2.022 seconds
2019-02-05 14:50:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 14:51:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 14:51:11 [DEBUG   ] Got command RPT from MCS: ref #1410569
2019-02-05 14:51:11 [DEBUG   ] summary = ERROR
2019-02-05 14:51:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410569  13 58519 53471945 A  ERRORERROR'
2019-02-05 14:51:11 [DEBUG   ] Got command RPT from MCS: ref #1410570
2019-02-05 14:51:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 14:51:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410570  77 58519 53471946 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 14:51:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 14:51:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:51:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 14:51:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-02-05 14:51:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:51:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:51:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:51:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:51:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:51:39 [DEBUG   ] Finished updating board flags in 1.978 seconds
2019-02-05 14:51:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 14:52:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 14:52:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 14:52:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:52:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-02-05 14:52:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-05 14:52:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:52:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:52:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:52:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:52:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:52:39 [DEBUG   ] Finished updating board flags in 1.813 seconds
2019-02-05 14:52:45 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-05 14:53:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-05 14:53:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 14:53:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:53:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-02-05 14:53:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:53:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:53:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:53:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:53:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:53:39 [DEBUG   ] Finished updating board flags in 1.904 seconds
2019-02-05 14:53:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 14:54:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-05 14:54:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 14:54:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:54:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:54:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:54:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:54:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:54:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:54:39 [DEBUG   ] Finished updating board flags in 1.734 seconds
2019-02-05 14:54:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 14:54:51 [DEBUG   ] Got command RPT from MCS: ref #1410592
2019-02-05 14:54:51 [DEBUG   ] summary = ERROR
2019-02-05 14:54:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410592  13 58519 53691069 A  ERRORERROR'
2019-02-05 14:54:51 [DEBUG   ] Got command RPT from MCS: ref #1410593
2019-02-05 14:54:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 14:54:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410593  77 58519 53691273 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 14:54:51 [DEBUG   ] Got command RPT from MCS: ref #1410594
2019-02-05 14:54:51 [DEBUG   ] summary = ERROR
2019-02-05 14:54:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410594  13 58519 53691477 A  ERRORERROR'
2019-02-05 14:54:51 [DEBUG   ] Got command RPT from MCS: ref #1410596
2019-02-05 14:54:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 14:54:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410596  77 58519 53691681 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 14:54:51 [DEBUG   ] Got command RPT from MCS: ref #1410597
2019-02-05 14:54:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 14:54:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410597  12 58519 53691873 A  ERRORBš™š'
2019-02-05 14:55:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 14:55:25 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-05 14:55:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:55:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-05 14:55:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:55:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:55:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:55:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:55:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:55:39 [DEBUG   ] Finished updating board flags in 1.569 seconds
2019-02-05 14:55:45 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-05 14:56:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 14:56:11 [DEBUG   ] Got command RPT from MCS: ref #1410611
2019-02-05 14:56:11 [DEBUG   ] summary = ERROR
2019-02-05 14:56:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410611  13 58519 53771945 A  ERRORERROR'
2019-02-05 14:56:11 [DEBUG   ] Got command RPT from MCS: ref #1410612
2019-02-05 14:56:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 14:56:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410612  77 58519 53771946 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 14:56:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 14:56:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:56:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 14:56:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:56:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:56:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:56:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:56:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:56:39 [DEBUG   ] Finished updating board flags in 1.413 seconds
2019-02-05 14:56:45 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-05 14:57:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 14:57:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 14:57:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:57:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:57:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:57:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:57:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:57:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:57:39 [DEBUG   ] Finished updating board flags in 1.427 seconds
2019-02-05 14:57:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 14:58:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-05 14:58:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 14:58:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 14:58:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:58:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:58:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:58:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:58:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:58:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:58:39 [DEBUG   ] Finished updating board flags in 1.501 seconds
2019-02-05 14:58:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 14:59:05 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-05 14:59:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-05 14:59:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 14:59:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:59:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:59:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:59:39 [WARNING ] (13, 1, 'bot')
2019-02-05 14:59:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 14:59:39 [DEBUG   ] Finished updating board flags in 1.510 seconds
2019-02-05 14:59:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 14:59:51 [DEBUG   ] Got command RPT from MCS: ref #1410637
2019-02-05 14:59:51 [DEBUG   ] summary = ERROR
2019-02-05 14:59:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410637  13 58519 53991161 A  ERRORERROR'
2019-02-05 14:59:51 [DEBUG   ] Got command RPT from MCS: ref #1410638
2019-02-05 14:59:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 14:59:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410638  77 58519 53991365 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 14:59:51 [DEBUG   ] Got command RPT from MCS: ref #1410639
2019-02-05 14:59:51 [DEBUG   ] summary = ERROR
2019-02-05 14:59:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410639  13 58519 53991557 A  ERRORERROR'
2019-02-05 14:59:51 [DEBUG   ] Got command RPT from MCS: ref #1410640
2019-02-05 14:59:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 14:59:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410640  77 58519 53991761 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 14:59:51 [DEBUG   ] Got command RPT from MCS: ref #1410641
2019-02-05 14:59:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 14:59:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410641  12 58519 53991965 A  ERRORB™™š'
2019-02-05 15:00:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-02-05 15:00:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 15:00:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 15:00:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:00:40 [WARNING ] (13, 1, 'bot')
2019-02-05 15:00:40 [WARNING ] (13, 1, 'bot')
2019-02-05 15:00:40 [WARNING ] (13, 1, 'bot')
2019-02-05 15:00:40 [WARNING ] (13, 1, 'bot')
2019-02-05 15:00:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:00:40 [DEBUG   ] Finished updating board flags in 2.192 seconds
2019-02-05 15:00:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-05 15:01:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 15:01:11 [DEBUG   ] Got command RPT from MCS: ref #1410642
2019-02-05 15:01:11 [DEBUG   ] summary = ERROR
2019-02-05 15:01:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410642  13 58519 54071949 A  ERRORERROR'
2019-02-05 15:01:11 [DEBUG   ] Got command RPT from MCS: ref #1410643
2019-02-05 15:01:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 15:01:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410643  77 58519 54071950 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 15:01:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 15:01:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:01:40 [WARNING ] (13, 1, 'bot')
2019-02-05 15:01:40 [WARNING ] (13, 1, 'bot')
2019-02-05 15:01:40 [WARNING ] (13, 1, 'bot')
2019-02-05 15:01:40 [WARNING ] (13, 1, 'bot')
2019-02-05 15:01:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:01:40 [DEBUG   ] Finished updating board flags in 2.037 seconds
2019-02-05 15:01:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 15:02:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 15:02:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 15:02:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 15:02:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:02:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 15:02:40 [WARNING ] (13, 1, 'bot')
2019-02-05 15:02:40 [WARNING ] (13, 1, 'bot')
2019-02-05 15:02:40 [WARNING ] (13, 1, 'bot')
2019-02-05 15:02:40 [WARNING ] (13, 1, 'bot')
2019-02-05 15:02:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:02:40 [DEBUG   ] Finished updating board flags in 1.980 seconds
2019-02-05 15:02:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 15:03:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 15:03:25 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-05 15:03:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 15:03:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:03:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 15:03:40 [WARNING ] (13, 1, 'bot')
2019-02-05 15:03:40 [WARNING ] (13, 1, 'bot')
2019-02-05 15:03:40 [WARNING ] (13, 1, 'bot')
2019-02-05 15:03:40 [WARNING ] (13, 1, 'bot')
2019-02-05 15:03:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:03:40 [DEBUG   ] Finished updating board flags in 1.822 seconds
2019-02-05 15:03:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 15:04:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 15:04:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 15:04:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:04:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2019-02-05 15:04:40 [WARNING ] (13, 1, 'bot')
2019-02-05 15:04:40 [WARNING ] (13, 1, 'bot')
2019-02-05 15:04:40 [WARNING ] (13, 1, 'bot')
2019-02-05 15:04:40 [WARNING ] (13, 1, 'bot')
2019-02-05 15:04:40 [WARNING ] (25, 5, 'bot')
2019-02-05 15:04:40 [WARNING ] (25, 5, 'bot')
2019-02-05 15:04:40 [WARNING ] (25, 5, 'bot')
2019-02-05 15:04:40 [WARNING ] (25, 5, 'bot')
2019-02-05 15:04:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:04:40 [DEBUG   ] Finished updating board flags in 1.726 seconds
2019-02-05 15:04:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-05 15:04:51 [DEBUG   ] Got command RPT from MCS: ref #1410665
2019-02-05 15:04:51 [DEBUG   ] summary = ERROR
2019-02-05 15:04:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410665  13 58519 54291241 A  ERRORERROR'
2019-02-05 15:04:51 [DEBUG   ] Got command RPT from MCS: ref #1410666
2019-02-05 15:04:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 15:04:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410666  77 58519 54291445 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 15:04:51 [DEBUG   ] Got command RPT from MCS: ref #1410667
2019-02-05 15:04:51 [DEBUG   ] summary = ERROR
2019-02-05 15:04:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410667  13 58519 54291649 A  ERRORERROR'
2019-02-05 15:04:51 [DEBUG   ] Got command RPT from MCS: ref #1410668
2019-02-05 15:04:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 15:04:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410668  77 58519 54291853 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 15:04:52 [DEBUG   ] Got command RPT from MCS: ref #1410671
2019-02-05 15:04:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 15:04:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410671  12 58519 54292045 A  ERRORB™™š'
2019-02-05 15:05:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 15:05:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 15:05:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:05:40 [WARNING ] (13, 1, 'bot')
2019-02-05 15:05:40 [WARNING ] (13, 1, 'bot')
2019-02-05 15:05:40 [WARNING ] (13, 1, 'bot')
2019-02-05 15:05:40 [WARNING ] (13, 1, 'bot')
2019-02-05 15:05:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:05:40 [DEBUG   ] Finished updating board flags in 1.604 seconds
2019-02-05 15:05:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 15:06:05 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-05 15:06:11 [DEBUG   ] Got command RPT from MCS: ref #1410679
2019-02-05 15:06:11 [DEBUG   ] summary = ERROR
2019-02-05 15:06:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410679  13 58519 54371945 A  ERRORERROR'
2019-02-05 15:06:11 [DEBUG   ] Got command RPT from MCS: ref #1410680
2019-02-05 15:06:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 15:06:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410680  77 58519 54371946 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 15:06:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 15:06:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:06:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-02-05 15:06:40 [WARNING ] (13, 1, 'bot')
2019-02-05 15:06:40 [WARNING ] (13, 1, 'bot')
2019-02-05 15:06:40 [WARNING ] (13, 1, 'bot')
2019-02-05 15:06:40 [WARNING ] (13, 1, 'bot')
2019-02-05 15:06:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:06:40 [DEBUG   ] Finished updating board flags in 1.626 seconds
2019-02-05 15:06:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 15:07:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 15:07:25 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-05 15:07:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:07:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 15:07:40 [WARNING ] (13, 1, 'bot')
2019-02-05 15:07:40 [WARNING ] (13, 1, 'bot')
2019-02-05 15:07:40 [WARNING ] (13, 1, 'bot')
2019-02-05 15:07:40 [WARNING ] (13, 1, 'bot')
2019-02-05 15:07:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:07:40 [DEBUG   ] Finished updating board flags in 1.588 seconds
2019-02-05 15:07:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 15:08:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 15:08:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 15:08:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:08:40 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 15:08:40 [WARNING ] (13, 1, 'bot')
2019-02-05 15:08:40 [WARNING ] (13, 1, 'bot')
2019-02-05 15:08:40 [WARNING ] (13, 1, 'bot')
2019-02-05 15:08:40 [WARNING ] (13, 1, 'bot')
2019-02-05 15:08:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:08:40 [DEBUG   ] Finished updating board flags in 1.480 seconds
2019-02-05 15:08:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-05 15:09:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 15:09:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 15:09:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:09:40 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 15:09:40 [WARNING ] (13, 1, 'bot')
2019-02-05 15:09:40 [WARNING ] (13, 1, 'bot')
2019-02-05 15:09:40 [WARNING ] (13, 1, 'bot')
2019-02-05 15:09:40 [WARNING ] (13, 1, 'bot')
2019-02-05 15:09:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:09:40 [DEBUG   ] Finished updating board flags in 1.493 seconds
2019-02-05 15:09:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 15:09:51 [DEBUG   ] Got command RPT from MCS: ref #1410700
2019-02-05 15:09:51 [DEBUG   ] summary = ERROR
2019-02-05 15:09:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410700  13 58519 54591337 A  ERRORERROR'
2019-02-05 15:09:51 [DEBUG   ] Got command RPT from MCS: ref #1410701
2019-02-05 15:09:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 15:09:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410701  77 58519 54591529 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 15:09:51 [DEBUG   ] Got command RPT from MCS: ref #1410702
2019-02-05 15:09:51 [DEBUG   ] summary = ERROR
2019-02-05 15:09:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410702  13 58519 54591733 A  ERRORERROR'
2019-02-05 15:09:51 [DEBUG   ] Got command RPT from MCS: ref #1410703
2019-02-05 15:09:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 15:09:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410703  77 58519 54591937 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 15:09:52 [DEBUG   ] Got command RPT from MCS: ref #1410704
2019-02-05 15:09:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 15:09:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410704  12 58519 54592141 A  ERRORB™™š'
2019-02-05 15:10:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 15:10:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 15:10:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:10:40 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 15:10:41 [WARNING ] (13, 1, 'bot')
2019-02-05 15:10:41 [WARNING ] (13, 1, 'bot')
2019-02-05 15:10:41 [WARNING ] (13, 1, 'bot')
2019-02-05 15:10:41 [WARNING ] (13, 1, 'bot')
2019-02-05 15:10:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:10:41 [DEBUG   ] Finished updating board flags in 1.601 seconds
2019-02-05 15:10:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 15:11:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 15:11:11 [DEBUG   ] Got command RPT from MCS: ref #1410709
2019-02-05 15:11:11 [DEBUG   ] summary = ERROR
2019-02-05 15:11:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410709  13 58519 54671945 A  ERRORERROR'
2019-02-05 15:11:11 [DEBUG   ] Got command RPT from MCS: ref #1410710
2019-02-05 15:11:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 15:11:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410710  77 58519 54671946 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 15:11:25 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-05 15:11:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:11:40 [WARNING ] (13, 1, 'bot')
2019-02-05 15:11:40 [WARNING ] (13, 1, 'bot')
2019-02-05 15:11:40 [WARNING ] (13, 1, 'bot')
2019-02-05 15:11:40 [WARNING ] (13, 1, 'bot')
2019-02-05 15:11:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:11:40 [DEBUG   ] Finished updating board flags in 1.351 seconds
2019-02-05 15:11:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 15:12:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 15:12:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 15:12:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 15:12:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:12:41 [WARNING ] (13, 1, 'bot')
2019-02-05 15:12:41 [WARNING ] (13, 1, 'bot')
2019-02-05 15:12:41 [WARNING ] (13, 1, 'bot')
2019-02-05 15:12:41 [WARNING ] (13, 1, 'bot')
2019-02-05 15:12:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:12:41 [DEBUG   ] Finished updating board flags in 2.105 seconds
2019-02-05 15:12:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-05 15:13:05 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-05 15:13:25 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-05 15:13:40 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 15:13:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:13:41 [WARNING ] (13, 1, 'bot')
2019-02-05 15:13:41 [WARNING ] (13, 1, 'bot')
2019-02-05 15:13:41 [WARNING ] (13, 1, 'bot')
2019-02-05 15:13:41 [WARNING ] (13, 1, 'bot')
2019-02-05 15:13:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:13:41 [DEBUG   ] Finished updating board flags in 1.968 seconds
2019-02-05 15:13:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 15:14:05 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-05 15:14:25 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-05 15:14:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:14:41 [WARNING ] (13, 1, 'bot')
2019-02-05 15:14:41 [WARNING ] (13, 1, 'bot')
2019-02-05 15:14:41 [WARNING ] (13, 1, 'bot')
2019-02-05 15:14:41 [WARNING ] (13, 1, 'bot')
2019-02-05 15:14:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:14:41 [DEBUG   ] Finished updating board flags in 1.809 seconds
2019-02-05 15:14:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 15:14:51 [DEBUG   ] Got command RPT from MCS: ref #1410732
2019-02-05 15:14:51 [DEBUG   ] summary = ERROR
2019-02-05 15:14:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410732  13 58519 54891421 A  ERRORERROR'
2019-02-05 15:14:51 [DEBUG   ] Got command RPT from MCS: ref #1410733
2019-02-05 15:14:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 15:14:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410733  77 58519 54891613 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 15:14:51 [DEBUG   ] Got command RPT from MCS: ref #1410734
2019-02-05 15:14:51 [DEBUG   ] summary = ERROR
2019-02-05 15:14:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410734  13 58519 54891817 A  ERRORERROR'
2019-02-05 15:14:52 [DEBUG   ] Got command RPT from MCS: ref #1410736
2019-02-05 15:14:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 15:14:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410736  77 58519 54892021 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 15:14:52 [DEBUG   ] Got command RPT from MCS: ref #1410738
2019-02-05 15:14:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 15:14:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410738  12 58519 54892225 A  ERRORB™™š'
2019-02-05 15:15:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 15:15:25 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-05 15:15:40 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 15:15:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:15:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 15:15:41 [WARNING ] (13, 1, 'bot')
2019-02-05 15:15:41 [WARNING ] (13, 1, 'bot')
2019-02-05 15:15:41 [WARNING ] (13, 1, 'bot')
2019-02-05 15:15:41 [WARNING ] (13, 1, 'bot')
2019-02-05 15:15:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:15:41 [DEBUG   ] Finished updating board flags in 1.901 seconds
2019-02-05 15:15:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 15:16:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-05 15:16:11 [DEBUG   ] Got command RPT from MCS: ref #1410742
2019-02-05 15:16:11 [DEBUG   ] summary = ERROR
2019-02-05 15:16:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410742  13 58519 54971945 A  ERRORERROR'
2019-02-05 15:16:11 [DEBUG   ] Got command RPT from MCS: ref #1410743
2019-02-05 15:16:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 15:16:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410743  77 58519 54971946 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 15:16:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 15:16:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:16:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 15:16:41 [WARNING ] (13, 1, 'bot')
2019-02-05 15:16:41 [WARNING ] (13, 1, 'bot')
2019-02-05 15:16:41 [WARNING ] (13, 1, 'bot')
2019-02-05 15:16:41 [WARNING ] (13, 1, 'bot')
2019-02-05 15:16:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:16:41 [DEBUG   ] Finished updating board flags in 1.685 seconds
2019-02-05 15:16:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-05 15:17:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 15:17:25 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-05 15:17:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:17:41 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 15:17:41 [WARNING ] (13, 1, 'bot')
2019-02-05 15:17:41 [WARNING ] (13, 1, 'bot')
2019-02-05 15:17:41 [WARNING ] (13, 1, 'bot')
2019-02-05 15:17:41 [WARNING ] (13, 1, 'bot')
2019-02-05 15:17:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:17:41 [DEBUG   ] Finished updating board flags in 1.616 seconds
2019-02-05 15:17:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 15:18:05 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2019-02-05 15:18:25 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-02-05 15:18:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:18:41 [WARNING ] (13, 1, 'bot')
2019-02-05 15:18:41 [WARNING ] (13, 1, 'bot')
2019-02-05 15:18:41 [WARNING ] (13, 1, 'bot')
2019-02-05 15:18:41 [WARNING ] (13, 1, 'bot')
2019-02-05 15:18:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:18:41 [DEBUG   ] Finished updating board flags in 1.612 seconds
2019-02-05 15:18:45 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 15:19:06 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-02-05 15:19:26 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-05 15:19:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:19:41 [WARNING ] (13, 1, 'bot')
2019-02-05 15:19:41 [WARNING ] (13, 1, 'bot')
2019-02-05 15:19:41 [WARNING ] (13, 1, 'bot')
2019-02-05 15:19:41 [WARNING ] (13, 1, 'bot')
2019-02-05 15:19:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:19:41 [DEBUG   ] Finished updating board flags in 1.580 seconds
2019-02-05 15:19:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 15:19:51 [DEBUG   ] Got command RPT from MCS: ref #1410763
2019-02-05 15:19:51 [DEBUG   ] summary = ERROR
2019-02-05 15:19:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410763  13 58519 55191501 A  ERRORERROR'
2019-02-05 15:19:51 [DEBUG   ] Got command RPT from MCS: ref #1410764
2019-02-05 15:19:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 15:19:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410764  77 58519 55191705 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 15:19:51 [DEBUG   ] Got command RPT from MCS: ref #1410765
2019-02-05 15:19:51 [DEBUG   ] summary = ERROR
2019-02-05 15:19:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410765  13 58519 55191909 A  ERRORERROR'
2019-02-05 15:19:52 [DEBUG   ] Got command RPT from MCS: ref #1410766
2019-02-05 15:19:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 15:19:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410766  77 58519 55192101 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 15:19:52 [DEBUG   ] Got command RPT from MCS: ref #1410767
2019-02-05 15:19:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 15:19:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410767  12 58519 55192305 A  ERRORB™™š'
2019-02-05 15:20:06 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-05 15:20:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 15:20:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:20:41 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 15:20:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 15:20:41 [WARNING ] (13, 1, 'bot')
2019-02-05 15:20:41 [WARNING ] (13, 1, 'bot')
2019-02-05 15:20:41 [WARNING ] (13, 1, 'bot')
2019-02-05 15:20:41 [WARNING ] (13, 1, 'bot')
2019-02-05 15:20:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:20:41 [DEBUG   ] Finished updating board flags in 1.430 seconds
2019-02-05 15:20:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 15:21:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 15:21:11 [DEBUG   ] Got command RPT from MCS: ref #1410772
2019-02-05 15:21:11 [DEBUG   ] summary = ERROR
2019-02-05 15:21:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410772  13 58519 55271953 A  ERRORERROR'
2019-02-05 15:21:11 [DEBUG   ] Got command RPT from MCS: ref #1410773
2019-02-05 15:21:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 15:21:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410773  77 58519 55271954 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 15:21:26 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-05 15:21:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:21:41 [WARNING ] (13, 1, 'bot')
2019-02-05 15:21:41 [WARNING ] (13, 1, 'bot')
2019-02-05 15:21:41 [WARNING ] (13, 1, 'bot')
2019-02-05 15:21:41 [WARNING ] (13, 1, 'bot')
2019-02-05 15:21:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:21:41 [DEBUG   ] Finished updating board flags in 1.398 seconds
2019-02-05 15:21:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 15:22:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 15:22:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 15:22:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:22:42 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 15:22:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:22:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:22:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:22:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:22:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:22:42 [DEBUG   ] Finished updating board flags in 2.211 seconds
2019-02-05 15:22:46 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-05 15:23:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 15:23:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 15:23:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:23:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:23:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:23:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:23:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:23:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:23:42 [DEBUG   ] Finished updating board flags in 2.278 seconds
2019-02-05 15:23:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 15:24:06 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-05 15:24:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 15:24:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:24:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:24:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:24:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:24:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:24:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:24:42 [DEBUG   ] Finished updating board flags in 2.116 seconds
2019-02-05 15:24:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 15:24:51 [DEBUG   ] Got command RPT from MCS: ref #1410795
2019-02-05 15:24:51 [DEBUG   ] summary = ERROR
2019-02-05 15:24:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410795  13 58519 55491593 A  ERRORERROR'
2019-02-05 15:24:51 [DEBUG   ] Got command RPT from MCS: ref #1410796
2019-02-05 15:24:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 15:24:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410796  77 58519 55491789 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 15:24:51 [DEBUG   ] Got command RPT from MCS: ref #1410797
2019-02-05 15:24:51 [DEBUG   ] summary = ERROR
2019-02-05 15:24:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410797  13 58519 55491993 A  ERRORERROR'
2019-02-05 15:24:52 [DEBUG   ] Got command RPT from MCS: ref #1410799
2019-02-05 15:24:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 15:24:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410799  77 58519 55492185 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 15:24:52 [DEBUG   ] Got command RPT from MCS: ref #1410800
2019-02-05 15:24:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 15:24:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410800  12 58519 55492389 A  ERRORBš™š'
2019-02-05 15:25:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 15:25:26 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-05 15:25:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:25:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:25:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:25:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:25:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:25:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:25:42 [DEBUG   ] Finished updating board flags in 2.078 seconds
2019-02-05 15:25:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 15:26:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 15:26:11 [DEBUG   ] Got command RPT from MCS: ref #1410809
2019-02-05 15:26:11 [DEBUG   ] summary = ERROR
2019-02-05 15:26:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410809  13 58519 55571945 A  ERRORERROR'
2019-02-05 15:26:11 [DEBUG   ] Got command RPT from MCS: ref #1410810
2019-02-05 15:26:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 15:26:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410810  77 58519 55571946 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 15:26:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 15:26:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:26:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:26:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:26:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:26:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:26:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:26:42 [DEBUG   ] Finished updating board flags in 1.911 seconds
2019-02-05 15:26:46 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-05 15:27:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 15:27:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 15:27:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:27:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 15:27:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:27:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:27:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:27:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:27:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:27:42 [DEBUG   ] Finished updating board flags in 1.825 seconds
2019-02-05 15:27:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 15:28:06 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-05 15:28:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 15:28:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 15:28:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:28:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:28:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:28:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:28:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:28:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:28:42 [DEBUG   ] Finished updating board flags in 1.858 seconds
2019-02-05 15:28:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 15:29:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 15:29:26 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-05 15:29:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:29:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:29:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:29:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:29:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:29:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:29:42 [DEBUG   ] Finished updating board flags in 1.823 seconds
2019-02-05 15:29:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 15:29:51 [DEBUG   ] Got command RPT from MCS: ref #1410830
2019-02-05 15:29:51 [DEBUG   ] summary = ERROR
2019-02-05 15:29:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410830  13 58519 55791677 A  ERRORERROR'
2019-02-05 15:29:51 [DEBUG   ] Got command RPT from MCS: ref #1410831
2019-02-05 15:29:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 15:29:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410831  77 58519 55791869 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 15:29:52 [DEBUG   ] Got command RPT from MCS: ref #1410832
2019-02-05 15:29:52 [DEBUG   ] summary = ERROR
2019-02-05 15:29:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410832  13 58519 55792073 A  ERRORERROR'
2019-02-05 15:29:52 [DEBUG   ] Got command RPT from MCS: ref #1410833
2019-02-05 15:29:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 15:29:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410833  77 58519 55792277 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 15:29:52 [DEBUG   ] Got command RPT from MCS: ref #1410834
2019-02-05 15:29:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 15:29:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410834  12 58519 55792481 A  ERRORB™™š'
2019-02-05 15:30:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 15:30:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 15:30:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:30:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:30:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:30:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:30:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:30:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:30:42 [DEBUG   ] Finished updating board flags in 1.703 seconds
2019-02-05 15:30:46 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-05 15:31:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 15:31:11 [DEBUG   ] Got command RPT from MCS: ref #1410835
2019-02-05 15:31:11 [DEBUG   ] summary = ERROR
2019-02-05 15:31:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410835  13 58519 55871949 A  ERRORERROR'
2019-02-05 15:31:11 [DEBUG   ] Got command RPT from MCS: ref #1410836
2019-02-05 15:31:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 15:31:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410836  77 58519 55871950 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 15:31:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 15:31:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:31:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:31:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:31:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:31:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:31:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:31:42 [DEBUG   ] Finished updating board flags in 1.613 seconds
2019-02-05 15:31:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 15:32:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 15:32:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 15:32:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:32:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 15:32:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:32:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:32:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:32:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:32:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:32:42 [DEBUG   ] Finished updating board flags in 1.581 seconds
2019-02-05 15:32:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 15:33:06 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-05 15:33:26 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-05 15:33:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:33:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:33:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:33:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:33:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:33:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:33:42 [DEBUG   ] Finished updating board flags in 1.421 seconds
2019-02-05 15:33:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 15:34:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 15:34:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 15:34:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:34:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 15:34:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:34:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:34:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:34:42 [WARNING ] (13, 1, 'bot')
2019-02-05 15:34:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:34:42 [DEBUG   ] Finished updating board flags in 1.586 seconds
2019-02-05 15:34:46 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-05 15:34:51 [DEBUG   ] Got command RPT from MCS: ref #1410858
2019-02-05 15:34:51 [DEBUG   ] summary = ERROR
2019-02-05 15:34:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410858  13 58519 56091766 A  ERRORERROR'
2019-02-05 15:34:51 [DEBUG   ] Got command RPT from MCS: ref #1410859
2019-02-05 15:34:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 15:34:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410859  77 58519 56091958 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 15:34:52 [DEBUG   ] Got command RPT from MCS: ref #1410860
2019-02-05 15:34:52 [DEBUG   ] summary = ERROR
2019-02-05 15:34:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410860  13 58519 56092161 A  ERRORERROR'
2019-02-05 15:34:52 [DEBUG   ] Got command RPT from MCS: ref #1410862
2019-02-05 15:34:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 15:34:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410862  77 58519 56092365 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 15:34:52 [DEBUG   ] Got command RPT from MCS: ref #1410863
2019-02-05 15:34:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 15:34:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410863  12 58519 56092569 A  ERRORBš™š'
2019-02-05 15:35:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 15:35:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 15:35:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:35:43 [WARNING ] (13, 1, 'bot')
2019-02-05 15:35:43 [WARNING ] (13, 1, 'bot')
2019-02-05 15:35:43 [WARNING ] (13, 1, 'bot')
2019-02-05 15:35:43 [WARNING ] (13, 1, 'bot')
2019-02-05 15:35:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:35:43 [DEBUG   ] Finished updating board flags in 2.339 seconds
2019-02-05 15:35:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 15:36:06 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-05 15:36:11 [DEBUG   ] Got command RPT from MCS: ref #1410872
2019-02-05 15:36:11 [DEBUG   ] summary = ERROR
2019-02-05 15:36:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410872  13 58519 56171949 A  ERRORERROR'
2019-02-05 15:36:11 [DEBUG   ] Got command RPT from MCS: ref #1410873
2019-02-05 15:36:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 15:36:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410873  77 58519 56171950 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 15:36:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 15:36:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:36:43 [WARNING ] (13, 1, 'bot')
2019-02-05 15:36:43 [WARNING ] (13, 1, 'bot')
2019-02-05 15:36:43 [WARNING ] (13, 1, 'bot')
2019-02-05 15:36:43 [WARNING ] (13, 1, 'bot')
2019-02-05 15:36:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:36:43 [DEBUG   ] Finished updating board flags in 2.065 seconds
2019-02-05 15:36:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 15:37:06 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-05 15:37:26 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-05 15:37:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:37:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 15:37:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-05 15:37:43 [WARNING ] (13, 1, 'bot')
2019-02-05 15:37:43 [WARNING ] (13, 1, 'bot')
2019-02-05 15:37:43 [WARNING ] (13, 1, 'bot')
2019-02-05 15:37:43 [WARNING ] (13, 1, 'bot')
2019-02-05 15:37:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:37:43 [DEBUG   ] Finished updating board flags in 2.020 seconds
2019-02-05 15:37:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 15:38:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 15:38:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 15:38:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:38:43 [WARNING ] (13, 1, 'bot')
2019-02-05 15:38:43 [WARNING ] (13, 1, 'bot')
2019-02-05 15:38:43 [WARNING ] (13, 1, 'bot')
2019-02-05 15:38:43 [WARNING ] (13, 1, 'bot')
2019-02-05 15:38:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:38:43 [DEBUG   ] Finished updating board flags in 1.989 seconds
2019-02-05 15:38:46 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-05 15:39:06 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-05 15:39:26 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-05 15:39:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:39:43 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 15:39:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-05 15:39:43 [WARNING ] (13, 1, 'bot')
2019-02-05 15:39:43 [WARNING ] (13, 1, 'bot')
2019-02-05 15:39:43 [WARNING ] (13, 1, 'bot')
2019-02-05 15:39:43 [WARNING ] (13, 1, 'bot')
2019-02-05 15:39:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:39:43 [DEBUG   ] Finished updating board flags in 1.821 seconds
2019-02-05 15:39:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 15:39:51 [DEBUG   ] Got command RPT from MCS: ref #1410893
2019-02-05 15:39:51 [DEBUG   ] summary = ERROR
2019-02-05 15:39:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410893  13 58519 56391853 A  ERRORERROR'
2019-02-05 15:39:52 [DEBUG   ] Got command RPT from MCS: ref #1410894
2019-02-05 15:39:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 15:39:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410894  77 58519 56392045 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 15:39:52 [DEBUG   ] Got command RPT from MCS: ref #1410895
2019-02-05 15:39:52 [DEBUG   ] summary = ERROR
2019-02-05 15:39:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410895  13 58519 56392249 A  ERRORERROR'
2019-02-05 15:39:52 [DEBUG   ] Got command RPT from MCS: ref #1410896
2019-02-05 15:39:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 15:39:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410896  77 58519 56392453 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 15:39:52 [DEBUG   ] Got command RPT from MCS: ref #1410897
2019-02-05 15:39:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 15:39:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410897  12 58519 56392658 A  ERRORBš™š'
2019-02-05 15:40:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 15:40:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 15:40:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:40:43 [WARNING ] (13, 1, 'bot')
2019-02-05 15:40:43 [WARNING ] (13, 1, 'bot')
2019-02-05 15:40:43 [WARNING ] (13, 1, 'bot')
2019-02-05 15:40:43 [WARNING ] (13, 1, 'bot')
2019-02-05 15:40:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:40:43 [DEBUG   ] Finished updating board flags in 1.778 seconds
2019-02-05 15:40:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 15:41:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 15:41:11 [DEBUG   ] Got command RPT from MCS: ref #1410902
2019-02-05 15:41:11 [DEBUG   ] summary = ERROR
2019-02-05 15:41:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410902  13 58519 56471957 A  ERRORERROR'
2019-02-05 15:41:11 [DEBUG   ] Got command RPT from MCS: ref #1410903
2019-02-05 15:41:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 15:41:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410903  77 58519 56471958 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 15:41:26 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-05 15:41:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:41:43 [WARNING ] (13, 1, 'bot')
2019-02-05 15:41:43 [WARNING ] (13, 1, 'bot')
2019-02-05 15:41:43 [WARNING ] (13, 1, 'bot')
2019-02-05 15:41:43 [WARNING ] (13, 1, 'bot')
2019-02-05 15:41:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:41:43 [DEBUG   ] Finished updating board flags in 1.618 seconds
2019-02-05 15:41:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 15:42:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 15:42:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 15:42:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:42:43 [WARNING ] (13, 1, 'bot')
2019-02-05 15:42:43 [WARNING ] (13, 1, 'bot')
2019-02-05 15:42:43 [WARNING ] (13, 1, 'bot')
2019-02-05 15:42:43 [WARNING ] (13, 1, 'bot')
2019-02-05 15:42:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:42:43 [DEBUG   ] Finished updating board flags in 1.635 seconds
2019-02-05 15:42:46 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-05 15:43:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 15:43:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 15:43:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:43:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 15:43:43 [WARNING ] (13, 1, 'bot')
2019-02-05 15:43:43 [WARNING ] (13, 1, 'bot')
2019-02-05 15:43:43 [WARNING ] (13, 1, 'bot')
2019-02-05 15:43:43 [WARNING ] (13, 1, 'bot')
2019-02-05 15:43:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:43:43 [DEBUG   ] Finished updating board flags in 1.677 seconds
2019-02-05 15:43:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 15:44:06 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-05 15:44:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 15:44:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:44:43 [WARNING ] (13, 1, 'bot')
2019-02-05 15:44:43 [WARNING ] (13, 1, 'bot')
2019-02-05 15:44:43 [WARNING ] (13, 1, 'bot')
2019-02-05 15:44:43 [WARNING ] (13, 1, 'bot')
2019-02-05 15:44:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:44:43 [DEBUG   ] Finished updating board flags in 1.484 seconds
2019-02-05 15:44:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 15:44:51 [DEBUG   ] Got command RPT from MCS: ref #1410925
2019-02-05 15:44:51 [DEBUG   ] summary = ERROR
2019-02-05 15:44:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410925  13 58519 56691925 A  ERRORERROR'
2019-02-05 15:44:52 [DEBUG   ] Got command RPT from MCS: ref #1410926
2019-02-05 15:44:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 15:44:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410926  77 58519 56692129 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 15:44:52 [DEBUG   ] Got command RPT from MCS: ref #1410927
2019-02-05 15:44:52 [DEBUG   ] summary = ERROR
2019-02-05 15:44:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410927  13 58519 56692333 A  ERRORERROR'
2019-02-05 15:44:52 [DEBUG   ] Got command RPT from MCS: ref #1410929
2019-02-05 15:44:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 15:44:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410929  77 58519 56692537 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 15:44:52 [DEBUG   ] Got command RPT from MCS: ref #1410931
2019-02-05 15:44:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 15:44:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410931  12 58519 56692729 A  ERRORB™™š'
2019-02-05 15:45:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 15:45:26 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-05 15:45:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 15:45:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:45:43 [WARNING ] (13, 1, 'bot')
2019-02-05 15:45:43 [WARNING ] (13, 1, 'bot')
2019-02-05 15:45:43 [WARNING ] (13, 1, 'bot')
2019-02-05 15:45:43 [WARNING ] (13, 1, 'bot')
2019-02-05 15:45:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:45:43 [DEBUG   ] Finished updating board flags in 1.628 seconds
2019-02-05 15:45:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 15:46:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 15:46:11 [DEBUG   ] Got command RPT from MCS: ref #1410935
2019-02-05 15:46:11 [DEBUG   ] summary = ERROR
2019-02-05 15:46:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410935  13 58519 56771953 A  ERRORERROR'
2019-02-05 15:46:11 [DEBUG   ] Got command RPT from MCS: ref #1410936
2019-02-05 15:46:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 15:46:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410936  77 58519 56771954 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 15:46:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 15:46:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:46:43 [WARNING ] (13, 1, 'bot')
2019-02-05 15:46:43 [WARNING ] (13, 1, 'bot')
2019-02-05 15:46:43 [WARNING ] (13, 1, 'bot')
2019-02-05 15:46:43 [WARNING ] (13, 1, 'bot')
2019-02-05 15:46:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:46:43 [DEBUG   ] Finished updating board flags in 1.377 seconds
2019-02-05 15:46:46 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-05 15:47:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 15:47:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 15:47:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-02-05 15:47:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:47:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 15:47:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:47:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:47:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:47:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:47:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:47:44 [DEBUG   ] Finished updating board flags in 2.218 seconds
2019-02-05 15:47:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 15:48:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 15:48:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 15:48:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 15:48:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:48:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 15:48:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:48:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:48:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:48:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:48:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:48:44 [DEBUG   ] Finished updating board flags in 2.257 seconds
2019-02-05 15:48:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 15:49:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 15:49:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 15:49:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 15:49:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:49:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:49:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:49:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:49:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:49:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:49:44 [DEBUG   ] Finished updating board flags in 2.185 seconds
2019-02-05 15:49:46 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2019-02-05 15:49:52 [DEBUG   ] Got command RPT from MCS: ref #1410956
2019-02-05 15:49:52 [DEBUG   ] summary = ERROR
2019-02-05 15:49:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410956  13 58519 56992023 A  ERRORERROR'
2019-02-05 15:49:52 [DEBUG   ] Got command RPT from MCS: ref #1410957
2019-02-05 15:49:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 15:49:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410957  77 58519 56992213 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 15:49:52 [DEBUG   ] Got command RPT from MCS: ref #1410958
2019-02-05 15:49:52 [DEBUG   ] summary = ERROR
2019-02-05 15:49:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410958  13 58519 56992417 A  ERRORERROR'
2019-02-05 15:49:52 [DEBUG   ] Got command RPT from MCS: ref #1410959
2019-02-05 15:49:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 15:49:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410959  77 58519 56992621 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 15:49:52 [DEBUG   ] Got command RPT from MCS: ref #1410960
2019-02-05 15:49:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 15:49:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410960  12 58519 56992813 A  ERRORB™™š'
2019-02-05 15:50:06 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 15:50:26 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-02-05 15:50:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-02-05 15:50:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:50:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:50:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:50:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:50:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:50:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:50:44 [DEBUG   ] Finished updating board flags in 2.020 seconds
2019-02-05 15:50:47 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2019-02-05 15:51:07 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-02-05 15:51:11 [DEBUG   ] Got command RPT from MCS: ref #1410965
2019-02-05 15:51:11 [DEBUG   ] summary = ERROR
2019-02-05 15:51:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410965  13 58519 57071961 A  ERRORERROR'
2019-02-05 15:51:11 [DEBUG   ] Got command RPT from MCS: ref #1410966
2019-02-05 15:51:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 15:51:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410966  77 58519 57071962 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 15:51:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 15:51:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:51:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:51:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:51:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:51:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:51:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:51:44 [DEBUG   ] Finished updating board flags in 1.925 seconds
2019-02-05 15:51:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-05 15:52:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-05 15:52:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 15:52:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:52:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:52:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:52:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:52:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:52:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:52:44 [DEBUG   ] Finished updating board flags in 1.813 seconds
2019-02-05 15:52:47 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-02-05 15:53:07 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-05 15:53:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 15:53:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:53:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:53:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:53:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:53:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:53:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:53:44 [DEBUG   ] Finished updating board flags in 1.807 seconds
2019-02-05 15:53:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 15:54:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 15:54:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 15:54:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:54:44 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 15:54:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:54:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:54:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:54:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:54:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:54:44 [DEBUG   ] Finished updating board flags in 1.787 seconds
2019-02-05 15:54:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 15:54:52 [DEBUG   ] Got command RPT from MCS: ref #1410988
2019-02-05 15:54:52 [DEBUG   ] summary = ERROR
2019-02-05 15:54:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410988  13 58519 57292105 A  ERRORERROR'
2019-02-05 15:54:52 [DEBUG   ] Got command RPT from MCS: ref #1410989
2019-02-05 15:54:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 15:54:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410989  77 58519 57292297 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 15:54:52 [DEBUG   ] Got command RPT from MCS: ref #1410990
2019-02-05 15:54:52 [DEBUG   ] summary = ERROR
2019-02-05 15:54:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410990  13 58519 57292501 A  ERRORERROR'
2019-02-05 15:54:52 [DEBUG   ] Got command RPT from MCS: ref #1410992
2019-02-05 15:54:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 15:54:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410992  77 58519 57292705 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 15:54:52 [DEBUG   ] Got command RPT from MCS: ref #1410994
2019-02-05 15:54:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 15:54:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1410994  12 58519 57292909 A  ERRORBš™š'
2019-02-05 15:55:07 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 15:55:27 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-02-05 15:55:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:55:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:55:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:55:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:55:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:55:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:55:44 [DEBUG   ] Finished updating board flags in 1.646 seconds
2019-02-05 15:55:47 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-05 15:56:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 15:56:11 [DEBUG   ] Got command RPT from MCS: ref #1411002
2019-02-05 15:56:11 [DEBUG   ] summary = ERROR
2019-02-05 15:56:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411002  13 58519 57371961 A  ERRORERROR'
2019-02-05 15:56:11 [DEBUG   ] Got command RPT from MCS: ref #1411003
2019-02-05 15:56:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 15:56:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411003  77 58519 57371962 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 15:56:27 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-05 15:56:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:56:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:56:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:56:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:56:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:56:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:56:44 [DEBUG   ] Finished updating board flags in 1.558 seconds
2019-02-05 15:56:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 15:57:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 15:57:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 15:57:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:57:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:57:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:57:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:57:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:57:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:57:44 [DEBUG   ] Finished updating board flags in 1.454 seconds
2019-02-05 15:57:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 15:58:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 15:58:27 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-05 15:58:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:58:44 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 15:58:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:58:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:58:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:58:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:58:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:58:44 [DEBUG   ] Finished updating board flags in 1.531 seconds
2019-02-05 15:58:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 15:59:07 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-05 15:59:27 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-05 15:59:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 15:59:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:59:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:59:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:59:44 [WARNING ] (13, 1, 'bot')
2019-02-05 15:59:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 15:59:44 [DEBUG   ] Finished updating board flags in 1.539 seconds
2019-02-05 15:59:47 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2019-02-05 15:59:52 [DEBUG   ] Got command RPT from MCS: ref #1411023
2019-02-05 15:59:52 [DEBUG   ] summary = ERROR
2019-02-05 15:59:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411023  13 58519 57592189 A  ERRORERROR'
2019-02-05 15:59:52 [DEBUG   ] Got command RPT from MCS: ref #1411024
2019-02-05 15:59:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 15:59:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411024  77 58519 57592381 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 15:59:52 [DEBUG   ] Got command RPT from MCS: ref #1411025
2019-02-05 15:59:52 [DEBUG   ] summary = ERROR
2019-02-05 15:59:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411025  13 58519 57592585 A  ERRORERROR'
2019-02-05 15:59:52 [DEBUG   ] Got command RPT from MCS: ref #1411026
2019-02-05 15:59:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 15:59:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411026  77 58519 57592789 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 15:59:52 [DEBUG   ] Got command RPT from MCS: ref #1411027
2019-02-05 15:59:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 15:59:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411027  12 58519 57592993 A  ERRORB™™š'
2019-02-05 16:00:07 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-05 16:00:28 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-02-05 16:00:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:00:45 [WARNING ] (13, 1, 'bot')
2019-02-05 16:00:45 [WARNING ] (13, 1, 'bot')
2019-02-05 16:00:45 [WARNING ] (13, 1, 'bot')
2019-02-05 16:00:45 [WARNING ] (13, 1, 'bot')
2019-02-05 16:00:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:00:45 [DEBUG   ] Finished updating board flags in 2.166 seconds
2019-02-05 16:00:48 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-02-05 16:01:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 16:01:11 [DEBUG   ] Got command RPT from MCS: ref #1411028
2019-02-05 16:01:11 [DEBUG   ] summary = ERROR
2019-02-05 16:01:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411028  13 58519 57671957 A  ERRORERROR'
2019-02-05 16:01:11 [DEBUG   ] Got command RPT from MCS: ref #1411029
2019-02-05 16:01:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 16:01:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411029  77 58519 57671958 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 16:01:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 16:01:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 16:01:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:01:45 [WARNING ] (13, 1, 'bot')
2019-02-05 16:01:45 [WARNING ] (13, 1, 'bot')
2019-02-05 16:01:45 [WARNING ] (13, 1, 'bot')
2019-02-05 16:01:45 [WARNING ] (13, 1, 'bot')
2019-02-05 16:01:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:01:45 [DEBUG   ] Finished updating board flags in 1.922 seconds
2019-02-05 16:01:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 16:02:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 16:02:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 16:02:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:02:45 [WARNING ] (13, 1, 'bot')
2019-02-05 16:02:45 [WARNING ] (13, 1, 'bot')
2019-02-05 16:02:45 [WARNING ] (13, 1, 'bot')
2019-02-05 16:02:45 [WARNING ] (13, 1, 'bot')
2019-02-05 16:02:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:02:45 [DEBUG   ] Finished updating board flags in 1.805 seconds
2019-02-05 16:02:48 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 16:03:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 16:03:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-05 16:03:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:03:45 [WARNING ] (13, 1, 'bot')
2019-02-05 16:03:45 [WARNING ] (13, 1, 'bot')
2019-02-05 16:03:45 [WARNING ] (13, 1, 'bot')
2019-02-05 16:03:45 [WARNING ] (13, 1, 'bot')
2019-02-05 16:03:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:03:45 [DEBUG   ] Finished updating board flags in 1.866 seconds
2019-02-05 16:03:48 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-05 16:04:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 16:04:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 16:04:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:04:45 [WARNING ] (13, 1, 'bot')
2019-02-05 16:04:45 [WARNING ] (13, 1, 'bot')
2019-02-05 16:04:45 [WARNING ] (13, 1, 'bot')
2019-02-05 16:04:45 [WARNING ] (13, 1, 'bot')
2019-02-05 16:04:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:04:45 [DEBUG   ] Finished updating board flags in 1.754 seconds
2019-02-05 16:04:48 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2019-02-05 16:04:52 [DEBUG   ] Got command RPT from MCS: ref #1411051
2019-02-05 16:04:52 [DEBUG   ] summary = ERROR
2019-02-05 16:04:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411051  13 58519 57892277 A  ERRORERROR'
2019-02-05 16:04:52 [DEBUG   ] Got command RPT from MCS: ref #1411052
2019-02-05 16:04:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 16:04:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411052  77 58519 57892469 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 16:04:52 [DEBUG   ] Got command RPT from MCS: ref #1411053
2019-02-05 16:04:52 [DEBUG   ] summary = ERROR
2019-02-05 16:04:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411053  13 58519 57892673 A  ERRORERROR'
2019-02-05 16:04:52 [DEBUG   ] Got command RPT from MCS: ref #1411055
2019-02-05 16:04:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 16:04:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411055  77 58519 57892877 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 16:04:53 [DEBUG   ] Got command RPT from MCS: ref #1411056
2019-02-05 16:04:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 16:04:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411056  12 58519 57893069 A  ERRORB˜™š'
2019-02-05 16:05:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 16:05:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 16:05:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 16:05:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:05:45 [WARNING ] (13, 1, 'bot')
2019-02-05 16:05:45 [WARNING ] (13, 1, 'bot')
2019-02-05 16:05:45 [WARNING ] (13, 1, 'bot')
2019-02-05 16:05:45 [WARNING ] (13, 1, 'bot')
2019-02-05 16:05:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:05:45 [DEBUG   ] Finished updating board flags in 1.592 seconds
2019-02-05 16:05:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 16:06:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 16:06:11 [DEBUG   ] Got command RPT from MCS: ref #1411065
2019-02-05 16:06:11 [DEBUG   ] summary = ERROR
2019-02-05 16:06:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411065  13 58519 57971965 A  ERRORERROR'
2019-02-05 16:06:11 [DEBUG   ] Got command RPT from MCS: ref #1411066
2019-02-05 16:06:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 16:06:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411066  77 58519 57971966 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 16:06:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 16:06:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:06:45 [WARNING ] (13, 1, 'bot')
2019-02-05 16:06:45 [WARNING ] (13, 1, 'bot')
2019-02-05 16:06:45 [WARNING ] (13, 1, 'bot')
2019-02-05 16:06:45 [WARNING ] (13, 1, 'bot')
2019-02-05 16:06:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:06:45 [DEBUG   ] Finished updating board flags in 1.382 seconds
2019-02-05 16:06:48 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-05 16:07:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 16:07:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 16:07:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:07:46 [WARNING ] (13, 1, 'bot')
2019-02-05 16:07:46 [WARNING ] (13, 1, 'bot')
2019-02-05 16:07:46 [WARNING ] (13, 1, 'bot')
2019-02-05 16:07:46 [WARNING ] (13, 1, 'bot')
2019-02-05 16:07:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:07:46 [DEBUG   ] Finished updating board flags in 1.560 seconds
2019-02-05 16:07:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 16:08:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-05 16:08:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 16:08:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:08:46 [WARNING ] (13, 1, 'bot')
2019-02-05 16:08:46 [WARNING ] (13, 1, 'bot')
2019-02-05 16:08:46 [WARNING ] (13, 1, 'bot')
2019-02-05 16:08:46 [WARNING ] (13, 1, 'bot')
2019-02-05 16:08:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:08:46 [DEBUG   ] Finished updating board flags in 2.132 seconds
2019-02-05 16:08:48 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-05 16:09:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 16:09:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-05 16:09:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 16:09:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:09:46 [WARNING ] (13, 1, 'bot')
2019-02-05 16:09:46 [WARNING ] (13, 1, 'bot')
2019-02-05 16:09:46 [WARNING ] (13, 1, 'bot')
2019-02-05 16:09:46 [WARNING ] (13, 1, 'bot')
2019-02-05 16:09:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:09:46 [DEBUG   ] Finished updating board flags in 2.045 seconds
2019-02-05 16:09:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 16:09:52 [DEBUG   ] Got command RPT from MCS: ref #1411086
2019-02-05 16:09:52 [DEBUG   ] summary = ERROR
2019-02-05 16:09:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411086  13 58519 58192357 A  ERRORERROR'
2019-02-05 16:09:52 [DEBUG   ] Got command RPT from MCS: ref #1411087
2019-02-05 16:09:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 16:09:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411087  77 58519 58192561 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 16:09:52 [DEBUG   ] Got command RPT from MCS: ref #1411088
2019-02-05 16:09:52 [DEBUG   ] summary = ERROR
2019-02-05 16:09:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411088  13 58519 58192765 A  ERRORERROR'
2019-02-05 16:09:52 [DEBUG   ] Got command RPT from MCS: ref #1411089
2019-02-05 16:09:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 16:09:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411089  77 58519 58192957 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 16:09:53 [DEBUG   ] Got command RPT from MCS: ref #1411090
2019-02-05 16:09:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 16:09:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411090  12 58519 58193161 A  ERRORB™™š'
2019-02-05 16:10:08 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-05 16:10:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 16:10:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:10:46 [WARNING ] (13, 1, 'bot')
2019-02-05 16:10:46 [WARNING ] (13, 1, 'bot')
2019-02-05 16:10:46 [WARNING ] (13, 1, 'bot')
2019-02-05 16:10:46 [WARNING ] (13, 1, 'bot')
2019-02-05 16:10:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:10:46 [DEBUG   ] Finished updating board flags in 1.877 seconds
2019-02-05 16:10:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 16:11:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 16:11:11 [DEBUG   ] Got command RPT from MCS: ref #1411095
2019-02-05 16:11:11 [DEBUG   ] summary = ERROR
2019-02-05 16:11:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411095  13 58519 58271961 A  ERRORERROR'
2019-02-05 16:11:11 [DEBUG   ] Got command RPT from MCS: ref #1411096
2019-02-05 16:11:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 16:11:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411096  77 58519 58271962 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 16:11:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-05 16:11:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:11:46 [WARNING ] (13, 1, 'bot')
2019-02-05 16:11:46 [WARNING ] (13, 1, 'bot')
2019-02-05 16:11:46 [WARNING ] (13, 1, 'bot')
2019-02-05 16:11:46 [WARNING ] (13, 1, 'bot')
2019-02-05 16:11:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:11:46 [DEBUG   ] Finished updating board flags in 1.827 seconds
2019-02-05 16:11:48 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-05 16:12:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 16:12:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 16:12:45 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-02-05 16:12:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:12:46 [WARNING ] (13, 1, 'bot')
2019-02-05 16:12:46 [WARNING ] (13, 1, 'bot')
2019-02-05 16:12:46 [WARNING ] (13, 1, 'bot')
2019-02-05 16:12:46 [WARNING ] (13, 1, 'bot')
2019-02-05 16:12:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:12:46 [DEBUG   ] Finished updating board flags in 1.814 seconds
2019-02-05 16:12:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 16:13:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 16:13:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 16:13:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:13:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-02-05 16:13:46 [WARNING ] (13, 1, 'bot')
2019-02-05 16:13:46 [WARNING ] (13, 1, 'bot')
2019-02-05 16:13:46 [WARNING ] (13, 1, 'bot')
2019-02-05 16:13:46 [WARNING ] (13, 1, 'bot')
2019-02-05 16:13:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:13:46 [DEBUG   ] Finished updating board flags in 1.785 seconds
2019-02-05 16:13:48 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2019-02-05 16:14:08 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-05 16:14:29 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-02-05 16:14:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:14:46 [WARNING ] (13, 1, 'bot')
2019-02-05 16:14:46 [WARNING ] (13, 1, 'bot')
2019-02-05 16:14:46 [WARNING ] (13, 1, 'bot')
2019-02-05 16:14:46 [WARNING ] (13, 1, 'bot')
2019-02-05 16:14:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:14:46 [DEBUG   ] Finished updating board flags in 1.620 seconds
2019-02-05 16:14:49 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-05 16:14:52 [DEBUG   ] Got command RPT from MCS: ref #1411118
2019-02-05 16:14:52 [DEBUG   ] summary = ERROR
2019-02-05 16:14:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411118  13 58519 58492441 A  ERRORERROR'
2019-02-05 16:14:52 [DEBUG   ] Got command RPT from MCS: ref #1411119
2019-02-05 16:14:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 16:14:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411119  77 58519 58492645 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 16:14:52 [DEBUG   ] Got command RPT from MCS: ref #1411120
2019-02-05 16:14:52 [DEBUG   ] summary = ERROR
2019-02-05 16:14:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411120  13 58519 58492849 A  ERRORERROR'
2019-02-05 16:14:53 [DEBUG   ] Got command RPT from MCS: ref #1411121
2019-02-05 16:14:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 16:14:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411121  77 58519 58493041 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 16:14:53 [DEBUG   ] Got command RPT from MCS: ref #1411123
2019-02-05 16:14:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 16:14:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411123  12 58519 58493245 A  ERRORBš™š'
2019-02-05 16:15:09 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-05 16:15:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 16:15:45 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 16:15:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:15:46 [WARNING ] (13, 1, 'bot')
2019-02-05 16:15:46 [WARNING ] (13, 1, 'bot')
2019-02-05 16:15:46 [WARNING ] (13, 1, 'bot')
2019-02-05 16:15:46 [WARNING ] (13, 1, 'bot')
2019-02-05 16:15:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:15:46 [DEBUG   ] Finished updating board flags in 1.570 seconds
2019-02-05 16:15:49 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 16:16:09 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-05 16:16:11 [DEBUG   ] Got command RPT from MCS: ref #1411128
2019-02-05 16:16:11 [DEBUG   ] summary = ERROR
2019-02-05 16:16:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411128  13 58519 58571961 A  ERRORERROR'
2019-02-05 16:16:11 [DEBUG   ] Got command RPT from MCS: ref #1411129
2019-02-05 16:16:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 16:16:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411129  77 58519 58571962 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 16:16:29 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-05 16:16:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:16:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-02-05 16:16:46 [WARNING ] (13, 1, 'bot')
2019-02-05 16:16:46 [WARNING ] (13, 1, 'bot')
2019-02-05 16:16:46 [WARNING ] (13, 1, 'bot')
2019-02-05 16:16:46 [WARNING ] (13, 1, 'bot')
2019-02-05 16:16:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:16:46 [DEBUG   ] Finished updating board flags in 1.405 seconds
2019-02-05 16:16:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 16:17:09 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 16:17:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 16:17:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:17:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-02-05 16:17:46 [WARNING ] (13, 1, 'bot')
2019-02-05 16:17:46 [WARNING ] (13, 1, 'bot')
2019-02-05 16:17:46 [WARNING ] (13, 1, 'bot')
2019-02-05 16:17:46 [WARNING ] (13, 1, 'bot')
2019-02-05 16:17:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:17:46 [DEBUG   ] Finished updating board flags in 1.499 seconds
2019-02-05 16:17:49 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-05 16:18:09 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 16:18:29 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 16:18:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:18:46 [WARNING ] (13, 1, 'bot')
2019-02-05 16:18:46 [WARNING ] (13, 1, 'bot')
2019-02-05 16:18:46 [WARNING ] (13, 1, 'bot')
2019-02-05 16:18:46 [WARNING ] (13, 1, 'bot')
2019-02-05 16:18:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:18:46 [DEBUG   ] Finished updating board flags in 1.501 seconds
2019-02-05 16:18:49 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-05 16:19:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 16:19:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 16:19:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:19:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:19:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:19:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:19:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:19:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:19:47 [DEBUG   ] Finished updating board flags in 2.245 seconds
2019-02-05 16:19:49 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-05 16:19:52 [DEBUG   ] Got command RPT from MCS: ref #1411149
2019-02-05 16:19:52 [DEBUG   ] summary = ERROR
2019-02-05 16:19:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411149  13 58519 58792529 A  ERRORERROR'
2019-02-05 16:19:52 [DEBUG   ] Got command RPT from MCS: ref #1411150
2019-02-05 16:19:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 16:19:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411150  77 58519 58792733 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 16:19:52 [DEBUG   ] Got command RPT from MCS: ref #1411151
2019-02-05 16:19:52 [DEBUG   ] summary = ERROR
2019-02-05 16:19:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411151  13 58519 58792925 A  ERRORERROR'
2019-02-05 16:19:53 [DEBUG   ] Got command RPT from MCS: ref #1411152
2019-02-05 16:19:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 16:19:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411152  77 58519 58793129 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 16:19:53 [DEBUG   ] Got command RPT from MCS: ref #1411153
2019-02-05 16:19:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 16:19:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411153  12 58519 58793333 A  ERRORB™™š'
2019-02-05 16:20:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 16:20:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 16:20:46 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 16:20:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:20:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:20:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:20:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:20:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:20:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:20:47 [DEBUG   ] Finished updating board flags in 2.145 seconds
2019-02-05 16:20:49 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-05 16:21:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 16:21:11 [DEBUG   ] Got command RPT from MCS: ref #1411158
2019-02-05 16:21:11 [DEBUG   ] summary = ERROR
2019-02-05 16:21:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411158  13 58519 58871965 A  ERRORERROR'
2019-02-05 16:21:11 [DEBUG   ] Got command RPT from MCS: ref #1411159
2019-02-05 16:21:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 16:21:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411159  77 58519 58871966 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 16:21:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 16:21:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:21:47 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 16:21:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:21:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:21:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:21:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:21:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:21:47 [DEBUG   ] Finished updating board flags in 2.058 seconds
2019-02-05 16:21:49 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-05 16:22:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 16:22:29 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-05 16:22:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:22:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:22:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:22:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:22:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:22:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:22:47 [DEBUG   ] Finished updating board flags in 2.037 seconds
2019-02-05 16:22:49 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-05 16:23:09 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-05 16:23:29 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-05 16:23:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:23:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:23:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:23:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:23:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:23:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:23:47 [DEBUG   ] Finished updating board flags in 1.918 seconds
2019-02-05 16:23:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 16:24:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 16:24:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 16:24:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:24:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:24:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:24:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:24:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:24:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:24:47 [DEBUG   ] Finished updating board flags in 1.814 seconds
2019-02-05 16:24:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 16:24:52 [DEBUG   ] Got command RPT from MCS: ref #1411181
2019-02-05 16:24:52 [DEBUG   ] summary = ERROR
2019-02-05 16:24:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411181  13 58519 59092617 A  ERRORERROR'
2019-02-05 16:24:52 [DEBUG   ] Got command RPT from MCS: ref #1411182
2019-02-05 16:24:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 16:24:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411182  77 58519 59092809 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 16:24:53 [DEBUG   ] Got command RPT from MCS: ref #1411183
2019-02-05 16:24:53 [DEBUG   ] summary = ERROR
2019-02-05 16:24:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411183  13 58519 59093013 A  ERRORERROR'
2019-02-05 16:24:53 [DEBUG   ] Got command RPT from MCS: ref #1411185
2019-02-05 16:24:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 16:24:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411185  77 58519 59093217 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 16:24:53 [DEBUG   ] Got command RPT from MCS: ref #1411186
2019-02-05 16:24:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 16:24:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411186  12 58519 59093421 A  ERRORB˜™š'
2019-02-05 16:25:09 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-05 16:25:29 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-02-05 16:25:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:25:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:25:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:25:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:25:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:25:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:25:47 [DEBUG   ] Finished updating board flags in 1.806 seconds
2019-02-05 16:25:49 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-05 16:26:10 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-02-05 16:26:11 [DEBUG   ] Got command RPT from MCS: ref #1411195
2019-02-05 16:26:11 [DEBUG   ] summary = ERROR
2019-02-05 16:26:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411195  13 58519 59171965 A  ERRORERROR'
2019-02-05 16:26:11 [DEBUG   ] Got command RPT from MCS: ref #1411196
2019-02-05 16:26:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 16:26:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411196  77 58519 59171966 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 16:26:30 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-02-05 16:26:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:26:47 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 16:26:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:26:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:26:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:26:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:26:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:26:47 [DEBUG   ] Finished updating board flags in 1.791 seconds
2019-02-05 16:26:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 16:27:10 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 16:27:30 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 16:27:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:27:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:27:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:27:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:27:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:27:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:27:47 [DEBUG   ] Finished updating board flags in 1.598 seconds
2019-02-05 16:27:50 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2019-02-05 16:28:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 16:28:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 16:28:46 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 16:28:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:28:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:28:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:28:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:28:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:28:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:28:47 [DEBUG   ] Finished updating board flags in 1.430 seconds
2019-02-05 16:28:50 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 16:29:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 16:29:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 16:29:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:29:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-05 16:29:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:29:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:29:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:29:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:29:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:29:47 [DEBUG   ] Finished updating board flags in 1.467 seconds
2019-02-05 16:29:50 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-05 16:29:52 [DEBUG   ] Got command RPT from MCS: ref #1411216
2019-02-05 16:29:52 [DEBUG   ] summary = ERROR
2019-02-05 16:29:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411216  13 58519 59392693 A  ERRORERROR'
2019-02-05 16:29:52 [DEBUG   ] Got command RPT from MCS: ref #1411217
2019-02-05 16:29:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 16:29:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411217  77 58519 59392897 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 16:29:53 [DEBUG   ] Got command RPT from MCS: ref #1411218
2019-02-05 16:29:53 [DEBUG   ] summary = ERROR
2019-02-05 16:29:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411218  13 58519 59393101 A  ERRORERROR'
2019-02-05 16:29:53 [DEBUG   ] Got command RPT from MCS: ref #1411219
2019-02-05 16:29:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 16:29:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411219  77 58519 59393305 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 16:29:53 [DEBUG   ] Got command RPT from MCS: ref #1411220
2019-02-05 16:29:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 16:29:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411220  12 58519 59393497 A  ERRORB˜™š'
2019-02-05 16:30:10 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-05 16:30:30 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-05 16:30:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 16:30:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:30:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:30:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:30:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:30:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:30:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:30:47 [DEBUG   ] Finished updating board flags in 1.463 seconds
2019-02-05 16:30:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 16:31:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 16:31:11 [DEBUG   ] Got command RPT from MCS: ref #1411221
2019-02-05 16:31:11 [DEBUG   ] summary = ERROR
2019-02-05 16:31:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411221  13 58519 59471961 A  ERRORERROR'
2019-02-05 16:31:11 [DEBUG   ] Got command RPT from MCS: ref #1411222
2019-02-05 16:31:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 16:31:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411222  77 58519 59471962 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 16:31:30 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-05 16:31:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:31:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:31:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:31:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:31:47 [WARNING ] (13, 1, 'bot')
2019-02-05 16:31:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:31:47 [DEBUG   ] Finished updating board flags in 1.466 seconds
2019-02-05 16:31:50 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2019-02-05 16:32:10 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-05 16:32:31 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-02-05 16:32:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 16:32:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:32:48 [WARNING ] (13, 1, 'bot')
2019-02-05 16:32:48 [WARNING ] (13, 1, 'bot')
2019-02-05 16:32:48 [WARNING ] (13, 1, 'bot')
2019-02-05 16:32:48 [WARNING ] (13, 1, 'bot')
2019-02-05 16:32:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:32:48 [DEBUG   ] Finished updating board flags in 2.202 seconds
2019-02-05 16:32:51 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-02-05 16:33:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 16:33:31 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 16:33:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:33:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 16:33:48 [WARNING ] (13, 1, 'bot')
2019-02-05 16:33:48 [WARNING ] (13, 1, 'bot')
2019-02-05 16:33:48 [WARNING ] (13, 1, 'bot')
2019-02-05 16:33:48 [WARNING ] (13, 1, 'bot')
2019-02-05 16:33:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:33:48 [DEBUG   ] Finished updating board flags in 2.185 seconds
2019-02-05 16:33:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 16:34:11 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-05 16:34:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 16:34:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:34:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-02-05 16:34:48 [WARNING ] (13, 1, 'bot')
2019-02-05 16:34:48 [WARNING ] (13, 1, 'bot')
2019-02-05 16:34:48 [WARNING ] (13, 1, 'bot')
2019-02-05 16:34:48 [WARNING ] (13, 1, 'bot')
2019-02-05 16:34:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:34:48 [DEBUG   ] Finished updating board flags in 2.104 seconds
2019-02-05 16:34:51 [DEBUG   ] Finished updating ant stats in 1.184 seconds
2019-02-05 16:34:52 [DEBUG   ] Got command RPT from MCS: ref #1411244
2019-02-05 16:34:52 [DEBUG   ] summary = ERROR
2019-02-05 16:34:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411244  13 58519 59692785 A  ERRORERROR'
2019-02-05 16:34:52 [DEBUG   ] Got command RPT from MCS: ref #1411245
2019-02-05 16:34:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 16:34:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411245  77 58519 59692989 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 16:34:53 [DEBUG   ] Got command RPT from MCS: ref #1411246
2019-02-05 16:34:53 [DEBUG   ] summary = ERROR
2019-02-05 16:34:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411246  13 58519 59693181 A  ERRORERROR'
2019-02-05 16:34:53 [DEBUG   ] Got command RPT from MCS: ref #1411248
2019-02-05 16:34:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 16:34:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411248  77 58519 59693385 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 16:34:53 [DEBUG   ] Got command RPT from MCS: ref #1411249
2019-02-05 16:34:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 16:34:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411249  12 58519 59693589 A  ERRORBš™š'
2019-02-05 16:35:11 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-02-05 16:35:31 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-05 16:35:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:35:48 [WARNING ] (13, 1, 'bot')
2019-02-05 16:35:48 [WARNING ] (13, 1, 'bot')
2019-02-05 16:35:48 [WARNING ] (13, 1, 'bot')
2019-02-05 16:35:48 [WARNING ] (13, 1, 'bot')
2019-02-05 16:35:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:35:48 [DEBUG   ] Finished updating board flags in 1.890 seconds
2019-02-05 16:35:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 16:36:11 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-05 16:36:11 [DEBUG   ] Got command RPT from MCS: ref #1411258
2019-02-05 16:36:11 [DEBUG   ] summary = ERROR
2019-02-05 16:36:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411258  13 58519 59771965 A  ERRORERROR'
2019-02-05 16:36:11 [DEBUG   ] Got command RPT from MCS: ref #1411259
2019-02-05 16:36:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 16:36:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411259  77 58519 59771966 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 16:36:31 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-05 16:36:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 16:36:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:36:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 16:36:48 [WARNING ] (13, 1, 'bot')
2019-02-05 16:36:48 [WARNING ] (13, 1, 'bot')
2019-02-05 16:36:48 [WARNING ] (13, 1, 'bot')
2019-02-05 16:36:48 [WARNING ] (13, 1, 'bot')
2019-02-05 16:36:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:36:48 [DEBUG   ] Finished updating board flags in 1.819 seconds
2019-02-05 16:36:51 [DEBUG   ] Finished updating ant stats in 0.570 seconds
2019-02-05 16:37:11 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-05 16:37:32 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-02-05 16:37:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:37:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-05 16:37:48 [WARNING ] (13, 1, 'bot')
2019-02-05 16:37:48 [WARNING ] (13, 1, 'bot')
2019-02-05 16:37:48 [WARNING ] (13, 1, 'bot')
2019-02-05 16:37:48 [WARNING ] (13, 1, 'bot')
2019-02-05 16:37:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:37:48 [DEBUG   ] Finished updating board flags in 1.798 seconds
2019-02-05 16:37:52 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-05 16:38:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 16:38:32 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 16:38:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:38:48 [WARNING ] (13, 1, 'bot')
2019-02-05 16:38:48 [WARNING ] (13, 1, 'bot')
2019-02-05 16:38:48 [WARNING ] (13, 1, 'bot')
2019-02-05 16:38:48 [WARNING ] (13, 1, 'bot')
2019-02-05 16:38:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:38:48 [DEBUG   ] Finished updating board flags in 1.600 seconds
2019-02-05 16:38:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 16:39:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 16:39:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 16:39:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:39:48 [WARNING ] (13, 1, 'bot')
2019-02-05 16:39:48 [WARNING ] (13, 1, 'bot')
2019-02-05 16:39:48 [WARNING ] (13, 1, 'bot')
2019-02-05 16:39:48 [WARNING ] (13, 1, 'bot')
2019-02-05 16:39:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:39:48 [DEBUG   ] Finished updating board flags in 1.411 seconds
2019-02-05 16:39:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 16:39:52 [DEBUG   ] Got command RPT from MCS: ref #1411279
2019-02-05 16:39:52 [DEBUG   ] summary = ERROR
2019-02-05 16:39:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411279  13 58519 59992865 A  ERRORERROR'
2019-02-05 16:39:53 [DEBUG   ] Got command RPT from MCS: ref #1411280
2019-02-05 16:39:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 16:39:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411280  77 58519 59993069 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 16:39:53 [DEBUG   ] Got command RPT from MCS: ref #1411281
2019-02-05 16:39:53 [DEBUG   ] summary = ERROR
2019-02-05 16:39:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411281  13 58519 59993273 A  ERRORERROR'
2019-02-05 16:39:53 [DEBUG   ] Got command RPT from MCS: ref #1411282
2019-02-05 16:39:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 16:39:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411282  77 58519 59993465 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 16:39:53 [DEBUG   ] Got command RPT from MCS: ref #1411283
2019-02-05 16:39:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 16:39:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411283  12 58519 59993669 A  ERRORB™™š'
2019-02-05 16:40:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 16:40:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 16:40:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:40:48 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 16:40:48 [WARNING ] (13, 1, 'bot')
2019-02-05 16:40:48 [WARNING ] (13, 1, 'bot')
2019-02-05 16:40:48 [WARNING ] (13, 1, 'bot')
2019-02-05 16:40:48 [WARNING ] (13, 1, 'bot')
2019-02-05 16:40:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:40:48 [DEBUG   ] Finished updating board flags in 1.392 seconds
2019-02-05 16:40:52 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 16:41:11 [DEBUG   ] Got command RPT from MCS: ref #1411288
2019-02-05 16:41:11 [DEBUG   ] summary = ERROR
2019-02-05 16:41:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411288  13 58519 60071969 A  ERRORERROR'
2019-02-05 16:41:11 [DEBUG   ] Got command RPT from MCS: ref #1411289
2019-02-05 16:41:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 16:41:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411289  77 58519 60071970 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 16:41:12 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 16:41:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 16:41:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 16:41:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:41:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 16:41:48 [WARNING ] (13, 1, 'bot')
2019-02-05 16:41:48 [WARNING ] (13, 1, 'bot')
2019-02-05 16:41:48 [WARNING ] (13, 1, 'bot')
2019-02-05 16:41:48 [WARNING ] (13, 1, 'bot')
2019-02-05 16:41:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:41:48 [DEBUG   ] Finished updating board flags in 1.461 seconds
2019-02-05 16:41:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 16:42:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 16:42:32 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 16:42:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:42:49 [WARNING ] (13, 1, 'bot')
2019-02-05 16:42:49 [WARNING ] (13, 1, 'bot')
2019-02-05 16:42:49 [WARNING ] (13, 1, 'bot')
2019-02-05 16:42:49 [WARNING ] (13, 1, 'bot')
2019-02-05 16:42:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:42:49 [DEBUG   ] Finished updating board flags in 2.268 seconds
2019-02-05 16:42:52 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-02-05 16:43:12 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-05 16:43:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 16:43:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:43:49 [WARNING ] (13, 1, 'bot')
2019-02-05 16:43:49 [WARNING ] (13, 1, 'bot')
2019-02-05 16:43:49 [WARNING ] (13, 1, 'bot')
2019-02-05 16:43:49 [WARNING ] (13, 1, 'bot')
2019-02-05 16:43:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:43:49 [DEBUG   ] Finished updating board flags in 2.071 seconds
2019-02-05 16:43:52 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 16:44:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 16:44:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 16:44:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:44:49 [WARNING ] (13, 1, 'bot')
2019-02-05 16:44:49 [WARNING ] (13, 1, 'bot')
2019-02-05 16:44:49 [WARNING ] (13, 1, 'bot')
2019-02-05 16:44:49 [WARNING ] (13, 1, 'bot')
2019-02-05 16:44:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:44:49 [DEBUG   ] Finished updating board flags in 2.028 seconds
2019-02-05 16:44:52 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-05 16:44:52 [DEBUG   ] Got command RPT from MCS: ref #1411311
2019-02-05 16:44:52 [DEBUG   ] summary = ERROR
2019-02-05 16:44:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411311  13 58519 60292949 A  ERRORERROR'
2019-02-05 16:44:53 [DEBUG   ] Got command RPT from MCS: ref #1411312
2019-02-05 16:44:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 16:44:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411312  77 58519 60293153 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 16:44:53 [DEBUG   ] Got command RPT from MCS: ref #1411313
2019-02-05 16:44:53 [DEBUG   ] summary = ERROR
2019-02-05 16:44:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411313  13 58519 60293357 A  ERRORERROR'
2019-02-05 16:44:53 [DEBUG   ] Got command RPT from MCS: ref #1411314
2019-02-05 16:44:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 16:44:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411314  77 58519 60293561 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 16:44:53 [DEBUG   ] Got command RPT from MCS: ref #1411316
2019-02-05 16:44:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 16:44:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411316  12 58519 60293753 A  ERRORB˜™š'
2019-02-05 16:45:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-05 16:45:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 16:45:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:45:49 [WARNING ] (13, 1, 'bot')
2019-02-05 16:45:49 [WARNING ] (13, 1, 'bot')
2019-02-05 16:45:49 [WARNING ] (13, 1, 'bot')
2019-02-05 16:45:49 [WARNING ] (13, 1, 'bot')
2019-02-05 16:45:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:45:49 [DEBUG   ] Finished updating board flags in 1.984 seconds
2019-02-05 16:45:52 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-05 16:46:11 [DEBUG   ] Got command RPT from MCS: ref #1411321
2019-02-05 16:46:11 [DEBUG   ] summary = ERROR
2019-02-05 16:46:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411321  13 58519 60371969 A  ERRORERROR'
2019-02-05 16:46:11 [DEBUG   ] Got command RPT from MCS: ref #1411322
2019-02-05 16:46:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 16:46:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411322  77 58519 60371970 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 16:46:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 16:46:32 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-05 16:46:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:46:49 [WARNING ] (13, 1, 'bot')
2019-02-05 16:46:49 [WARNING ] (13, 1, 'bot')
2019-02-05 16:46:49 [WARNING ] (13, 1, 'bot')
2019-02-05 16:46:49 [WARNING ] (13, 1, 'bot')
2019-02-05 16:46:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:46:49 [DEBUG   ] Finished updating board flags in 1.822 seconds
2019-02-05 16:46:52 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-05 16:47:12 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-05 16:47:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 16:47:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:47:49 [WARNING ] (13, 1, 'bot')
2019-02-05 16:47:49 [WARNING ] (13, 1, 'bot')
2019-02-05 16:47:49 [WARNING ] (13, 1, 'bot')
2019-02-05 16:47:49 [WARNING ] (13, 1, 'bot')
2019-02-05 16:47:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:47:49 [DEBUG   ] Finished updating board flags in 1.786 seconds
2019-02-05 16:47:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 16:48:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 16:48:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 16:48:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:48:49 [WARNING ] (13, 1, 'bot')
2019-02-05 16:48:49 [WARNING ] (13, 1, 'bot')
2019-02-05 16:48:49 [WARNING ] (13, 1, 'bot')
2019-02-05 16:48:49 [WARNING ] (13, 1, 'bot')
2019-02-05 16:48:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:48:49 [DEBUG   ] Finished updating board flags in 1.633 seconds
2019-02-05 16:48:52 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-05 16:49:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 16:49:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 16:49:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:49:49 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 16:49:49 [WARNING ] (13, 1, 'bot')
2019-02-05 16:49:49 [WARNING ] (13, 1, 'bot')
2019-02-05 16:49:49 [WARNING ] (13, 1, 'bot')
2019-02-05 16:49:49 [WARNING ] (13, 1, 'bot')
2019-02-05 16:49:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:49:49 [DEBUG   ] Finished updating board flags in 1.579 seconds
2019-02-05 16:49:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 16:49:53 [DEBUG   ] Got command RPT from MCS: ref #1411342
2019-02-05 16:49:53 [DEBUG   ] summary = ERROR
2019-02-05 16:49:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411342  13 58519 60593037 A  ERRORERROR'
2019-02-05 16:49:53 [DEBUG   ] Got command RPT from MCS: ref #1411343
2019-02-05 16:49:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 16:49:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411343  77 58519 60593241 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 16:49:53 [DEBUG   ] Got command RPT from MCS: ref #1411344
2019-02-05 16:49:53 [DEBUG   ] summary = ERROR
2019-02-05 16:49:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411344  13 58519 60593445 A  ERRORERROR'
2019-02-05 16:49:53 [DEBUG   ] Got command RPT from MCS: ref #1411345
2019-02-05 16:49:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 16:49:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411345  77 58519 60593637 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 16:49:53 [DEBUG   ] Got command RPT from MCS: ref #1411346
2019-02-05 16:49:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 16:49:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411346  12 58519 60593841 A  ERRORB˜™š'
2019-02-05 16:50:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 16:50:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-05 16:50:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:50:49 [WARNING ] (13, 1, 'bot')
2019-02-05 16:50:49 [WARNING ] (13, 1, 'bot')
2019-02-05 16:50:49 [WARNING ] (13, 1, 'bot')
2019-02-05 16:50:49 [WARNING ] (13, 1, 'bot')
2019-02-05 16:50:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:50:49 [DEBUG   ] Finished updating board flags in 1.465 seconds
2019-02-05 16:50:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 16:51:11 [DEBUG   ] Got command RPT from MCS: ref #1411351
2019-02-05 16:51:11 [DEBUG   ] summary = ERROR
2019-02-05 16:51:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411351  13 58519 60671978 A  ERRORERROR'
2019-02-05 16:51:11 [DEBUG   ] Got command RPT from MCS: ref #1411352
2019-02-05 16:51:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 16:51:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411352  77 58519 60671978 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 16:51:12 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-05 16:51:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 16:51:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:51:49 [WARNING ] (13, 1, 'bot')
2019-02-05 16:51:49 [WARNING ] (13, 1, 'bot')
2019-02-05 16:51:49 [WARNING ] (13, 1, 'bot')
2019-02-05 16:51:49 [WARNING ] (13, 1, 'bot')
2019-02-05 16:51:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:51:49 [DEBUG   ] Finished updating board flags in 1.540 seconds
2019-02-05 16:51:52 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-05 16:52:12 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-05 16:52:32 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-05 16:52:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:52:50 [WARNING ] (13, 1, 'bot')
2019-02-05 16:52:50 [WARNING ] (13, 1, 'bot')
2019-02-05 16:52:50 [WARNING ] (13, 1, 'bot')
2019-02-05 16:52:50 [WARNING ] (13, 1, 'bot')
2019-02-05 16:52:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:52:50 [DEBUG   ] Finished updating board flags in 2.292 seconds
2019-02-05 16:52:53 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-02-05 16:53:13 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-05 16:53:33 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-05 16:53:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:53:50 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 16:53:50 [WARNING ] (13, 1, 'bot')
2019-02-05 16:53:50 [WARNING ] (13, 1, 'bot')
2019-02-05 16:53:50 [WARNING ] (13, 1, 'bot')
2019-02-05 16:53:50 [WARNING ] (13, 1, 'bot')
2019-02-05 16:53:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:53:50 [DEBUG   ] Finished updating board flags in 2.097 seconds
2019-02-05 16:53:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 16:54:13 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 16:54:33 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-02-05 16:54:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:54:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 16:54:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2019-02-05 16:54:50 [WARNING ] (13, 1, 'bot')
2019-02-05 16:54:50 [WARNING ] (13, 1, 'bot')
2019-02-05 16:54:50 [WARNING ] (13, 1, 'bot')
2019-02-05 16:54:50 [WARNING ] (13, 1, 'bot')
2019-02-05 16:54:50 [WARNING ] (25, 5, 'bot')
2019-02-05 16:54:50 [WARNING ] (25, 5, 'bot')
2019-02-05 16:54:50 [WARNING ] (25, 5, 'bot')
2019-02-05 16:54:50 [WARNING ] (25, 5, 'bot')
2019-02-05 16:54:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:54:50 [DEBUG   ] Finished updating board flags in 2.042 seconds
2019-02-05 16:54:53 [DEBUG   ] Got command RPT from MCS: ref #1411374
2019-02-05 16:54:53 [DEBUG   ] summary = ERROR
2019-02-05 16:54:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411374  13 58519 60893125 A  ERRORERROR'
2019-02-05 16:54:53 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-05 16:54:53 [DEBUG   ] Got command RPT from MCS: ref #1411375
2019-02-05 16:54:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 16:54:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411375  77 58519 60893321 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 16:54:53 [DEBUG   ] Got command RPT from MCS: ref #1411376
2019-02-05 16:54:53 [DEBUG   ] summary = ERROR
2019-02-05 16:54:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411376  13 58519 60893525 A  ERRORERROR'
2019-02-05 16:54:53 [DEBUG   ] Got command RPT from MCS: ref #1411378
2019-02-05 16:54:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 16:54:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411378  77 58519 60893729 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 16:54:53 [DEBUG   ] Got command RPT from MCS: ref #1411379
2019-02-05 16:54:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 16:54:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411379  12 58519 60893933 A  ERRORB™™š'
2019-02-05 16:55:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 16:55:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 16:55:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-02-05 16:55:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:55:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2019-02-05 16:55:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-05 16:55:50 [WARNING ] (13, 1, 'bot')
2019-02-05 16:55:50 [WARNING ] (13, 1, 'bot')
2019-02-05 16:55:50 [WARNING ] (13, 1, 'bot')
2019-02-05 16:55:50 [WARNING ] (13, 1, 'bot')
2019-02-05 16:55:50 [WARNING ] (25, 5, 'bot')
2019-02-05 16:55:50 [WARNING ] (25, 5, 'bot')
2019-02-05 16:55:50 [WARNING ] (25, 5, 'bot')
2019-02-05 16:55:50 [WARNING ] (25, 5, 'bot')
2019-02-05 16:55:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:55:50 [DEBUG   ] Finished updating board flags in 1.977 seconds
2019-02-05 16:55:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 16:56:11 [DEBUG   ] Got command RPT from MCS: ref #1411388
2019-02-05 16:56:11 [DEBUG   ] summary = ERROR
2019-02-05 16:56:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411388  13 58519 60971969 A  ERRORERROR'
2019-02-05 16:56:11 [DEBUG   ] Got command RPT from MCS: ref #1411389
2019-02-05 16:56:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 16:56:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411389  77 58519 60971970 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 16:56:13 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-05 16:56:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 16:56:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:56:50 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 16:56:50 [WARNING ] (13, 1, 'bot')
2019-02-05 16:56:50 [WARNING ] (13, 1, 'bot')
2019-02-05 16:56:50 [WARNING ] (13, 1, 'bot')
2019-02-05 16:56:50 [WARNING ] (13, 1, 'bot')
2019-02-05 16:56:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:56:50 [DEBUG   ] Finished updating board flags in 1.818 seconds
2019-02-05 16:56:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 16:57:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 16:57:33 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-05 16:57:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:57:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-02-05 16:57:50 [WARNING ] (13, 1, 'bot')
2019-02-05 16:57:50 [WARNING ] (13, 1, 'bot')
2019-02-05 16:57:50 [WARNING ] (13, 1, 'bot')
2019-02-05 16:57:50 [WARNING ] (13, 1, 'bot')
2019-02-05 16:57:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:57:50 [DEBUG   ] Finished updating board flags in 1.811 seconds
2019-02-05 16:57:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 16:58:13 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 16:58:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 16:58:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:58:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 16:58:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-02-05 16:58:50 [WARNING ] (13, 1, 'bot')
2019-02-05 16:58:50 [WARNING ] (13, 1, 'bot')
2019-02-05 16:58:50 [WARNING ] (13, 1, 'bot')
2019-02-05 16:58:50 [WARNING ] (13, 1, 'bot')
2019-02-05 16:58:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:58:50 [DEBUG   ] Finished updating board flags in 1.867 seconds
2019-02-05 16:58:53 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-05 16:59:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 16:59:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 16:59:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 16:59:50 [WARNING ] (13, 1, 'bot')
2019-02-05 16:59:50 [WARNING ] (13, 1, 'bot')
2019-02-05 16:59:50 [WARNING ] (13, 1, 'bot')
2019-02-05 16:59:50 [WARNING ] (13, 1, 'bot')
2019-02-05 16:59:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 16:59:50 [DEBUG   ] Finished updating board flags in 1.691 seconds
2019-02-05 16:59:53 [DEBUG   ] Got command RPT from MCS: ref #1411409
2019-02-05 16:59:53 [DEBUG   ] summary = ERROR
2019-02-05 16:59:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411409  13 58519 61193217 A  ERRORERROR'
2019-02-05 16:59:53 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-05 16:59:53 [DEBUG   ] Got command RPT from MCS: ref #1411410
2019-02-05 16:59:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 16:59:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411410  77 58519 61193409 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 16:59:53 [DEBUG   ] Got command RPT from MCS: ref #1411411
2019-02-05 16:59:53 [DEBUG   ] summary = ERROR
2019-02-05 16:59:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411411  13 58519 61193613 A  ERRORERROR'
2019-02-05 16:59:53 [DEBUG   ] Got command RPT from MCS: ref #1411412
2019-02-05 16:59:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 16:59:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411412  77 58519 61193817 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 16:59:54 [DEBUG   ] Got command RPT from MCS: ref #1411413
2019-02-05 16:59:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 16:59:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411413  12 58519 61194009 A  ERRORBš™š'
2019-02-05 17:00:13 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-05 17:00:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 17:00:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:00:50 [WARNING ] (13, 1, 'bot')
2019-02-05 17:00:50 [WARNING ] (13, 1, 'bot')
2019-02-05 17:00:50 [WARNING ] (13, 1, 'bot')
2019-02-05 17:00:50 [WARNING ] (13, 1, 'bot')
2019-02-05 17:00:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:00:50 [DEBUG   ] Finished updating board flags in 1.624 seconds
2019-02-05 17:00:53 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-02-05 17:01:11 [DEBUG   ] Got command RPT from MCS: ref #1411414
2019-02-05 17:01:11 [DEBUG   ] summary = ERROR
2019-02-05 17:01:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411414  13 58519 61271973 A  ERRORERROR'
2019-02-05 17:01:11 [DEBUG   ] Got command RPT from MCS: ref #1411415
2019-02-05 17:01:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 17:01:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411415  77 58519 61271974 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 17:01:13 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 17:01:33 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-02-05 17:01:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:01:50 [WARNING ] (13, 1, 'bot')
2019-02-05 17:01:50 [WARNING ] (13, 1, 'bot')
2019-02-05 17:01:50 [WARNING ] (13, 1, 'bot')
2019-02-05 17:01:50 [WARNING ] (13, 1, 'bot')
2019-02-05 17:01:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:01:50 [DEBUG   ] Finished updating board flags in 1.609 seconds
2019-02-05 17:01:54 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-02-05 17:02:14 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-02-05 17:02:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 17:02:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 17:02:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-02-05 17:02:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:02:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 17:02:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-02-05 17:02:50 [WARNING ] (13, 1, 'bot')
2019-02-05 17:02:50 [WARNING ] (13, 1, 'bot')
2019-02-05 17:02:50 [WARNING ] (13, 1, 'bot')
2019-02-05 17:02:50 [WARNING ] (13, 1, 'bot')
2019-02-05 17:02:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:02:50 [DEBUG   ] Finished updating board flags in 1.584 seconds
2019-02-05 17:02:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 17:03:14 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 17:03:34 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-05 17:03:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-02-05 17:03:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:03:50 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 17:03:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-02-05 17:03:50 [WARNING ] (13, 1, 'bot')
2019-02-05 17:03:50 [WARNING ] (13, 1, 'bot')
2019-02-05 17:03:50 [WARNING ] (13, 1, 'bot')
2019-02-05 17:03:50 [WARNING ] (13, 1, 'bot')
2019-02-05 17:03:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:03:50 [DEBUG   ] Finished updating board flags in 1.429 seconds
2019-02-05 17:03:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 17:04:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 17:04:34 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 17:04:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:04:50 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 17:04:50 [WARNING ] (13, 1, 'bot')
2019-02-05 17:04:50 [WARNING ] (13, 1, 'bot')
2019-02-05 17:04:50 [WARNING ] (13, 1, 'bot')
2019-02-05 17:04:50 [WARNING ] (13, 1, 'bot')
2019-02-05 17:04:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:04:50 [DEBUG   ] Finished updating board flags in 1.422 seconds
2019-02-05 17:04:53 [DEBUG   ] Got command RPT from MCS: ref #1411437
2019-02-05 17:04:53 [DEBUG   ] summary = ERROR
2019-02-05 17:04:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411437  13 58519 61493293 A  ERRORERROR'
2019-02-05 17:04:53 [DEBUG   ] Got command RPT from MCS: ref #1411438
2019-02-05 17:04:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 17:04:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411438  77 58519 61493497 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 17:04:53 [DEBUG   ] Got command RPT from MCS: ref #1411439
2019-02-05 17:04:53 [DEBUG   ] summary = ERROR
2019-02-05 17:04:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411439  13 58519 61493701 A  ERRORERROR'
2019-02-05 17:04:53 [DEBUG   ] Got command RPT from MCS: ref #1411441
2019-02-05 17:04:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 17:04:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411441  77 58519 61493893 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 17:04:54 [DEBUG   ] Got command RPT from MCS: ref #1411443
2019-02-05 17:04:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 17:04:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411443  12 58519 61494097 A  ERRORB™™š'
2019-02-05 17:04:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 17:05:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 17:05:34 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 17:05:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:05:50 [WARNING ] (13, 1, 'bot')
2019-02-05 17:05:50 [WARNING ] (13, 1, 'bot')
2019-02-05 17:05:50 [WARNING ] (13, 1, 'bot')
2019-02-05 17:05:50 [WARNING ] (13, 1, 'bot')
2019-02-05 17:05:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:05:50 [DEBUG   ] Finished updating board flags in 1.427 seconds
2019-02-05 17:05:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 17:06:11 [DEBUG   ] Got command RPT from MCS: ref #1411451
2019-02-05 17:06:11 [DEBUG   ] summary = ERROR
2019-02-05 17:06:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411451  13 58519 61571977 A  ERRORERROR'
2019-02-05 17:06:11 [DEBUG   ] Got command RPT from MCS: ref #1411452
2019-02-05 17:06:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 17:06:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411452  77 58519 61571978 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 17:06:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 17:06:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 17:06:49 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 17:06:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:06:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 17:06:50 [WARNING ] (13, 1, 'bot')
2019-02-05 17:06:50 [WARNING ] (13, 1, 'bot')
2019-02-05 17:06:50 [WARNING ] (13, 1, 'bot')
2019-02-05 17:06:50 [WARNING ] (13, 1, 'bot')
2019-02-05 17:06:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:06:50 [DEBUG   ] Finished updating board flags in 1.571 seconds
2019-02-05 17:06:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 17:07:14 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 17:07:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 17:07:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:07:51 [WARNING ] (13, 1, 'bot')
2019-02-05 17:07:51 [WARNING ] (13, 1, 'bot')
2019-02-05 17:07:51 [WARNING ] (13, 1, 'bot')
2019-02-05 17:07:51 [WARNING ] (13, 1, 'bot')
2019-02-05 17:07:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:07:51 [DEBUG   ] Finished updating board flags in 2.283 seconds
2019-02-05 17:07:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 17:08:14 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 17:08:34 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 17:08:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:08:51 [WARNING ] (13, 1, 'bot')
2019-02-05 17:08:51 [WARNING ] (13, 1, 'bot')
2019-02-05 17:08:51 [WARNING ] (13, 1, 'bot')
2019-02-05 17:08:51 [WARNING ] (13, 1, 'bot')
2019-02-05 17:08:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:08:51 [DEBUG   ] Finished updating board flags in 2.080 seconds
2019-02-05 17:08:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 17:09:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 17:09:34 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 17:09:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:09:51 [WARNING ] (13, 1, 'bot')
2019-02-05 17:09:51 [WARNING ] (13, 1, 'bot')
2019-02-05 17:09:51 [WARNING ] (13, 1, 'bot')
2019-02-05 17:09:51 [WARNING ] (13, 1, 'bot')
2019-02-05 17:09:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:09:51 [DEBUG   ] Finished updating board flags in 2.026 seconds
2019-02-05 17:09:53 [DEBUG   ] Got command RPT from MCS: ref #1411472
2019-02-05 17:09:53 [DEBUG   ] summary = ERROR
2019-02-05 17:09:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411472  13 58519 61793381 A  ERRORERROR'
2019-02-05 17:09:53 [DEBUG   ] Got command RPT from MCS: ref #1411473
2019-02-05 17:09:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 17:09:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411473  77 58519 61793585 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 17:09:53 [DEBUG   ] Got command RPT from MCS: ref #1411474
2019-02-05 17:09:53 [DEBUG   ] summary = ERROR
2019-02-05 17:09:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411474  13 58519 61793789 A  ERRORERROR'
2019-02-05 17:09:53 [DEBUG   ] Got command RPT from MCS: ref #1411475
2019-02-05 17:09:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 17:09:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411475  77 58519 61793993 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 17:09:54 [DEBUG   ] Got command RPT from MCS: ref #1411476
2019-02-05 17:09:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 17:09:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411476  12 58519 61794185 A  ERRORB™™š'
2019-02-05 17:09:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 17:10:14 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-02-05 17:10:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 17:10:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:10:51 [WARNING ] (13, 1, 'bot')
2019-02-05 17:10:51 [WARNING ] (13, 1, 'bot')
2019-02-05 17:10:51 [WARNING ] (13, 1, 'bot')
2019-02-05 17:10:51 [WARNING ] (13, 1, 'bot')
2019-02-05 17:10:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:10:51 [DEBUG   ] Finished updating board flags in 1.971 seconds
2019-02-05 17:10:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 17:11:11 [DEBUG   ] Got command RPT from MCS: ref #1411481
2019-02-05 17:11:11 [DEBUG   ] summary = ERROR
2019-02-05 17:11:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411481  13 58519 61871977 A  ERRORERROR'
2019-02-05 17:11:11 [DEBUG   ] Got command RPT from MCS: ref #1411482
2019-02-05 17:11:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 17:11:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411482  77 58519 61871978 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 17:11:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 17:11:34 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-05 17:11:50 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 17:11:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:11:51 [WARNING ] (13, 1, 'bot')
2019-02-05 17:11:51 [WARNING ] (13, 1, 'bot')
2019-02-05 17:11:51 [WARNING ] (13, 1, 'bot')
2019-02-05 17:11:51 [WARNING ] (13, 1, 'bot')
2019-02-05 17:11:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:11:51 [DEBUG   ] Finished updating board flags in 1.826 seconds
2019-02-05 17:11:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 17:12:14 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-05 17:12:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 17:12:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:12:51 [WARNING ] (13, 1, 'bot')
2019-02-05 17:12:51 [WARNING ] (13, 1, 'bot')
2019-02-05 17:12:51 [WARNING ] (13, 1, 'bot')
2019-02-05 17:12:51 [WARNING ] (13, 1, 'bot')
2019-02-05 17:12:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:12:51 [DEBUG   ] Finished updating board flags in 1.772 seconds
2019-02-05 17:12:54 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2019-02-05 17:13:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 17:13:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 17:13:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:13:51 [WARNING ] (13, 1, 'bot')
2019-02-05 17:13:51 [WARNING ] (13, 1, 'bot')
2019-02-05 17:13:51 [WARNING ] (13, 1, 'bot')
2019-02-05 17:13:51 [WARNING ] (13, 1, 'bot')
2019-02-05 17:13:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:13:51 [DEBUG   ] Finished updating board flags in 1.626 seconds
2019-02-05 17:13:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 17:14:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 17:14:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 17:14:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:14:51 [WARNING ] (13, 1, 'bot')
2019-02-05 17:14:51 [WARNING ] (13, 1, 'bot')
2019-02-05 17:14:51 [WARNING ] (13, 1, 'bot')
2019-02-05 17:14:51 [WARNING ] (13, 1, 'bot')
2019-02-05 17:14:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:14:51 [DEBUG   ] Finished updating board flags in 1.699 seconds
2019-02-05 17:14:53 [DEBUG   ] Got command RPT from MCS: ref #1411504
2019-02-05 17:14:53 [DEBUG   ] summary = ERROR
2019-02-05 17:14:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411504  13 58519 62093473 A  ERRORERROR'
2019-02-05 17:14:53 [DEBUG   ] Got command RPT from MCS: ref #1411505
2019-02-05 17:14:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 17:14:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411505  77 58519 62093677 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 17:14:53 [DEBUG   ] Got command RPT from MCS: ref #1411506
2019-02-05 17:14:53 [DEBUG   ] summary = ERROR
2019-02-05 17:14:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411506  13 58519 62093881 A  ERRORERROR'
2019-02-05 17:14:54 [DEBUG   ] Got command RPT from MCS: ref #1411508
2019-02-05 17:14:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 17:14:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411508  77 58519 62094081 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 17:14:54 [DEBUG   ] Got command RPT from MCS: ref #1411509
2019-02-05 17:14:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 17:14:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411509  12 58519 62094273 A  ERRORB˜™š'
2019-02-05 17:14:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 17:15:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 17:15:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 17:15:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:15:51 [WARNING ] (13, 1, 'bot')
2019-02-05 17:15:51 [WARNING ] (13, 1, 'bot')
2019-02-05 17:15:51 [WARNING ] (13, 1, 'bot')
2019-02-05 17:15:51 [WARNING ] (13, 1, 'bot')
2019-02-05 17:15:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:15:51 [DEBUG   ] Finished updating board flags in 1.502 seconds
2019-02-05 17:15:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 17:16:11 [DEBUG   ] Got command RPT from MCS: ref #1411514
2019-02-05 17:16:11 [DEBUG   ] summary = ERROR
2019-02-05 17:16:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411514  13 58519 62171977 A  ERRORERROR'
2019-02-05 17:16:11 [DEBUG   ] Got command RPT from MCS: ref #1411515
2019-02-05 17:16:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 17:16:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411515  77 58519 62171978 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 17:16:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 17:16:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 17:16:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:16:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-02-05 17:16:51 [WARNING ] (13, 1, 'bot')
2019-02-05 17:16:51 [WARNING ] (13, 1, 'bot')
2019-02-05 17:16:51 [WARNING ] (13, 1, 'bot')
2019-02-05 17:16:51 [WARNING ] (13, 1, 'bot')
2019-02-05 17:16:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:16:51 [DEBUG   ] Finished updating board flags in 1.490 seconds
2019-02-05 17:16:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 17:17:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 17:17:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 17:17:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:17:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-05 17:17:51 [WARNING ] (13, 1, 'bot')
2019-02-05 17:17:51 [WARNING ] (13, 1, 'bot')
2019-02-05 17:17:51 [WARNING ] (13, 1, 'bot')
2019-02-05 17:17:51 [WARNING ] (13, 1, 'bot')
2019-02-05 17:17:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:17:51 [DEBUG   ] Finished updating board flags in 1.486 seconds
2019-02-05 17:17:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-05 17:18:14 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2019-02-05 17:18:35 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-02-05 17:18:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:18:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 17:18:51 [WARNING ] (13, 1, 'bot')
2019-02-05 17:18:51 [WARNING ] (13, 1, 'bot')
2019-02-05 17:18:51 [WARNING ] (13, 1, 'bot')
2019-02-05 17:18:51 [WARNING ] (13, 1, 'bot')
2019-02-05 17:18:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:18:51 [DEBUG   ] Finished updating board flags in 1.490 seconds
2019-02-05 17:18:55 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-05 17:19:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 17:19:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 17:19:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 17:19:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:19:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 17:19:52 [WARNING ] (13, 1, 'bot')
2019-02-05 17:19:52 [WARNING ] (13, 1, 'bot')
2019-02-05 17:19:52 [WARNING ] (13, 1, 'bot')
2019-02-05 17:19:52 [WARNING ] (13, 1, 'bot')
2019-02-05 17:19:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:19:52 [DEBUG   ] Finished updating board flags in 2.156 seconds
2019-02-05 17:19:53 [DEBUG   ] Got command RPT from MCS: ref #1411535
2019-02-05 17:19:53 [DEBUG   ] summary = ERROR
2019-02-05 17:19:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411535  13 58519 62393557 A  ERRORERROR'
2019-02-05 17:19:53 [DEBUG   ] Got command RPT from MCS: ref #1411536
2019-02-05 17:19:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 17:19:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411536  77 58519 62393761 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 17:19:53 [DEBUG   ] Got command RPT from MCS: ref #1411537
2019-02-05 17:19:53 [DEBUG   ] summary = ERROR
2019-02-05 17:19:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411537  13 58519 62393965 A  ERRORERROR'
2019-02-05 17:19:54 [DEBUG   ] Got command RPT from MCS: ref #1411538
2019-02-05 17:19:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 17:19:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411538  77 58519 62394170 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 17:19:54 [DEBUG   ] Got command RPT from MCS: ref #1411539
2019-02-05 17:19:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 17:19:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411539  12 58519 62394361 A  ERRORBš™š'
2019-02-05 17:19:55 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 17:20:15 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-05 17:20:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 17:20:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:20:52 [WARNING ] (13, 1, 'bot')
2019-02-05 17:20:52 [WARNING ] (13, 1, 'bot')
2019-02-05 17:20:52 [WARNING ] (13, 1, 'bot')
2019-02-05 17:20:52 [WARNING ] (13, 1, 'bot')
2019-02-05 17:20:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:20:52 [DEBUG   ] Finished updating board flags in 1.999 seconds
2019-02-05 17:20:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 17:21:11 [DEBUG   ] Got command RPT from MCS: ref #1411544
2019-02-05 17:21:11 [DEBUG   ] summary = ERROR
2019-02-05 17:21:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411544  13 58519 62471981 A  ERRORERROR'
2019-02-05 17:21:11 [DEBUG   ] Got command RPT from MCS: ref #1411545
2019-02-05 17:21:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 17:21:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411545  77 58519 62471982 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 17:21:15 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 17:21:35 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-02-05 17:21:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:21:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-05 17:21:52 [WARNING ] (13, 1, 'bot')
2019-02-05 17:21:52 [WARNING ] (13, 1, 'bot')
2019-02-05 17:21:52 [WARNING ] (13, 1, 'bot')
2019-02-05 17:21:52 [WARNING ] (13, 1, 'bot')
2019-02-05 17:21:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:21:52 [DEBUG   ] Finished updating board flags in 1.795 seconds
2019-02-05 17:21:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-05 17:22:15 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-05 17:22:35 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-05 17:22:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:22:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 17:22:52 [WARNING ] (13, 1, 'bot')
2019-02-05 17:22:52 [WARNING ] (13, 1, 'bot')
2019-02-05 17:22:52 [WARNING ] (13, 1, 'bot')
2019-02-05 17:22:52 [WARNING ] (13, 1, 'bot')
2019-02-05 17:22:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:22:52 [DEBUG   ] Finished updating board flags in 1.618 seconds
2019-02-05 17:22:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 17:23:15 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-05 17:23:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 17:23:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:23:52 [WARNING ] (13, 1, 'bot')
2019-02-05 17:23:52 [WARNING ] (13, 1, 'bot')
2019-02-05 17:23:52 [WARNING ] (13, 1, 'bot')
2019-02-05 17:23:52 [WARNING ] (13, 1, 'bot')
2019-02-05 17:23:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:23:52 [DEBUG   ] Finished updating board flags in 1.671 seconds
2019-02-05 17:23:55 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-05 17:24:15 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-05 17:24:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 17:24:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:24:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-02-05 17:24:52 [WARNING ] (13, 1, 'bot')
2019-02-05 17:24:52 [WARNING ] (13, 1, 'bot')
2019-02-05 17:24:52 [WARNING ] (13, 1, 'bot')
2019-02-05 17:24:52 [WARNING ] (13, 1, 'bot')
2019-02-05 17:24:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:24:52 [DEBUG   ] Finished updating board flags in 1.502 seconds
2019-02-05 17:24:53 [DEBUG   ] Got command RPT from MCS: ref #1411567
2019-02-05 17:24:53 [DEBUG   ] summary = ERROR
2019-02-05 17:24:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411567  13 58519 62693653 A  ERRORERROR'
2019-02-05 17:24:53 [DEBUG   ] Got command RPT from MCS: ref #1411568
2019-02-05 17:24:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 17:24:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411568  77 58519 62693845 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 17:24:54 [DEBUG   ] Got command RPT from MCS: ref #1411569
2019-02-05 17:24:54 [DEBUG   ] summary = ERROR
2019-02-05 17:24:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411569  13 58519 62694049 A  ERRORERROR'
2019-02-05 17:24:54 [DEBUG   ] Got command RPT from MCS: ref #1411571
2019-02-05 17:24:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 17:24:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411571  77 58519 62694253 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 17:24:54 [DEBUG   ] Got command RPT from MCS: ref #1411572
2019-02-05 17:24:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 17:24:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411572  12 58519 62694457 A  ERRORBš™š'
2019-02-05 17:24:55 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-05 17:25:15 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-02-05 17:25:36 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-02-05 17:25:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:25:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 17:25:52 [WARNING ] (13, 1, 'bot')
2019-02-05 17:25:52 [WARNING ] (13, 1, 'bot')
2019-02-05 17:25:52 [WARNING ] (13, 1, 'bot')
2019-02-05 17:25:52 [WARNING ] (13, 1, 'bot')
2019-02-05 17:25:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:25:52 [DEBUG   ] Finished updating board flags in 1.417 seconds
2019-02-05 17:25:56 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-02-05 17:26:11 [DEBUG   ] Got command RPT from MCS: ref #1411580
2019-02-05 17:26:11 [DEBUG   ] summary = ERROR
2019-02-05 17:26:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411580  13 58519 62771986 A  ERRORERROR'
2019-02-05 17:26:11 [DEBUG   ] Got command RPT from MCS: ref #1411581
2019-02-05 17:26:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 17:26:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411581  77 58519 62771986 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 17:26:16 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 17:26:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 17:26:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:26:52 [WARNING ] (13, 1, 'bot')
2019-02-05 17:26:52 [WARNING ] (13, 1, 'bot')
2019-02-05 17:26:52 [WARNING ] (13, 1, 'bot')
2019-02-05 17:26:52 [WARNING ] (13, 1, 'bot')
2019-02-05 17:26:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:26:52 [DEBUG   ] Finished updating board flags in 1.378 seconds
2019-02-05 17:26:56 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-02-05 17:27:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 17:27:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 17:27:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:27:52 [WARNING ] (13, 1, 'bot')
2019-02-05 17:27:52 [WARNING ] (13, 1, 'bot')
2019-02-05 17:27:52 [WARNING ] (13, 1, 'bot')
2019-02-05 17:27:52 [WARNING ] (13, 1, 'bot')
2019-02-05 17:27:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:27:52 [DEBUG   ] Finished updating board flags in 1.354 seconds
2019-02-05 17:27:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 17:28:16 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-02-05 17:28:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 17:28:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:28:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 17:28:53 [WARNING ] (13, 1, 'bot')
2019-02-05 17:28:53 [WARNING ] (13, 1, 'bot')
2019-02-05 17:28:53 [WARNING ] (13, 1, 'bot')
2019-02-05 17:28:53 [WARNING ] (13, 1, 'bot')
2019-02-05 17:28:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:28:53 [DEBUG   ] Finished updating board flags in 2.065 seconds
2019-02-05 17:28:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-05 17:29:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 17:29:36 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-05 17:29:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:29:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 17:29:53 [WARNING ] (13, 1, 'bot')
2019-02-05 17:29:53 [WARNING ] (13, 1, 'bot')
2019-02-05 17:29:53 [WARNING ] (13, 1, 'bot')
2019-02-05 17:29:53 [WARNING ] (13, 1, 'bot')
2019-02-05 17:29:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:29:53 [DEBUG   ] Finished updating board flags in 2.041 seconds
2019-02-05 17:29:53 [DEBUG   ] Got command RPT from MCS: ref #1411602
2019-02-05 17:29:53 [DEBUG   ] summary = ERROR
2019-02-05 17:29:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411602  13 58519 62993741 A  ERRORERROR'
2019-02-05 17:29:53 [DEBUG   ] Got command RPT from MCS: ref #1411603
2019-02-05 17:29:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 17:29:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411603  77 58519 62993933 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 17:29:54 [DEBUG   ] Got command RPT from MCS: ref #1411604
2019-02-05 17:29:54 [DEBUG   ] summary = ERROR
2019-02-05 17:29:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411604  13 58519 62994137 A  ERRORERROR'
2019-02-05 17:29:54 [DEBUG   ] Got command RPT from MCS: ref #1411605
2019-02-05 17:29:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 17:29:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411605  77 58519 62994341 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 17:29:54 [DEBUG   ] Got command RPT from MCS: ref #1411606
2019-02-05 17:29:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 17:29:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411606  12 58519 62994533 A  ERRORB™™š'
2019-02-05 17:29:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 17:30:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 17:30:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 17:30:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:30:53 [WARNING ] (13, 1, 'bot')
2019-02-05 17:30:53 [WARNING ] (13, 1, 'bot')
2019-02-05 17:30:53 [WARNING ] (13, 1, 'bot')
2019-02-05 17:30:53 [WARNING ] (13, 1, 'bot')
2019-02-05 17:30:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:30:53 [DEBUG   ] Finished updating board flags in 1.952 seconds
2019-02-05 17:30:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 17:31:11 [DEBUG   ] Got command RPT from MCS: ref #1411607
2019-02-05 17:31:11 [DEBUG   ] summary = ERROR
2019-02-05 17:31:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411607  13 58519 63071977 A  ERRORERROR'
2019-02-05 17:31:11 [DEBUG   ] Got command RPT from MCS: ref #1411608
2019-02-05 17:31:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 17:31:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411608  77 58519 63071978 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 17:31:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 17:31:36 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-05 17:31:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:31:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 17:31:53 [WARNING ] (13, 1, 'bot')
2019-02-05 17:31:53 [WARNING ] (13, 1, 'bot')
2019-02-05 17:31:53 [WARNING ] (13, 1, 'bot')
2019-02-05 17:31:53 [WARNING ] (13, 1, 'bot')
2019-02-05 17:31:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:31:53 [DEBUG   ] Finished updating board flags in 1.818 seconds
2019-02-05 17:31:56 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-05 17:32:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 17:32:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 17:32:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:32:53 [WARNING ] (13, 1, 'bot')
2019-02-05 17:32:53 [WARNING ] (13, 1, 'bot')
2019-02-05 17:32:53 [WARNING ] (13, 1, 'bot')
2019-02-05 17:32:53 [WARNING ] (13, 1, 'bot')
2019-02-05 17:32:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:32:53 [DEBUG   ] Finished updating board flags in 1.815 seconds
2019-02-05 17:32:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 17:33:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 17:33:36 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-05 17:33:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:33:53 [WARNING ] (13, 1, 'bot')
2019-02-05 17:33:53 [WARNING ] (13, 1, 'bot')
2019-02-05 17:33:53 [WARNING ] (13, 1, 'bot')
2019-02-05 17:33:53 [WARNING ] (13, 1, 'bot')
2019-02-05 17:33:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:33:53 [DEBUG   ] Finished updating board flags in 1.862 seconds
2019-02-05 17:33:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 17:34:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 17:34:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 17:34:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:34:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 17:34:53 [WARNING ] (13, 1, 'bot')
2019-02-05 17:34:53 [WARNING ] (13, 1, 'bot')
2019-02-05 17:34:53 [WARNING ] (13, 1, 'bot')
2019-02-05 17:34:53 [WARNING ] (13, 1, 'bot')
2019-02-05 17:34:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:34:53 [DEBUG   ] Finished updating board flags in 1.741 seconds
2019-02-05 17:34:53 [DEBUG   ] Got command RPT from MCS: ref #1411630
2019-02-05 17:34:53 [DEBUG   ] summary = ERROR
2019-02-05 17:34:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411630  13 58519 63293817 A  ERRORERROR'
2019-02-05 17:34:54 [DEBUG   ] Got command RPT from MCS: ref #1411631
2019-02-05 17:34:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 17:34:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411631  77 58519 63294021 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 17:34:54 [DEBUG   ] Got command RPT from MCS: ref #1411632
2019-02-05 17:34:54 [DEBUG   ] summary = ERROR
2019-02-05 17:34:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411632  13 58519 63294225 A  ERRORERROR'
2019-02-05 17:34:54 [DEBUG   ] Got command RPT from MCS: ref #1411634
2019-02-05 17:34:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 17:34:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411634  77 58519 63294429 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 17:34:54 [DEBUG   ] Got command RPT from MCS: ref #1411635
2019-02-05 17:34:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 17:34:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411635  12 58519 63294621 A  ERRORB™™š'
2019-02-05 17:34:56 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-05 17:35:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 17:35:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 17:35:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:35:53 [WARNING ] (13, 1, 'bot')
2019-02-05 17:35:53 [WARNING ] (13, 1, 'bot')
2019-02-05 17:35:53 [WARNING ] (13, 1, 'bot')
2019-02-05 17:35:53 [WARNING ] (13, 1, 'bot')
2019-02-05 17:35:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:35:53 [DEBUG   ] Finished updating board flags in 1.597 seconds
2019-02-05 17:35:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 17:36:11 [DEBUG   ] Got command RPT from MCS: ref #1411644
2019-02-05 17:36:11 [DEBUG   ] summary = ERROR
2019-02-05 17:36:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411644  13 58519 63371981 A  ERRORERROR'
2019-02-05 17:36:11 [DEBUG   ] Got command RPT from MCS: ref #1411645
2019-02-05 17:36:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 17:36:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411645  77 58519 63371982 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 17:36:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 17:36:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 17:36:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:36:53 [WARNING ] (13, 1, 'bot')
2019-02-05 17:36:53 [WARNING ] (13, 1, 'bot')
2019-02-05 17:36:53 [WARNING ] (13, 1, 'bot')
2019-02-05 17:36:53 [WARNING ] (13, 1, 'bot')
2019-02-05 17:36:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:36:53 [DEBUG   ] Finished updating board flags in 1.495 seconds
2019-02-05 17:36:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 17:37:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 17:37:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 17:37:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:37:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 17:37:53 [WARNING ] (13, 1, 'bot')
2019-02-05 17:37:53 [WARNING ] (13, 1, 'bot')
2019-02-05 17:37:53 [WARNING ] (13, 1, 'bot')
2019-02-05 17:37:53 [WARNING ] (13, 1, 'bot')
2019-02-05 17:37:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:37:53 [DEBUG   ] Finished updating board flags in 1.516 seconds
2019-02-05 17:37:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 17:38:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 17:38:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 17:38:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:38:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 17:38:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:38:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:38:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:38:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:38:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:38:54 [DEBUG   ] Finished updating board flags in 2.269 seconds
2019-02-05 17:38:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 17:39:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 17:39:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 17:39:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 17:39:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:39:53 [DEBUG   ] Got command RPT from MCS: ref #1411665
2019-02-05 17:39:53 [DEBUG   ] summary = ERROR
2019-02-05 17:39:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411665  13 58519 63593909 A  ERRORERROR'
2019-02-05 17:39:54 [DEBUG   ] Got command RPT from MCS: ref #1411666
2019-02-05 17:39:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 17:39:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411666  77 58519 63594113 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 17:39:54 [DEBUG   ] Got command RPT from MCS: ref #1411667
2019-02-05 17:39:54 [DEBUG   ] summary = ERROR
2019-02-05 17:39:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411667  13 58519 63594305 A  ERRORERROR'
2019-02-05 17:39:54 [DEBUG   ] Got command RPT from MCS: ref #1411668
2019-02-05 17:39:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 17:39:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411668  77 58519 63594513 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 17:39:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:39:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:39:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:39:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:39:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:39:54 [DEBUG   ] Finished updating board flags in 2.119 seconds
2019-02-05 17:39:54 [DEBUG   ] Got command RPT from MCS: ref #1411669
2019-02-05 17:39:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 17:39:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411669  12 58519 63594705 A  ERRORB™™š'
2019-02-05 17:39:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 17:40:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 17:40:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 17:40:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:40:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:40:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:40:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:40:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:40:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:40:54 [DEBUG   ] Finished updating board flags in 2.040 seconds
2019-02-05 17:40:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 17:41:11 [DEBUG   ] Got command RPT from MCS: ref #1411671
2019-02-05 17:41:11 [DEBUG   ] summary = ERROR
2019-02-05 17:41:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411671  13 58519 63671989 A  ERRORERROR'
2019-02-05 17:41:11 [DEBUG   ] Got command RPT from MCS: ref #1411672
2019-02-05 17:41:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 17:41:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411672  77 58519 63671990 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 17:41:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 17:41:36 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-05 17:41:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 17:41:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:41:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:41:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:41:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:41:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:41:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:41:54 [DEBUG   ] Finished updating board flags in 1.953 seconds
2019-02-05 17:41:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 17:42:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 17:42:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 17:42:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:42:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 17:42:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:42:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:42:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:42:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:42:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:42:54 [DEBUG   ] Finished updating board flags in 1.806 seconds
2019-02-05 17:42:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 17:43:16 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-05 17:43:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 17:43:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:43:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:43:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:43:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:43:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:43:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:43:54 [DEBUG   ] Finished updating board flags in 1.879 seconds
2019-02-05 17:43:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 17:44:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 17:44:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 17:44:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:44:53 [DEBUG   ] Got command RPT from MCS: ref #1411697
2019-02-05 17:44:53 [DEBUG   ] summary = ERROR
2019-02-05 17:44:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411697  13 58519 63893989 A  ERRORERROR'
2019-02-05 17:44:54 [DEBUG   ] Got command RPT from MCS: ref #1411698
2019-02-05 17:44:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 17:44:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411698  77 58519 63894197 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 17:44:54 [DEBUG   ] Got command RPT from MCS: ref #1411699
2019-02-05 17:44:54 [DEBUG   ] summary = ERROR
2019-02-05 17:44:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411699  13 58519 63894389 A  ERRORERROR'
2019-02-05 17:44:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-02-05 17:44:54 [DEBUG   ] Got command RPT from MCS: ref #1411701
2019-02-05 17:44:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 17:44:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411701  77 58519 63894593 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 17:44:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:44:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:44:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:44:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:44:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:44:54 [DEBUG   ] Finished updating board flags in 1.725 seconds
2019-02-05 17:44:54 [DEBUG   ] Got command RPT from MCS: ref #1411702
2019-02-05 17:44:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 17:44:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411702  12 58519 63894797 A  ERRORBš™š'
2019-02-05 17:44:56 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-05 17:45:16 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-02-05 17:45:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-05 17:45:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:45:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:45:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:45:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:45:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:45:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:45:54 [DEBUG   ] Finished updating board flags in 1.620 seconds
2019-02-05 17:45:57 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-02-05 17:46:11 [DEBUG   ] Got command RPT from MCS: ref #1411707
2019-02-05 17:46:11 [DEBUG   ] summary = ERROR
2019-02-05 17:46:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411707  13 58519 63971981 A  ERRORERROR'
2019-02-05 17:46:11 [DEBUG   ] Got command RPT from MCS: ref #1411708
2019-02-05 17:46:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 17:46:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411708  77 58519 63971982 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 17:46:17 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-02-05 17:46:37 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-05 17:46:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:46:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-02-05 17:46:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:46:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:46:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:46:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:46:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:46:54 [DEBUG   ] Finished updating board flags in 1.574 seconds
2019-02-05 17:46:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 17:47:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 17:47:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 17:47:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:47:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:47:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:47:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:47:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:47:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:47:54 [DEBUG   ] Finished updating board flags in 1.455 seconds
2019-02-05 17:47:57 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-05 17:48:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 17:48:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 17:48:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:48:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-02-05 17:48:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:48:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:48:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:48:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:48:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:48:54 [DEBUG   ] Finished updating board flags in 1.414 seconds
2019-02-05 17:48:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 17:49:17 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-05 17:49:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 17:49:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:49:54 [DEBUG   ] Got command RPT from MCS: ref #1411728
2019-02-05 17:49:54 [DEBUG   ] summary = ERROR
2019-02-05 17:49:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411728  13 58519 64194081 A  ERRORERROR'
2019-02-05 17:49:54 [DEBUG   ] Got command RPT from MCS: ref #1411729
2019-02-05 17:49:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 17:49:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411729  77 58519 64194286 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 17:49:54 [DEBUG   ] Got command RPT from MCS: ref #1411730
2019-02-05 17:49:54 [DEBUG   ] summary = ERROR
2019-02-05 17:49:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411730  13 58519 64194478 A  ERRORERROR'
2019-02-05 17:49:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-05 17:49:54 [DEBUG   ] Got command RPT from MCS: ref #1411731
2019-02-05 17:49:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 17:49:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411731  77 58519 64194681 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 17:49:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:49:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:49:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:49:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:49:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:49:54 [DEBUG   ] Finished updating board flags in 1.429 seconds
2019-02-05 17:49:54 [DEBUG   ] Got command RPT from MCS: ref #1411732
2019-02-05 17:49:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 17:49:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411732  12 58519 64194885 A  ERRORBš™š'
2019-02-05 17:49:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 17:50:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 17:50:37 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-05 17:50:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 17:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:50:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 17:50:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 17:50:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:50:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:50:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:50:54 [WARNING ] (13, 1, 'bot')
2019-02-05 17:50:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:50:54 [DEBUG   ] Finished updating board flags in 1.563 seconds
2019-02-05 17:50:57 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-05 17:51:11 [DEBUG   ] Got command RPT from MCS: ref #1411737
2019-02-05 17:51:11 [DEBUG   ] summary = ERROR
2019-02-05 17:51:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411737  13 58519 64271989 A  ERRORERROR'
2019-02-05 17:51:11 [DEBUG   ] Got command RPT from MCS: ref #1411738
2019-02-05 17:51:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 17:51:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411738  77 58519 64271990 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 17:51:17 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 17:51:37 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-05 17:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:51:55 [WARNING ] (13, 1, 'bot')
2019-02-05 17:51:55 [WARNING ] (13, 1, 'bot')
2019-02-05 17:51:55 [WARNING ] (13, 1, 'bot')
2019-02-05 17:51:55 [WARNING ] (13, 1, 'bot')
2019-02-05 17:51:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:51:55 [DEBUG   ] Finished updating board flags in 2.275 seconds
2019-02-05 17:51:57 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-05 17:52:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 17:52:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 17:52:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:52:55 [WARNING ] (13, 1, 'bot')
2019-02-05 17:52:55 [WARNING ] (13, 1, 'bot')
2019-02-05 17:52:55 [WARNING ] (13, 1, 'bot')
2019-02-05 17:52:55 [WARNING ] (13, 1, 'bot')
2019-02-05 17:52:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:52:55 [DEBUG   ] Finished updating board flags in 2.088 seconds
2019-02-05 17:52:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 17:53:17 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-05 17:53:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 17:53:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:53:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 17:53:55 [WARNING ] (13, 1, 'bot')
2019-02-05 17:53:55 [WARNING ] (13, 1, 'bot')
2019-02-05 17:53:55 [WARNING ] (13, 1, 'bot')
2019-02-05 17:53:55 [WARNING ] (13, 1, 'bot')
2019-02-05 17:53:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:53:55 [DEBUG   ] Finished updating board flags in 2.002 seconds
2019-02-05 17:53:57 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 17:54:17 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-05 17:54:37 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-05 17:54:54 [DEBUG   ] Got command RPT from MCS: ref #1411760
2019-02-05 17:54:54 [DEBUG   ] summary = ERROR
2019-02-05 17:54:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411760  13 58519 64494166 A  ERRORERROR'
2019-02-05 17:54:54 [DEBUG   ] Got command RPT from MCS: ref #1411761
2019-02-05 17:54:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 17:54:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411761  77 58519 64494369 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 17:54:54 [DEBUG   ] Got command RPT from MCS: ref #1411762
2019-02-05 17:54:54 [DEBUG   ] summary = ERROR
2019-02-05 17:54:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411762  13 58519 64494561 A  ERRORERROR'
2019-02-05 17:54:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:54:54 [DEBUG   ] Got command RPT from MCS: ref #1411764
2019-02-05 17:54:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 17:54:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411764  77 58519 64494765 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 17:54:54 [DEBUG   ] Got command RPT from MCS: ref #1411765
2019-02-05 17:54:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 17:54:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411765  12 58519 64494969 A  ERRORB�ÌÍ'
2019-02-05 17:54:55 [WARNING ] (13, 1, 'bot')
2019-02-05 17:54:55 [WARNING ] (13, 1, 'bot')
2019-02-05 17:54:55 [WARNING ] (13, 1, 'bot')
2019-02-05 17:54:55 [WARNING ] (13, 1, 'bot')
2019-02-05 17:54:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:54:55 [DEBUG   ] Finished updating board flags in 1.989 seconds
2019-02-05 17:54:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 17:55:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 17:55:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 17:55:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:55:55 [WARNING ] (13, 1, 'bot')
2019-02-05 17:55:55 [WARNING ] (13, 1, 'bot')
2019-02-05 17:55:55 [WARNING ] (13, 1, 'bot')
2019-02-05 17:55:55 [WARNING ] (13, 1, 'bot')
2019-02-05 17:55:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:55:55 [DEBUG   ] Finished updating board flags in 1.821 seconds
2019-02-05 17:55:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 17:56:11 [DEBUG   ] Got command RPT from MCS: ref #1411770
2019-02-05 17:56:11 [DEBUG   ] summary = ERROR
2019-02-05 17:56:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411770  13 58519 64571993 A  ERRORERROR'
2019-02-05 17:56:11 [DEBUG   ] Got command RPT from MCS: ref #1411771
2019-02-05 17:56:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 17:56:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411771  77 58519 64571994 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 17:56:17 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-05 17:56:37 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-05 17:56:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:56:55 [WARNING ] (13, 1, 'bot')
2019-02-05 17:56:55 [WARNING ] (13, 1, 'bot')
2019-02-05 17:56:55 [WARNING ] (13, 1, 'bot')
2019-02-05 17:56:55 [WARNING ] (13, 1, 'bot')
2019-02-05 17:56:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:56:55 [DEBUG   ] Finished updating board flags in 1.788 seconds
2019-02-05 17:56:57 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-05 17:57:17 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-05 17:57:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 17:57:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:57:55 [WARNING ] (13, 1, 'bot')
2019-02-05 17:57:55 [WARNING ] (13, 1, 'bot')
2019-02-05 17:57:55 [WARNING ] (13, 1, 'bot')
2019-02-05 17:57:55 [WARNING ] (13, 1, 'bot')
2019-02-05 17:57:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:57:55 [DEBUG   ] Finished updating board flags in 1.611 seconds
2019-02-05 17:57:57 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-05 17:58:17 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-05 17:58:38 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-02-05 17:58:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:58:55 [WARNING ] (13, 1, 'bot')
2019-02-05 17:58:55 [WARNING ] (13, 1, 'bot')
2019-02-05 17:58:55 [WARNING ] (13, 1, 'bot')
2019-02-05 17:58:55 [WARNING ] (13, 1, 'bot')
2019-02-05 17:58:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:58:55 [DEBUG   ] Finished updating board flags in 1.606 seconds
2019-02-05 17:58:58 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-02-05 17:59:18 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-05 17:59:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 17:59:54 [DEBUG   ] Got command RPT from MCS: ref #1411795
2019-02-05 17:59:54 [DEBUG   ] summary = ERROR
2019-02-05 17:59:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411795  13 58519 64794250 A  ERRORERROR'
2019-02-05 17:59:54 [DEBUG   ] Got command RPT from MCS: ref #1411796
2019-02-05 17:59:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 17:59:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411796  77 58519 64794454 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 17:59:54 [DEBUG   ] Got command RPT from MCS: ref #1411797
2019-02-05 17:59:54 [DEBUG   ] summary = ERROR
2019-02-05 17:59:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411797  13 58519 64794650 A  ERRORERROR'
2019-02-05 17:59:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 17:59:54 [DEBUG   ] Got command RPT from MCS: ref #1411798
2019-02-05 17:59:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 17:59:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411798  77 58519 64794853 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 17:59:55 [DEBUG   ] Got command RPT from MCS: ref #1411799
2019-02-05 17:59:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 17:59:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411799  12 58519 64795057 A  ERRORBŽÌÍ'
2019-02-05 17:59:55 [WARNING ] (13, 1, 'bot')
2019-02-05 17:59:55 [WARNING ] (13, 1, 'bot')
2019-02-05 17:59:55 [WARNING ] (13, 1, 'bot')
2019-02-05 17:59:55 [WARNING ] (13, 1, 'bot')
2019-02-05 17:59:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 17:59:55 [DEBUG   ] Finished updating board flags in 1.595 seconds
2019-02-05 17:59:58 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 18:00:18 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-05 18:00:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 18:00:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:00:55 [WARNING ] (13, 1, 'bot')
2019-02-05 18:00:55 [WARNING ] (13, 1, 'bot')
2019-02-05 18:00:55 [WARNING ] (13, 1, 'bot')
2019-02-05 18:00:55 [WARNING ] (13, 1, 'bot')
2019-02-05 18:00:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:00:55 [DEBUG   ] Finished updating board flags in 1.391 seconds
2019-02-05 18:00:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 18:01:11 [DEBUG   ] Got command RPT from MCS: ref #1411800
2019-02-05 18:01:11 [DEBUG   ] summary = ERROR
2019-02-05 18:01:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411800  13 58519 64871985 A  ERRORERROR'
2019-02-05 18:01:11 [DEBUG   ] Got command RPT from MCS: ref #1411801
2019-02-05 18:01:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 18:01:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411801  77 58519 64871986 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 18:01:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 18:01:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 18:01:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:01:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:01:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:01:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:01:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:01:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:01:56 [DEBUG   ] Finished updating board flags in 1.572 seconds
2019-02-05 18:01:58 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2019-02-05 18:02:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 18:02:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 18:02:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:02:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 18:02:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:02:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:02:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:02:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:02:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:02:56 [DEBUG   ] Finished updating board flags in 2.146 seconds
2019-02-05 18:02:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 18:03:18 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-05 18:03:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 18:03:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:03:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:03:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:03:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:03:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:03:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:03:56 [DEBUG   ] Finished updating board flags in 2.015 seconds
2019-02-05 18:03:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 18:04:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 18:04:38 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-05 18:04:54 [DEBUG   ] Got command RPT from MCS: ref #1411823
2019-02-05 18:04:54 [DEBUG   ] summary = ERROR
2019-02-05 18:04:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411823  13 58519 65094333 A  ERRORERROR'
2019-02-05 18:04:54 [DEBUG   ] Got command RPT from MCS: ref #1411824
2019-02-05 18:04:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 18:04:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411824  77 58519 65094537 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 18:04:54 [DEBUG   ] Got command RPT from MCS: ref #1411825
2019-02-05 18:04:54 [DEBUG   ] summary = ERROR
2019-02-05 18:04:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411825  13 58519 65094741 A  ERRORERROR'
2019-02-05 18:04:54 [DEBUG   ] Got command RPT from MCS: ref #1411827
2019-02-05 18:04:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 18:04:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411827  77 58519 65094945 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 18:04:55 [DEBUG   ] Got command RPT from MCS: ref #1411828
2019-02-05 18:04:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 18:04:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411828  12 58519 65095137 A  ERRORB„ÌÍ'
2019-02-05 18:04:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:04:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:04:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:04:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:04:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:04:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:04:56 [DEBUG   ] Finished updating board flags in 1.872 seconds
2019-02-05 18:04:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 18:05:18 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-05 18:05:38 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-02-05 18:05:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:05:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 18:05:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:05:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:05:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:05:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:05:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:05:56 [DEBUG   ] Finished updating board flags in 1.818 seconds
2019-02-05 18:05:59 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-02-05 18:06:11 [DEBUG   ] Got command RPT from MCS: ref #1411837
2019-02-05 18:06:11 [DEBUG   ] summary = ERROR
2019-02-05 18:06:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411837  13 58519 65171985 A  ERRORERROR'
2019-02-05 18:06:11 [DEBUG   ] Got command RPT from MCS: ref #1411838
2019-02-05 18:06:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 18:06:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411838  77 58519 65171986 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 18:06:19 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-02-05 18:06:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 18:06:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:06:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:06:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:06:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:06:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:06:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:06:56 [DEBUG   ] Finished updating board flags in 1.774 seconds
2019-02-05 18:06:59 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-05 18:07:19 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-05 18:07:39 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 18:07:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-02-05 18:07:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:07:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:07:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:07:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:07:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:07:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:07:56 [DEBUG   ] Finished updating board flags in 1.627 seconds
2019-02-05 18:07:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 18:08:19 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-05 18:08:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 18:08:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 18:08:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:08:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-02-05 18:08:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:08:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:08:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:08:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:08:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:08:56 [DEBUG   ] Finished updating board flags in 1.591 seconds
2019-02-05 18:08:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 18:09:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 18:09:39 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-05 18:09:54 [DEBUG   ] Got command RPT from MCS: ref #1411858
2019-02-05 18:09:54 [DEBUG   ] summary = ERROR
2019-02-05 18:09:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411858  13 58519 65394421 A  ERRORERROR'
2019-02-05 18:09:54 [DEBUG   ] Got command RPT from MCS: ref #1411859
2019-02-05 18:09:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 18:09:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411859  77 58519 65394625 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 18:09:54 [DEBUG   ] Got command RPT from MCS: ref #1411860
2019-02-05 18:09:54 [DEBUG   ] summary = ERROR
2019-02-05 18:09:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411860  13 58519 65394829 A  ERRORERROR'
2019-02-05 18:09:55 [DEBUG   ] Got command RPT from MCS: ref #1411861
2019-02-05 18:09:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 18:09:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411861  77 58519 65395021 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 18:09:55 [DEBUG   ] Got command RPT from MCS: ref #1411862
2019-02-05 18:09:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 18:09:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411862  12 58519 65395225 A  ERRORB™™š'
2019-02-05 18:09:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:09:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 18:09:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:09:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:09:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:09:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:09:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:09:56 [DEBUG   ] Finished updating board flags in 1.473 seconds
2019-02-05 18:09:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 18:10:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 18:10:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 18:10:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:10:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:10:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:10:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:10:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:10:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:10:56 [DEBUG   ] Finished updating board flags in 1.529 seconds
2019-02-05 18:10:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 18:11:11 [DEBUG   ] Got command RPT from MCS: ref #1411863
2019-02-05 18:11:11 [DEBUG   ] summary = ERROR
2019-02-05 18:11:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411863  13 58519 65471997 A  ERRORERROR'
2019-02-05 18:11:11 [DEBUG   ] Got command RPT from MCS: ref #1411864
2019-02-05 18:11:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 18:11:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411864  77 58519 65471998 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 18:11:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 18:11:39 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 18:11:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:11:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:11:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:11:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:11:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:11:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:11:57 [DEBUG   ] Finished updating board flags in 2.309 seconds
2019-02-05 18:11:59 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-02-05 18:12:19 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-05 18:12:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 18:12:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:12:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:12:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:12:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:12:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:12:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:12:57 [DEBUG   ] Finished updating board flags in 2.090 seconds
2019-02-05 18:12:59 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 18:13:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 18:13:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-05 18:13:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:13:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:13:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:13:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:13:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:13:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:13:57 [DEBUG   ] Finished updating board flags in 2.030 seconds
2019-02-05 18:13:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 18:14:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 18:14:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 18:14:54 [DEBUG   ] Got command RPT from MCS: ref #1411890
2019-02-05 18:14:54 [DEBUG   ] summary = ERROR
2019-02-05 18:14:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411890  13 58519 65694509 A  ERRORERROR'
2019-02-05 18:14:54 [DEBUG   ] Got command RPT from MCS: ref #1411891
2019-02-05 18:14:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 18:14:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411891  77 58519 65694713 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 18:14:54 [DEBUG   ] Got command RPT from MCS: ref #1411892
2019-02-05 18:14:54 [DEBUG   ] summary = ERROR
2019-02-05 18:14:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411892  13 58519 65694917 A  ERRORERROR'
2019-02-05 18:14:55 [DEBUG   ] Got command RPT from MCS: ref #1411894
2019-02-05 18:14:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 18:14:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411894  77 58519 65695109 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 18:14:55 [DEBUG   ] Got command RPT from MCS: ref #1411895
2019-02-05 18:14:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 18:14:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411895  12 58519 65695313 A  ERRORBš™š'
2019-02-05 18:14:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:14:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:14:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:14:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:14:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:14:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:14:57 [DEBUG   ] Finished updating board flags in 1.972 seconds
2019-02-05 18:14:59 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-05 18:15:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 18:15:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 18:15:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:15:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:15:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:15:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:15:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:15:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:15:57 [DEBUG   ] Finished updating board flags in 1.818 seconds
2019-02-05 18:15:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 18:16:11 [DEBUG   ] Got command RPT from MCS: ref #1411900
2019-02-05 18:16:11 [DEBUG   ] summary = ERROR
2019-02-05 18:16:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411900  13 58519 65771997 A  ERRORERROR'
2019-02-05 18:16:11 [DEBUG   ] Got command RPT from MCS: ref #1411901
2019-02-05 18:16:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 18:16:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411901  77 58519 65771998 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 18:16:19 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2019-02-05 18:16:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-05 18:16:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:16:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:16:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:16:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:16:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:16:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:16:57 [DEBUG   ] Finished updating board flags in 1.789 seconds
2019-02-05 18:16:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 18:17:19 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-05 18:17:39 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-05 18:17:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 18:17:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:17:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 18:17:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:17:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:17:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:17:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:17:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:17:57 [DEBUG   ] Finished updating board flags in 1.615 seconds
2019-02-05 18:17:59 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-05 18:18:19 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-05 18:18:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 18:18:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 18:18:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-02-05 18:18:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:18:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 18:18:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-02-05 18:18:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:18:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:18:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:18:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:18:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:18:57 [DEBUG   ] Finished updating board flags in 1.684 seconds
2019-02-05 18:18:59 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-05 18:19:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 18:19:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 18:19:54 [DEBUG   ] Got command RPT from MCS: ref #1411921
2019-02-05 18:19:54 [DEBUG   ] summary = ERROR
2019-02-05 18:19:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411921  13 58519 65994601 A  ERRORERROR'
2019-02-05 18:19:54 [DEBUG   ] Got command RPT from MCS: ref #1411922
2019-02-05 18:19:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 18:19:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411922  77 58519 65994793 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 18:19:54 [DEBUG   ] Got command RPT from MCS: ref #1411923
2019-02-05 18:19:54 [DEBUG   ] summary = ERROR
2019-02-05 18:19:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411923  13 58519 65994997 A  ERRORERROR'
2019-02-05 18:19:55 [DEBUG   ] Got command RPT from MCS: ref #1411924
2019-02-05 18:19:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 18:19:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411924  77 58519 65995201 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 18:19:55 [DEBUG   ] Got command RPT from MCS: ref #1411925
2019-02-05 18:19:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 18:19:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411925  12 58519 65995393 A  ERRORBš™š'
2019-02-05 18:19:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:19:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:19:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:19:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:19:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:19:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:19:57 [DEBUG   ] Finished updating board flags in 1.620 seconds
2019-02-05 18:19:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 18:20:19 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-05 18:20:39 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-05 18:20:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:20:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:20:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:20:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:20:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:20:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:20:57 [DEBUG   ] Finished updating board flags in 1.499 seconds
2019-02-05 18:20:59 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-05 18:21:11 [DEBUG   ] Got command RPT from MCS: ref #1411930
2019-02-05 18:21:11 [DEBUG   ] summary = ERROR
2019-02-05 18:21:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411930  13 58519 66071993 A  ERRORERROR'
2019-02-05 18:21:11 [DEBUG   ] Got command RPT from MCS: ref #1411931
2019-02-05 18:21:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 18:21:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411931  77 58519 66071994 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 18:21:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 18:21:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 18:21:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 18:21:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:21:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:21:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:21:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:21:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:21:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:21:57 [DEBUG   ] Finished updating board flags in 1.498 seconds
2019-02-05 18:21:59 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2019-02-05 18:22:20 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-02-05 18:22:40 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-02-05 18:22:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:22:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:22:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:22:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:22:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:22:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:22:57 [DEBUG   ] Finished updating board flags in 1.499 seconds
2019-02-05 18:23:00 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-05 18:23:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 18:23:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 18:23:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:23:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:23:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:23:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:23:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:23:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:23:57 [DEBUG   ] Finished updating board flags in 1.503 seconds
2019-02-05 18:24:00 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-05 18:24:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 18:24:40 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 18:24:54 [DEBUG   ] Got command RPT from MCS: ref #1411953
2019-02-05 18:24:54 [DEBUG   ] summary = ERROR
2019-02-05 18:24:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411953  13 58519 66294677 A  ERRORERROR'
2019-02-05 18:24:54 [DEBUG   ] Got command RPT from MCS: ref #1411954
2019-02-05 18:24:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 18:24:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411954  77 58519 66294881 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 18:24:55 [DEBUG   ] Got command RPT from MCS: ref #1411955
2019-02-05 18:24:55 [DEBUG   ] summary = ERROR
2019-02-05 18:24:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411955  13 58519 66295085 A  ERRORERROR'
2019-02-05 18:24:55 [DEBUG   ] Got command RPT from MCS: ref #1411956
2019-02-05 18:24:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 18:24:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411956  77 58519 66295289 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 18:24:55 [DEBUG   ] Got command RPT from MCS: ref #1411958
2019-02-05 18:24:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 18:24:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411958  12 58519 66295481 A  ERRORB™™š'
2019-02-05 18:24:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:24:58 [WARNING ] (13, 1, 'bot')
2019-02-05 18:24:58 [WARNING ] (13, 1, 'bot')
2019-02-05 18:24:58 [WARNING ] (13, 1, 'bot')
2019-02-05 18:24:58 [WARNING ] (13, 1, 'bot')
2019-02-05 18:24:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:24:58 [DEBUG   ] Finished updating board flags in 2.139 seconds
2019-02-05 18:25:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 18:25:20 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-05 18:25:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 18:25:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:25:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-02-05 18:25:58 [WARNING ] (13, 1, 'bot')
2019-02-05 18:25:58 [WARNING ] (13, 1, 'bot')
2019-02-05 18:25:58 [WARNING ] (13, 1, 'bot')
2019-02-05 18:25:58 [WARNING ] (13, 1, 'bot')
2019-02-05 18:25:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:25:58 [DEBUG   ] Finished updating board flags in 1.997 seconds
2019-02-05 18:26:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 18:26:11 [DEBUG   ] Got command RPT from MCS: ref #1411963
2019-02-05 18:26:11 [DEBUG   ] summary = ERROR
2019-02-05 18:26:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411963  13 58519 66371993 A  ERRORERROR'
2019-02-05 18:26:11 [DEBUG   ] Got command RPT from MCS: ref #1411964
2019-02-05 18:26:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 18:26:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411964  77 58519 66371994 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 18:26:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 18:26:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 18:26:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:26:58 [WARNING ] (13, 1, 'bot')
2019-02-05 18:26:58 [WARNING ] (13, 1, 'bot')
2019-02-05 18:26:58 [WARNING ] (13, 1, 'bot')
2019-02-05 18:26:58 [WARNING ] (13, 1, 'bot')
2019-02-05 18:26:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:26:58 [DEBUG   ] Finished updating board flags in 1.878 seconds
2019-02-05 18:27:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 18:27:20 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 18:27:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 18:27:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:27:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 18:27:58 [WARNING ] (13, 1, 'bot')
2019-02-05 18:27:58 [WARNING ] (13, 1, 'bot')
2019-02-05 18:27:58 [WARNING ] (13, 1, 'bot')
2019-02-05 18:27:58 [WARNING ] (13, 1, 'bot')
2019-02-05 18:27:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:27:58 [DEBUG   ] Finished updating board flags in 1.695 seconds
2019-02-05 18:28:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 18:28:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 18:28:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 18:28:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:28:58 [WARNING ] (13, 1, 'bot')
2019-02-05 18:28:58 [WARNING ] (13, 1, 'bot')
2019-02-05 18:28:58 [WARNING ] (13, 1, 'bot')
2019-02-05 18:28:58 [WARNING ] (13, 1, 'bot')
2019-02-05 18:28:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:28:58 [DEBUG   ] Finished updating board flags in 1.621 seconds
2019-02-05 18:29:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 18:29:00 [DEBUG   ] Got command RPT from MCS: ref #1411984
2019-02-05 18:29:00 [DEBUG   ] summary = ERROR
2019-02-05 18:29:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411984  13 58519 66540673 A  ERRORERROR'
2019-02-05 18:29:00 [DEBUG   ] Got command RPT from MCS: ref #1411985
2019-02-05 18:29:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 18:29:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411985  77 58519 66540674 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 18:29:05 [DEBUG   ] Got command INI from MCS: ref #1411986
2019-02-05 18:29:05 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2019-02-05 18:29:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI  1411986   8 58519 66545682 ABOOTING'
2019-02-05 18:29:30 [INFO    ] -------------------
2019-02-05 18:29:30 [INFO    ]  LWA board status
2019-02-05 18:29:30 [INFO    ] -------------------
2019-02-05 18:29:30 [INFO    ] DP 1: 2 lwa27
2019-02-05 18:29:30 [INFO    ] DP 1: 3 lwa24
2019-02-05 18:29:30 [INFO    ] DP 1: 4 lwa23
2019-02-05 18:29:30 [INFO    ] DP 1: 5 lwa18
2019-02-05 18:29:30 [INFO    ] DP 1: 6 lwa10
2019-02-05 18:29:30 [INFO    ] DP 1: 7 lwa32
2019-02-05 18:29:30 [INFO    ] DP 1: 8 lwa11
2019-02-05 18:29:30 [INFO    ] DP 1: 9 lwa30
2019-02-05 18:29:30 [INFO    ] DP 1: 10 lwa12
2019-02-05 18:29:30 [INFO    ] DP 1: 11 lwa8
2019-02-05 18:29:30 [INFO    ] DP 1: 12 lwa13
2019-02-05 18:29:30 [INFO    ] DP 1: 13 lwa26
2019-02-05 18:29:30 [INFO    ] DP 1: 14 lwa14
2019-02-05 18:29:30 [INFO    ] DP 1: 16 lwa22
2019-02-05 18:29:30 [INFO    ] DP 1: 17 lwa20
2019-02-05 18:29:30 [INFO    ] DP 1: 18 lwa1
2019-02-05 18:29:30 [INFO    ] DP 1: 19 lwa5
2019-02-05 18:29:30 [INFO    ] DP 1: 20 lwa25
2019-02-05 18:29:30 [INFO    ] DP 1: 21 lwa35
2019-02-05 18:29:30 [INFO    ] DP 1: 22 lwa19
2019-02-05 18:29:30 [INFO    ] DP 1: 23 lwa21
2019-02-05 18:29:30 [INFO    ] DP 1: 24 lwa6
2019-02-05 18:29:30 [INFO    ] DP 1: 25 lwa7
2019-02-05 18:29:30 [INFO    ] DP 1: 26 lwa33
2019-02-05 18:29:30 [INFO    ] DP 1: 27 lwa15
2019-02-05 18:29:30 [INFO    ] DP 1: 28 lwa28
2019-02-05 18:29:30 [INFO    ] DP 2: 1 lwa16
2019-02-05 18:29:30 [INFO    ] DP 2: 15 lwa34
2019-02-05 18:29:30 [INFO    ] Total of 28 boards
2019-02-05 18:29:30 [INFO    ] Total of 260 stands
2019-02-05 18:29:30 [INFO    ] -------------------
2019-02-05 18:29:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2019-02-05 18:29:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2019-02-05 18:29:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2019-02-05 18:29:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2019-02-05 18:29:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2019-02-05 18:29:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2019-02-05 18:29:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2019-02-05 18:29:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2019-02-05 18:29:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2019-02-05 18:29:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2019-02-05 18:29:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2019-02-05 18:29:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2019-02-05 18:29:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2019-02-05 18:29:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2019-02-05 18:29:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2019-02-05 18:29:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2019-02-05 18:29:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2019-02-05 18:29:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2019-02-05 18:29:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2019-02-05 18:29:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2019-02-05 18:29:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2019-02-05 18:29:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2019-02-05 18:29:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2019-02-05 18:29:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2019-02-05 18:29:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2019-02-05 18:29:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2019-02-05 18:29:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2019-02-05 18:29:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2019-02-05 18:29:37 [DEBUG   ] 2019-02-05 18:29:37 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 705
2019-02-05 18:29:37 [DEBUG   ] 2019-02-05 18:29:37 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 706
2019-02-05 18:29:37 [DEBUG   ] 2019-02-05 18:29:37 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 707
2019-02-05 18:29:37 [DEBUG   ] 2019-02-05 18:29:37 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 708
2019-02-05 18:29:37 [DEBUG   ] 2019-02-05 18:29:37 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 709
2019-02-05 18:29:37 [DEBUG   ] 2019-02-05 18:29:37 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 710
2019-02-05 18:29:37 [DEBUG   ] 2019-02-05 18:29:37 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 711
2019-02-05 18:29:37 [DEBUG   ] 2019-02-05 18:29:37 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 712
2019-02-05 18:29:37 [DEBUG   ] 2019-02-05 18:29:37 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 713
2019-02-05 18:29:37 [DEBUG   ] 2019-02-05 18:29:37 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 714
2019-02-05 18:29:37 [DEBUG   ] 2019-02-05 18:29:37 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 715
2019-02-05 18:29:37 [DEBUG   ] 2019-02-05 18:29:37 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 716
2019-02-05 18:29:37 [DEBUG   ] 2019-02-05 18:29:37 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 717
2019-02-05 18:29:37 [DEBUG   ] 2019-02-05 18:29:37 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 718
2019-02-05 18:29:37 [DEBUG   ] 2019-02-05 18:29:37 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 719
2019-02-05 18:29:37 [DEBUG   ] 2019-02-05 18:29:37 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 720
2019-02-05 18:29:37 [DEBUG   ] 2019-02-05 18:29:37 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 721
2019-02-05 18:29:37 [DEBUG   ] 2019-02-05 18:29:37 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 722
2019-02-05 18:29:37 [DEBUG   ] 2019-02-05 18:29:37 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 723
2019-02-05 18:29:37 [DEBUG   ] 2019-02-05 18:29:37 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 724
2019-02-05 18:29:37 [DEBUG   ] 2019-02-05 18:29:37 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 725
2019-02-05 18:29:37 [DEBUG   ] 2019-02-05 18:29:37 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 726
2019-02-05 18:29:37 [DEBUG   ] 2019-02-05 18:29:37 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 727
2019-02-05 18:29:37 [DEBUG   ] 2019-02-05 18:29:37 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 728
2019-02-05 18:29:37 [DEBUG   ] 2019-02-05 18:29:37 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 729
2019-02-05 18:29:37 [DEBUG   ] 2019-02-05 18:29:37 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 730
2019-02-05 18:29:49 [DEBUG   ] 2019-02-05 18:29:49 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 705 exited with status 0
2019-02-05 18:29:49 [DEBUG   ] 2019-02-05 18:29:49 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 706 exited with status 0
2019-02-05 18:29:49 [DEBUG   ] 2019-02-05 18:29:49 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 707 exited with status 0
2019-02-05 18:29:49 [DEBUG   ] 2019-02-05 18:29:49 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 708 exited with status 0
2019-02-05 18:29:49 [DEBUG   ] 2019-02-05 18:29:49 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 709 exited with status 0
2019-02-05 18:29:49 [DEBUG   ] 2019-02-05 18:29:49 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 710 exited with status 0
2019-02-05 18:29:49 [DEBUG   ] 2019-02-05 18:29:49 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 711 exited with status 0
2019-02-05 18:29:49 [DEBUG   ] 2019-02-05 18:29:49 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 712 exited with status 0
2019-02-05 18:29:49 [DEBUG   ] 2019-02-05 18:29:49 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 713 exited with status 0
2019-02-05 18:29:49 [DEBUG   ] 2019-02-05 18:29:49 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 714 exited with status 0
2019-02-05 18:29:49 [DEBUG   ] 2019-02-05 18:29:49 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 715 exited with status 0
2019-02-05 18:29:49 [DEBUG   ] 2019-02-05 18:29:49 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 716 exited with status 0
2019-02-05 18:29:49 [DEBUG   ] 2019-02-05 18:29:49 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 717 exited with status 0
2019-02-05 18:29:49 [DEBUG   ] 2019-02-05 18:29:49 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 718 exited with status 0
2019-02-05 18:29:49 [DEBUG   ] 2019-02-05 18:29:49 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 719 exited with status 0
2019-02-05 18:29:49 [DEBUG   ] 2019-02-05 18:29:49 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 720 exited with status 0
2019-02-05 18:29:49 [DEBUG   ] 2019-02-05 18:29:49 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 721 exited with status 0
2019-02-05 18:29:49 [DEBUG   ] 2019-02-05 18:29:49 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 722 exited with status 0
2019-02-05 18:29:49 [DEBUG   ] 2019-02-05 18:29:49 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 723 exited with status 0
2019-02-05 18:29:49 [DEBUG   ] 2019-02-05 18:29:49 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 724 exited with status 0
2019-02-05 18:29:49 [DEBUG   ] 2019-02-05 18:29:49 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 725 exited with status 0
2019-02-05 18:29:49 [DEBUG   ] 2019-02-05 18:29:49 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 726 exited with status 0
2019-02-05 18:29:49 [DEBUG   ] 2019-02-05 18:29:49 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 727 exited with status 0
2019-02-05 18:29:50 [DEBUG   ] 2019-02-05 18:29:50 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 728 exited with status 0
2019-02-05 18:29:50 [DEBUG   ] 2019-02-05 18:29:50 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 729 exited with status 0
2019-02-05 18:29:50 [DEBUG   ] 2019-02-05 18:29:50 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 730 exited with status 0
2019-02-05 18:29:50 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2019-02-05 18:29:50 [DEBUG   ] spawn_process: at 2019-02-05 18:29:50 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2019-02-05 18:29:50 [DEBUG   ] spawn_process: at 2019-02-05 18:29:50 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2019-02-05 18:29:50 [DEBUG   ] spawn_process: at 2019-02-05 18:29:50 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2019-02-05 18:29:50 [DEBUG   ] spawn_process: at 2019-02-05 18:29:50 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2019-02-05 18:29:50 [DEBUG   ] spawn_process: at 2019-02-05 18:29:50 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2019-02-05 18:29:50 [DEBUG   ] spawn_process: at 2019-02-05 18:29:50 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2019-02-05 18:29:50 [DEBUG   ] spawn_process: at 2019-02-05 18:29:50 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2019-02-05 18:29:50 [DEBUG   ] spawn_process: at 2019-02-05 18:29:50 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2019-02-05 18:29:50 [DEBUG   ] spawn_process: at 2019-02-05 18:29:50 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2019-02-05 18:29:50 [DEBUG   ] spawn_process: at 2019-02-05 18:29:50 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2019-02-05 18:29:50 [DEBUG   ] spawn_process: at 2019-02-05 18:29:50 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2019-02-05 18:29:50 [DEBUG   ] spawn_process: at 2019-02-05 18:29:50 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2019-02-05 18:29:50 [DEBUG   ] spawn_process: at 2019-02-05 18:29:50 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2019-02-05 18:29:50 [DEBUG   ] spawn_process: at 2019-02-05 18:29:50 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2019-02-05 18:29:50 [DEBUG   ] spawn_process: at 2019-02-05 18:29:50 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2019-02-05 18:29:50 [DEBUG   ] spawn_process: at 2019-02-05 18:29:50 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2019-02-05 18:29:50 [DEBUG   ] spawn_process: at 2019-02-05 18:29:50 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2019-02-05 18:29:50 [DEBUG   ] spawn_process: at 2019-02-05 18:29:50 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2019-02-05 18:29:50 [DEBUG   ] spawn_process: at 2019-02-05 18:29:50 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2019-02-05 18:29:50 [DEBUG   ] spawn_process: at 2019-02-05 18:29:50 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2019-02-05 18:29:50 [DEBUG   ] spawn_process: at 2019-02-05 18:29:50 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2019-02-05 18:29:50 [DEBUG   ] spawn_process: at 2019-02-05 18:29:50 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2019-02-05 18:29:50 [DEBUG   ] spawn_process: at 2019-02-05 18:29:50 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2019-02-05 18:29:50 [DEBUG   ] spawn_process: at 2019-02-05 18:29:50 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2019-02-05 18:29:50 [DEBUG   ] spawn_process: at 2019-02-05 18:29:50 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2019-02-05 18:29:50 [DEBUG   ] spawn_process: at 2019-02-05 18:29:50 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2019-02-05 18:29:50 [DEBUG   ] 2019-02-05 18:29:50 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 757
2019-02-05 18:29:50 [DEBUG   ] 2019-02-05 18:29:50 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 758
2019-02-05 18:29:54 [DEBUG   ] Got command RPT from MCS: ref #1411991
2019-02-05 18:29:54 [DEBUG   ] summary = BOOTING
2019-02-05 18:29:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411991  15 58519 66594765 ABOOTINGBOOTING'
2019-02-05 18:29:55 [DEBUG   ] 2019-02-05 18:29:55 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 757 exited with status 0
2019-02-05 18:29:55 [DEBUG   ] 2019-02-05 18:29:55 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 758 exited with status 0
2019-02-05 18:29:55 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2019-02-05 18:29:55 [DEBUG   ] spawn_process: at 2019-02-05 18:29:55 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2019-02-05 18:29:55 [DEBUG   ] spawn_process: at 2019-02-05 18:29:55 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2019-02-05 18:29:55 [INFO    ] Setting Beam 1 xbars
2019-02-05 18:29:55 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2019-02-05 18:29:55 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2019-02-05 18:29:55 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2019-02-05 18:29:55 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2019-02-05 18:29:56 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2019-02-05 18:29:56 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2019-02-05 18:29:56 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2019-02-05 18:29:56 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2019-02-05 18:29:56 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2019-02-05 18:29:56 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2019-02-05 18:29:56 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2019-02-05 18:29:56 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2019-02-05 18:29:56 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2019-02-05 18:29:57 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2019-02-05 18:29:57 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2019-02-05 18:29:57 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2019-02-05 18:29:57 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2019-02-05 18:29:57 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2019-02-05 18:29:57 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2019-02-05 18:29:57 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2019-02-05 18:29:57 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2019-02-05 18:29:57 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2019-02-05 18:29:58 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2019-02-05 18:29:58 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2019-02-05 18:29:58 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2019-02-05 18:29:58 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2019-02-05 18:29:58 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2019-02-05 18:29:58 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2019-02-05 18:29:58 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2019-02-05 18:29:58 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2019-02-05 18:29:58 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2019-02-05 18:29:59 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2019-02-05 18:29:59 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2019-02-05 18:29:59 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2019-02-05 18:29:59 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2019-02-05 18:29:59 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2019-02-05 18:29:59 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2019-02-05 18:29:59 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2019-02-05 18:29:59 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2019-02-05 18:29:59 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2019-02-05 18:29:59 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2019-02-05 18:30:00 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2019-02-05 18:30:00 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2019-02-05 18:30:00 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2019-02-05 18:30:00 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2019-02-05 18:30:00 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2019-02-05 18:30:00 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2019-02-05 18:30:00 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2019-02-05 18:30:00 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2019-02-05 18:30:00 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2019-02-05 18:30:01 [INFO    ] Setting Beam 2 xbars
2019-02-05 18:30:01 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2019-02-05 18:30:01 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2019-02-05 18:30:01 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2019-02-05 18:30:01 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2019-02-05 18:30:01 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2019-02-05 18:30:01 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2019-02-05 18:30:01 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2019-02-05 18:30:01 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2019-02-05 18:30:01 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2019-02-05 18:30:02 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2019-02-05 18:30:02 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2019-02-05 18:30:02 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2019-02-05 18:30:02 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2019-02-05 18:30:02 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2019-02-05 18:30:02 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2019-02-05 18:30:02 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2019-02-05 18:30:02 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2019-02-05 18:30:02 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2019-02-05 18:30:03 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2019-02-05 18:30:03 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2019-02-05 18:30:03 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2019-02-05 18:30:03 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2019-02-05 18:30:03 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2019-02-05 18:30:03 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2019-02-05 18:30:03 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2019-02-05 18:30:03 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2019-02-05 18:30:03 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2019-02-05 18:30:04 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2019-02-05 18:30:04 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2019-02-05 18:30:04 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2019-02-05 18:30:04 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2019-02-05 18:30:04 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2019-02-05 18:30:04 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2019-02-05 18:30:04 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2019-02-05 18:30:04 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2019-02-05 18:30:04 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2019-02-05 18:30:04 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2019-02-05 18:30:05 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2019-02-05 18:30:05 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2019-02-05 18:30:05 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2019-02-05 18:30:05 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2019-02-05 18:30:05 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2019-02-05 18:30:05 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2019-02-05 18:30:05 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2019-02-05 18:30:05 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2019-02-05 18:30:05 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2019-02-05 18:30:06 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2019-02-05 18:30:06 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2019-02-05 18:30:06 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2019-02-05 18:30:06 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2019-02-05 18:30:06 [INFO    ] Setting Beam 3 xbars
2019-02-05 18:30:06 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2019-02-05 18:30:06 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2019-02-05 18:30:06 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2019-02-05 18:30:06 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2019-02-05 18:30:06 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2019-02-05 18:30:07 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2019-02-05 18:30:07 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2019-02-05 18:30:07 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2019-02-05 18:30:07 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2019-02-05 18:30:07 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2019-02-05 18:30:07 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2019-02-05 18:30:07 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2019-02-05 18:30:07 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2019-02-05 18:30:07 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2019-02-05 18:30:08 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2019-02-05 18:30:08 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2019-02-05 18:30:08 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2019-02-05 18:30:08 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2019-02-05 18:30:08 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2019-02-05 18:30:08 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2019-02-05 18:30:08 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2019-02-05 18:30:08 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2019-02-05 18:30:08 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2019-02-05 18:30:08 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2019-02-05 18:30:09 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2019-02-05 18:30:09 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2019-02-05 18:30:09 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2019-02-05 18:30:09 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2019-02-05 18:30:09 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2019-02-05 18:30:09 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2019-02-05 18:30:09 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2019-02-05 18:30:09 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2019-02-05 18:30:09 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2019-02-05 18:30:10 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2019-02-05 18:30:10 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2019-02-05 18:30:10 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2019-02-05 18:30:10 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2019-02-05 18:30:10 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2019-02-05 18:30:10 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2019-02-05 18:30:10 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2019-02-05 18:30:10 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2019-02-05 18:30:10 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2019-02-05 18:30:11 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2019-02-05 18:30:11 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2019-02-05 18:30:11 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2019-02-05 18:30:11 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2019-02-05 18:30:11 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2019-02-05 18:30:11 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2019-02-05 18:30:11 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2019-02-05 18:30:11 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2019-02-05 18:30:11 [INFO    ] Setting Beam 4 xbars
2019-02-05 18:30:11 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2019-02-05 18:30:12 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2019-02-05 18:30:12 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2019-02-05 18:30:12 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2019-02-05 18:30:12 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2019-02-05 18:30:12 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2019-02-05 18:30:12 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2019-02-05 18:30:12 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2019-02-05 18:30:12 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2019-02-05 18:30:12 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2019-02-05 18:30:12 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2019-02-05 18:30:13 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2019-02-05 18:30:13 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2019-02-05 18:30:13 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2019-02-05 18:30:13 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2019-02-05 18:30:13 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2019-02-05 18:30:13 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2019-02-05 18:30:13 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2019-02-05 18:30:13 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2019-02-05 18:30:13 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2019-02-05 18:30:14 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2019-02-05 18:30:14 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2019-02-05 18:30:14 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2019-02-05 18:30:14 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2019-02-05 18:30:14 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2019-02-05 18:30:14 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2019-02-05 18:30:14 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2019-02-05 18:30:14 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2019-02-05 18:30:14 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2019-02-05 18:30:15 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2019-02-05 18:30:15 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2019-02-05 18:30:15 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2019-02-05 18:30:15 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2019-02-05 18:30:15 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2019-02-05 18:30:15 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2019-02-05 18:30:15 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2019-02-05 18:30:15 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2019-02-05 18:30:15 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2019-02-05 18:30:16 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2019-02-05 18:30:16 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2019-02-05 18:30:16 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2019-02-05 18:30:16 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2019-02-05 18:30:16 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2019-02-05 18:30:16 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2019-02-05 18:30:16 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2019-02-05 18:30:16 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2019-02-05 18:30:16 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2019-02-05 18:30:16 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2019-02-05 18:30:17 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2019-02-05 18:30:17 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2019-02-05 18:30:17 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2019-02-05 18:30:17 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2019-02-05 18:30:17 [INFO    ] All xbars set
2019-02-05 18:30:17 [INFO    ] Setting adder chain routing for all beams
2019-02-05 18:30:22 [INFO    ] Setting beam ids
2019-02-05 18:30:32 [INFO    ] Starting beam delay calibration
2019-02-05 18:30:44 [INFO    ] Beam 1 latency is 5740
2019-02-05 18:30:44 [INFO    ] Beam 2 latency is 5731
2019-02-05 18:30:44 [INFO    ] Beam 3 latency is 5724
2019-02-05 18:30:44 [INFO    ] Beam 4 latency is 5718
2019-02-05 18:30:44 [INFO    ] Stop calibration
2019-02-05 18:30:52 [INFO    ] Beam delay calibration successful
2019-02-05 18:30:52 [INFO    ] Calibration passed
2019-02-05 18:30:52 [DEBUG   ] spawn_process: at 2019-02-05 18:30:52 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2019-02-05 18:30:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2019-02-05 18:30:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2019-02-05 18:30:52 [DEBUG   ] spawn_process: at 2019-02-05 18:30:52 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2019-02-05 18:30:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2019-02-05 18:30:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2019-02-05 18:30:52 [DEBUG   ] spawn_process: at 2019-02-05 18:30:52 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2019-02-05 18:30:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2019-02-05 18:30:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2019-02-05 18:30:53 [DEBUG   ] spawn_process: at 2019-02-05 18:30:53 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2019-02-05 18:30:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2019-02-05 18:30:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2019-02-05 18:30:53 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2019-02-05 18:30:53 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 279 ms (1549391453.281 s) with PID 2358 and time 1549391454
2019-02-05 18:30:53 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2019-02-05 18:30:53 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 369 ms (1549391453.371 s) with PID 2361 and time 1549391454
2019-02-05 18:30:54 [DEBUG   ] Finished updating ant stats in 0.876 seconds
2019-02-05 18:30:54 [INFO    ] Started antennas statistics background thread
2019-02-05 18:30:54 [INFO    ] Started board flags background thread
2019-02-05 18:30:54 [INFO    ] Started BAM background thread
2019-02-05 18:30:54 [INFO    ] Finished the INI process (ref. #1411986) in 108.812 s
2019-02-05 18:30:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 18:30:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:30:55 [WARNING ] (13, 1, 'bot')
2019-02-05 18:30:55 [WARNING ] (13, 1, 'bot')
2019-02-05 18:30:55 [WARNING ] (13, 1, 'bot')
2019-02-05 18:30:55 [WARNING ] (13, 1, 'bot')
2019-02-05 18:30:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:30:55 [DEBUG   ] Finished updating board flags in 1.059 seconds
2019-02-05 18:31:11 [DEBUG   ] Got command RPT from MCS: ref #1411992
2019-02-05 18:31:11 [DEBUG   ] summary = ERROR
2019-02-05 18:31:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411992  13 58519 66671997 A  ERRORERROR'
2019-02-05 18:31:11 [DEBUG   ] Got command RPT from MCS: ref #1411993
2019-02-05 18:31:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 18:31:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1411993  77 58519 66671998 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 18:31:14 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-05 18:31:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 18:31:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 18:31:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:31:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 18:31:55 [WARNING ] (13, 1, 'bot')
2019-02-05 18:31:55 [WARNING ] (13, 1, 'bot')
2019-02-05 18:31:55 [WARNING ] (13, 1, 'bot')
2019-02-05 18:31:55 [WARNING ] (13, 1, 'bot')
2019-02-05 18:31:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:31:55 [DEBUG   ] Finished updating board flags in 1.010 seconds
2019-02-05 18:32:05 [DEBUG   ] Got command RPT from MCS: ref #1412009
2019-02-05 18:32:05 [DEBUG   ] summary = ERROR
2019-02-05 18:32:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412009  13 58519 66725673 A  ERRORERROR'
2019-02-05 18:32:05 [DEBUG   ] Got command RPT from MCS: ref #1412010
2019-02-05 18:32:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 18:32:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412010  77 58519 66725674 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 18:32:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 18:32:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 18:32:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 18:32:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:32:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 18:32:55 [WARNING ] (13, 1, 'bot')
2019-02-05 18:32:55 [WARNING ] (13, 1, 'bot')
2019-02-05 18:32:55 [WARNING ] (13, 1, 'bot')
2019-02-05 18:32:55 [WARNING ] (13, 1, 'bot')
2019-02-05 18:32:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:32:55 [DEBUG   ] Finished updating board flags in 1.030 seconds
2019-02-05 18:33:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 18:33:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 18:33:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 18:33:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:33:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:33:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:33:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:33:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:33:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:33:56 [DEBUG   ] Finished updating board flags in 2.023 seconds
2019-02-05 18:34:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 18:34:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 18:34:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 18:34:54 [DEBUG   ] Got command RPT from MCS: ref #1412017
2019-02-05 18:34:54 [DEBUG   ] summary = ERROR
2019-02-05 18:34:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412017  13 58519 66894845 A  ERRORERROR'
2019-02-05 18:34:55 [DEBUG   ] Got command RPT from MCS: ref #1412018
2019-02-05 18:34:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 18:34:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412018  77 58519 66895050 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 18:34:55 [DEBUG   ] Got command RPT from MCS: ref #1412019
2019-02-05 18:34:55 [DEBUG   ] summary = ERROR
2019-02-05 18:34:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412019  13 58519 66895254 A  ERRORERROR'
2019-02-05 18:34:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:34:55 [DEBUG   ] Got command RPT from MCS: ref #1412021
2019-02-05 18:34:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 18:34:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412021  77 58519 66895457 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 18:34:55 [DEBUG   ] Got command RPT from MCS: ref #1412022
2019-02-05 18:34:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 18:34:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412022  12 58519 66895654 A  ERRORB’™š'
2019-02-05 18:34:55 [WARNING ] (13, 1, 'bot')
2019-02-05 18:34:55 [WARNING ] (13, 1, 'bot')
2019-02-05 18:34:55 [WARNING ] (13, 1, 'bot')
2019-02-05 18:34:55 [WARNING ] (13, 1, 'bot')
2019-02-05 18:34:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:34:55 [DEBUG   ] Finished updating board flags in 1.381 seconds
2019-02-05 18:35:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 18:35:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 18:35:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 18:35:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:35:55 [WARNING ] (13, 1, 'bot')
2019-02-05 18:35:55 [WARNING ] (13, 1, 'bot')
2019-02-05 18:35:55 [WARNING ] (13, 1, 'bot')
2019-02-05 18:35:55 [WARNING ] (13, 1, 'bot')
2019-02-05 18:35:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:35:55 [DEBUG   ] Finished updating board flags in 1.268 seconds
2019-02-05 18:36:12 [DEBUG   ] Got command RPT from MCS: ref #1412031
2019-02-05 18:36:12 [DEBUG   ] summary = ERROR
2019-02-05 18:36:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412031  13 58519 66972001 A  ERRORERROR'
2019-02-05 18:36:12 [DEBUG   ] Got command RPT from MCS: ref #1412032
2019-02-05 18:36:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 18:36:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412032  77 58519 66972002 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 18:36:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 18:36:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 18:36:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 18:36:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:36:55 [WARNING ] (13, 1, 'bot')
2019-02-05 18:36:55 [WARNING ] (13, 1, 'bot')
2019-02-05 18:36:55 [WARNING ] (13, 1, 'bot')
2019-02-05 18:36:55 [WARNING ] (13, 1, 'bot')
2019-02-05 18:36:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:36:55 [DEBUG   ] Finished updating board flags in 1.211 seconds
2019-02-05 18:37:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 18:37:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 18:37:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 18:37:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:37:55 [WARNING ] (13, 1, 'bot')
2019-02-05 18:37:55 [WARNING ] (13, 1, 'bot')
2019-02-05 18:37:55 [WARNING ] (13, 1, 'bot')
2019-02-05 18:37:55 [WARNING ] (13, 1, 'bot')
2019-02-05 18:37:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:37:55 [DEBUG   ] Finished updating board flags in 1.133 seconds
2019-02-05 18:38:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 18:38:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 18:38:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 18:38:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:38:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:38:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:38:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:38:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:38:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:38:56 [DEBUG   ] Finished updating board flags in 1.593 seconds
2019-02-05 18:39:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 18:39:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 18:39:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 18:39:54 [DEBUG   ] Got command RPT from MCS: ref #1412052
2019-02-05 18:39:54 [DEBUG   ] summary = ERROR
2019-02-05 18:39:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412052  13 58519 67194941 A  ERRORERROR'
2019-02-05 18:39:55 [DEBUG   ] Got command RPT from MCS: ref #1412053
2019-02-05 18:39:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 18:39:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412053  77 58519 67195133 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 18:39:55 [DEBUG   ] Got command RPT from MCS: ref #1412054
2019-02-05 18:39:55 [DEBUG   ] summary = ERROR
2019-02-05 18:39:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412054  13 58519 67195338 A  ERRORERROR'
2019-02-05 18:39:55 [DEBUG   ] Got command RPT from MCS: ref #1412055
2019-02-05 18:39:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 18:39:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412055  77 58519 67195534 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 18:39:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:39:55 [DEBUG   ] Got command RPT from MCS: ref #1412056
2019-02-05 18:39:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 18:39:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412056  12 58519 67195737 A  ERRORB�ÌÍ'
2019-02-05 18:39:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:39:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:39:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:39:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:39:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:39:56 [DEBUG   ] Finished updating board flags in 1.419 seconds
2019-02-05 18:40:14 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-02-05 18:40:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-05 18:40:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-05 18:40:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 18:40:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:40:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:40:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:40:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:40:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:40:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:40:56 [DEBUG   ] Finished updating board flags in 1.347 seconds
2019-02-05 18:41:11 [DEBUG   ] Got command RPT from MCS: ref #1412057
2019-02-05 18:41:11 [DEBUG   ] summary = ERROR
2019-02-05 18:41:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412057  13 58519 67271994 A  ERRORERROR'
2019-02-05 18:41:11 [DEBUG   ] Got command RPT from MCS: ref #1412058
2019-02-05 18:41:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 18:41:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412058  77 58519 67271994 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 18:41:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-05 18:41:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-05 18:41:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-05 18:41:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:41:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:41:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:41:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:41:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:41:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:41:56 [DEBUG   ] Finished updating board flags in 1.211 seconds
2019-02-05 18:42:14 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2019-02-05 18:42:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 18:42:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 18:42:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:42:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:42:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:42:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:42:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:42:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:42:56 [DEBUG   ] Finished updating board flags in 1.211 seconds
2019-02-05 18:43:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 18:43:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 18:43:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 18:43:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:43:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 18:43:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-02-05 18:43:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:43:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:43:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:43:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:43:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:43:56 [DEBUG   ] Finished updating board flags in 1.231 seconds
2019-02-05 18:44:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 18:44:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 18:44:55 [DEBUG   ] Got command RPT from MCS: ref #1412084
2019-02-05 18:44:55 [DEBUG   ] summary = ERROR
2019-02-05 18:44:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412084  13 58519 67495017 A  ERRORERROR'
2019-02-05 18:44:55 [DEBUG   ] Got command RPT from MCS: ref #1412085
2019-02-05 18:44:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 18:44:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412085  77 58519 67495221 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 18:44:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 18:44:55 [DEBUG   ] Got command RPT from MCS: ref #1412086
2019-02-05 18:44:55 [DEBUG   ] summary = ERROR
2019-02-05 18:44:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412086  13 58519 67495426 A  ERRORERROR'
2019-02-05 18:44:55 [DEBUG   ] Got command RPT from MCS: ref #1412088
2019-02-05 18:44:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 18:44:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412088  77 58519 67495634 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 18:44:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:44:55 [DEBUG   ] Got command RPT from MCS: ref #1412089
2019-02-05 18:44:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 18:44:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412089  12 58519 67495826 A  ERRORB�™š'
2019-02-05 18:44:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:44:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:44:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:44:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:44:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:44:56 [DEBUG   ] Finished updating board flags in 1.179 seconds
2019-02-05 18:45:15 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-02-05 18:45:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 18:45:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 18:45:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:45:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:45:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:45:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:45:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:45:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:45:56 [DEBUG   ] Finished updating board flags in 1.020 seconds
2019-02-05 18:46:12 [DEBUG   ] Got command RPT from MCS: ref #1412094
2019-02-05 18:46:12 [DEBUG   ] summary = ERROR
2019-02-05 18:46:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412094  13 58519 67572005 A  ERRORERROR'
2019-02-05 18:46:12 [DEBUG   ] Got command RPT from MCS: ref #1412095
2019-02-05 18:46:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 18:46:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412095  77 58519 67572006 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 18:46:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 18:46:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 18:46:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 18:46:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:46:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:46:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:46:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:46:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:46:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:46:57 [DEBUG   ] Finished updating board flags in 2.001 seconds
2019-02-05 18:47:15 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-02-05 18:47:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 18:47:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 18:47:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:47:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:47:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:47:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:47:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:47:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:47:57 [DEBUG   ] Finished updating board flags in 1.975 seconds
2019-02-05 18:48:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 18:48:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 18:48:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 18:48:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:48:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-02-05 18:48:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:48:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:48:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:48:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:48:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:48:56 [DEBUG   ] Finished updating board flags in 1.269 seconds
2019-02-05 18:49:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 18:49:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 18:49:55 [DEBUG   ] Got command RPT from MCS: ref #1412115
2019-02-05 18:49:55 [DEBUG   ] summary = ERROR
2019-02-05 18:49:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412115  13 58519 67795109 A  ERRORERROR'
2019-02-05 18:49:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 18:49:55 [DEBUG   ] Got command RPT from MCS: ref #1412116
2019-02-05 18:49:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 18:49:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412116  77 58519 67795313 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 18:49:55 [DEBUG   ] Got command RPT from MCS: ref #1412117
2019-02-05 18:49:55 [DEBUG   ] summary = ERROR
2019-02-05 18:49:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412117  13 58519 67795505 A  ERRORERROR'
2019-02-05 18:49:55 [DEBUG   ] Got command RPT from MCS: ref #1412118
2019-02-05 18:49:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 18:49:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412118  77 58519 67795709 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 18:49:55 [DEBUG   ] Got command RPT from MCS: ref #1412119
2019-02-05 18:49:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 18:49:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412119  12 58519 67795913 A  ERRORBš™š'
2019-02-05 18:49:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:49:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:49:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:49:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:49:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:49:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:49:56 [DEBUG   ] Finished updating board flags in 1.213 seconds
2019-02-05 18:50:02 [DEBUG   ] Got command BAM from MCS: ref #1412125
2019-02-05 18:50:02 [INFO    ] Finished processing BAM request
2019-02-05 18:50:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 18:50:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412125   8 58519 67802025 A  ERROR'
2019-02-05 18:50:02 [DEBUG   ] Got command BAM from MCS: ref #1412124
2019-02-05 18:50:02 [INFO    ] Finished processing BAM request
2019-02-05 18:50:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 18:50:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412124   8 58519 67802029 A  ERROR'
2019-02-05 18:50:02 [DEBUG   ] Got command DRX from MCS: ref #1412127
2019-02-05 18:50:02 [INFO    ] sending drx command to lwa34
2019-02-05 18:50:02 [DEBUG   ] run_process: at 2019-02-05 18:50:02 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 1 35000000.0 6 9 9']
2019-02-05 18:50:02 [DEBUG   ] drx = exited with status True, code 0x00
2019-02-05 18:50:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX  1412127   8 58519 67802105 A  ERROR'
2019-02-05 18:50:02 [DEBUG   ] Got command DRX from MCS: ref #1412126
2019-02-05 18:50:02 [INFO    ] sending drx command to lwa16
2019-02-05 18:50:02 [DEBUG   ] run_process: at 2019-02-05 18:50:02 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 1 35000000.0 6 9 9']
2019-02-05 18:50:02 [DEBUG   ] drx = exited with status True, code 0x00
2019-02-05 18:50:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX  1412126   8 58519 67802109 A  ERROR'
2019-02-05 18:50:02 [DEBUG   ] Got command DRX from MCS: ref #1412128
2019-02-05 18:50:02 [INFO    ] sending drx command to lwa16
2019-02-05 18:50:02 [DEBUG   ] run_process: at 2019-02-05 18:50:02 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 2 45000000.0 6 9 9']
2019-02-05 18:50:02 [DEBUG   ] drx = exited with status True, code 0x00
2019-02-05 18:50:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX  1412128   8 58519 67802113 A  ERROR'
2019-02-05 18:50:02 [DEBUG   ] Got command DRX from MCS: ref #1412129
2019-02-05 18:50:02 [INFO    ] sending drx command to lwa34
2019-02-05 18:50:02 [DEBUG   ] run_process: at 2019-02-05 18:50:02 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 2 45000000.0 6 9 9']
2019-02-05 18:50:02 [DEBUG   ] drx = exited with status True, code 0x00
2019-02-05 18:50:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX  1412129   8 58519 67802117 A  ERROR'
2019-02-05 18:50:02 [INFO    ] Finished starting DRX
2019-02-05 18:50:02 [INFO    ] Finished starting DRX
2019-02-05 18:50:02 [INFO    ] Finished starting DRX
2019-02-05 18:50:02 [INFO    ] Finished starting DRX
2019-02-05 18:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 18:50:02 [DEBUG   ] spawn_process: at 2019-02-05 18:50:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 18:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 18:50:02 [DEBUG   ] spawn_process: at 2019-02-05 18:50:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 18:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 18:50:02 [DEBUG   ] spawn_process: at 2019-02-05 18:50:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 18:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 18:50:02 [DEBUG   ] spawn_process: at 2019-02-05 18:50:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 18:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 18:50:02 [DEBUG   ] spawn_process: at 2019-02-05 18:50:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 18:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 18:50:02 [DEBUG   ] spawn_process: at 2019-02-05 18:50:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 18:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 18:50:02 [DEBUG   ] spawn_process: at 2019-02-05 18:50:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 18:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 18:50:02 [DEBUG   ] spawn_process: at 2019-02-05 18:50:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 18:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 18:50:02 [DEBUG   ] spawn_process: at 2019-02-05 18:50:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 18:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 18:50:02 [DEBUG   ] spawn_process: at 2019-02-05 18:50:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 18:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 18:50:02 [DEBUG   ] spawn_process: at 2019-02-05 18:50:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 18:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 18:50:02 [DEBUG   ] spawn_process: at 2019-02-05 18:50:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 18:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 18:50:02 [DEBUG   ] spawn_process: at 2019-02-05 18:50:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 18:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 18:50:02 [DEBUG   ] spawn_process: at 2019-02-05 18:50:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 18:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 18:50:02 [DEBUG   ] spawn_process: at 2019-02-05 18:50:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 18:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 18:50:02 [DEBUG   ] spawn_process: at 2019-02-05 18:50:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 18:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 18:50:02 [DEBUG   ] spawn_process: at 2019-02-05 18:50:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 18:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 18:50:02 [DEBUG   ] spawn_process: at 2019-02-05 18:50:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 18:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 18:50:02 [DEBUG   ] spawn_process: at 2019-02-05 18:50:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 18:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 18:50:02 [DEBUG   ] spawn_process: at 2019-02-05 18:50:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 18:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 18:50:02 [DEBUG   ] spawn_process: at 2019-02-05 18:50:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 18:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 18:50:02 [DEBUG   ] spawn_process: at 2019-02-05 18:50:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 18:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 18:50:02 [DEBUG   ] spawn_process: at 2019-02-05 18:50:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 18:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 18:50:02 [DEBUG   ] spawn_process: at 2019-02-05 18:50:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 18:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 18:50:02 [DEBUG   ] spawn_process: at 2019-02-05 18:50:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 18:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 18:50:02 [DEBUG   ] spawn_process: at 2019-02-05 18:50:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 18:50:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 18:50:23 [DEBUG   ] Got command BAM from MCS: ref #1412136
2019-02-05 18:50:23 [INFO    ] Finished processing BAM request
2019-02-05 18:50:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 18:50:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412136   8 58519 67823033 A  ERROR'
2019-02-05 18:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 18:50:23 [DEBUG   ] spawn_process: at 2019-02-05 18:50:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 18:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 18:50:23 [DEBUG   ] spawn_process: at 2019-02-05 18:50:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 18:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 18:50:23 [DEBUG   ] spawn_process: at 2019-02-05 18:50:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 18:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 18:50:23 [DEBUG   ] spawn_process: at 2019-02-05 18:50:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 18:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 18:50:23 [DEBUG   ] spawn_process: at 2019-02-05 18:50:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 18:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 18:50:23 [DEBUG   ] spawn_process: at 2019-02-05 18:50:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 18:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 18:50:23 [DEBUG   ] spawn_process: at 2019-02-05 18:50:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 18:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 18:50:23 [DEBUG   ] spawn_process: at 2019-02-05 18:50:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 18:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 18:50:23 [DEBUG   ] spawn_process: at 2019-02-05 18:50:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 18:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 18:50:23 [DEBUG   ] spawn_process: at 2019-02-05 18:50:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 18:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 18:50:23 [DEBUG   ] spawn_process: at 2019-02-05 18:50:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 18:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 18:50:23 [DEBUG   ] spawn_process: at 2019-02-05 18:50:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 18:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 18:50:23 [DEBUG   ] spawn_process: at 2019-02-05 18:50:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 18:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 18:50:23 [DEBUG   ] spawn_process: at 2019-02-05 18:50:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 18:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 18:50:23 [DEBUG   ] spawn_process: at 2019-02-05 18:50:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 18:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 18:50:23 [DEBUG   ] spawn_process: at 2019-02-05 18:50:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 18:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 18:50:23 [DEBUG   ] spawn_process: at 2019-02-05 18:50:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 18:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 18:50:23 [DEBUG   ] spawn_process: at 2019-02-05 18:50:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 18:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 18:50:23 [DEBUG   ] spawn_process: at 2019-02-05 18:50:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 18:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 18:50:23 [DEBUG   ] spawn_process: at 2019-02-05 18:50:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 18:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 18:50:23 [DEBUG   ] spawn_process: at 2019-02-05 18:50:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 18:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 18:50:23 [DEBUG   ] spawn_process: at 2019-02-05 18:50:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 18:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 18:50:23 [DEBUG   ] spawn_process: at 2019-02-05 18:50:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 18:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 18:50:23 [DEBUG   ] spawn_process: at 2019-02-05 18:50:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 18:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 18:50:23 [DEBUG   ] spawn_process: at 2019-02-05 18:50:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 18:50:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 18:50:23 [DEBUG   ] spawn_process: at 2019-02-05 18:50:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 18:50:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 18:50:44 [DEBUG   ] Got command BAM from MCS: ref #1412137
2019-02-05 18:50:44 [INFO    ] Finished processing BAM request
2019-02-05 18:50:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 18:50:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412137   8 58519 67844025 A  ERROR'
2019-02-05 18:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-02-05 18:50:44 [DEBUG   ] spawn_process: at 2019-02-05 18:50:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-02-05 18:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-02-05 18:50:44 [DEBUG   ] spawn_process: at 2019-02-05 18:50:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-02-05 18:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-02-05 18:50:44 [DEBUG   ] spawn_process: at 2019-02-05 18:50:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-02-05 18:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-02-05 18:50:44 [DEBUG   ] spawn_process: at 2019-02-05 18:50:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-02-05 18:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-02-05 18:50:44 [DEBUG   ] spawn_process: at 2019-02-05 18:50:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-02-05 18:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-02-05 18:50:44 [DEBUG   ] spawn_process: at 2019-02-05 18:50:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-02-05 18:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-02-05 18:50:44 [DEBUG   ] spawn_process: at 2019-02-05 18:50:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-02-05 18:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-02-05 18:50:44 [DEBUG   ] spawn_process: at 2019-02-05 18:50:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-02-05 18:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-02-05 18:50:44 [DEBUG   ] spawn_process: at 2019-02-05 18:50:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-02-05 18:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-02-05 18:50:44 [DEBUG   ] spawn_process: at 2019-02-05 18:50:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-02-05 18:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-02-05 18:50:44 [DEBUG   ] spawn_process: at 2019-02-05 18:50:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-02-05 18:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-02-05 18:50:44 [DEBUG   ] spawn_process: at 2019-02-05 18:50:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-02-05 18:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-02-05 18:50:44 [DEBUG   ] spawn_process: at 2019-02-05 18:50:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-02-05 18:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-02-05 18:50:44 [DEBUG   ] spawn_process: at 2019-02-05 18:50:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-02-05 18:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-02-05 18:50:44 [DEBUG   ] spawn_process: at 2019-02-05 18:50:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-02-05 18:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-02-05 18:50:44 [DEBUG   ] spawn_process: at 2019-02-05 18:50:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-02-05 18:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-02-05 18:50:44 [DEBUG   ] spawn_process: at 2019-02-05 18:50:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-02-05 18:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-02-05 18:50:44 [DEBUG   ] spawn_process: at 2019-02-05 18:50:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-02-05 18:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-02-05 18:50:44 [DEBUG   ] spawn_process: at 2019-02-05 18:50:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-02-05 18:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-02-05 18:50:44 [DEBUG   ] spawn_process: at 2019-02-05 18:50:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-02-05 18:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-02-05 18:50:44 [DEBUG   ] spawn_process: at 2019-02-05 18:50:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-02-05 18:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-02-05 18:50:44 [DEBUG   ] spawn_process: at 2019-02-05 18:50:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-02-05 18:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-02-05 18:50:44 [DEBUG   ] spawn_process: at 2019-02-05 18:50:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-02-05 18:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-02-05 18:50:44 [DEBUG   ] spawn_process: at 2019-02-05 18:50:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-02-05 18:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-02-05 18:50:44 [DEBUG   ] spawn_process: at 2019-02-05 18:50:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-02-05 18:50:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-02-05 18:50:44 [DEBUG   ] spawn_process: at 2019-02-05 18:50:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-02-05 18:50:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 18:50:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:50:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-02-05 18:50:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:50:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:50:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:50:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:50:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:50:56 [DEBUG   ] Finished updating board flags in 1.155 seconds
2019-02-05 18:51:05 [DEBUG   ] Got command BAM from MCS: ref #1412138
2019-02-05 18:51:05 [INFO    ] Finished processing BAM request
2019-02-05 18:51:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 18:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412138   8 58519 67865029 A  ERROR'
2019-02-05 18:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 18:51:05 [DEBUG   ] spawn_process: at 2019-02-05 18:51:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 18:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 18:51:05 [DEBUG   ] spawn_process: at 2019-02-05 18:51:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 18:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 18:51:05 [DEBUG   ] spawn_process: at 2019-02-05 18:51:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 18:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 18:51:05 [DEBUG   ] spawn_process: at 2019-02-05 18:51:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 18:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 18:51:05 [DEBUG   ] spawn_process: at 2019-02-05 18:51:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 18:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 18:51:05 [DEBUG   ] spawn_process: at 2019-02-05 18:51:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 18:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 18:51:05 [DEBUG   ] spawn_process: at 2019-02-05 18:51:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 18:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 18:51:05 [DEBUG   ] spawn_process: at 2019-02-05 18:51:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 18:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 18:51:05 [DEBUG   ] spawn_process: at 2019-02-05 18:51:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 18:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 18:51:05 [DEBUG   ] spawn_process: at 2019-02-05 18:51:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 18:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 18:51:05 [DEBUG   ] spawn_process: at 2019-02-05 18:51:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 18:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 18:51:05 [DEBUG   ] spawn_process: at 2019-02-05 18:51:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 18:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 18:51:05 [DEBUG   ] spawn_process: at 2019-02-05 18:51:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 18:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 18:51:05 [DEBUG   ] spawn_process: at 2019-02-05 18:51:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 18:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 18:51:05 [DEBUG   ] spawn_process: at 2019-02-05 18:51:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 18:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 18:51:05 [DEBUG   ] spawn_process: at 2019-02-05 18:51:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 18:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 18:51:05 [DEBUG   ] spawn_process: at 2019-02-05 18:51:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 18:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 18:51:05 [DEBUG   ] spawn_process: at 2019-02-05 18:51:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 18:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 18:51:05 [DEBUG   ] spawn_process: at 2019-02-05 18:51:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 18:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 18:51:05 [DEBUG   ] spawn_process: at 2019-02-05 18:51:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 18:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 18:51:05 [DEBUG   ] spawn_process: at 2019-02-05 18:51:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 18:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 18:51:05 [DEBUG   ] spawn_process: at 2019-02-05 18:51:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 18:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 18:51:05 [DEBUG   ] spawn_process: at 2019-02-05 18:51:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 18:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 18:51:05 [DEBUG   ] spawn_process: at 2019-02-05 18:51:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 18:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 18:51:05 [DEBUG   ] spawn_process: at 2019-02-05 18:51:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 18:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 18:51:05 [DEBUG   ] spawn_process: at 2019-02-05 18:51:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 18:51:12 [DEBUG   ] Got command RPT from MCS: ref #1412139
2019-02-05 18:51:12 [DEBUG   ] summary = ERROR
2019-02-05 18:51:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412139  13 58519 67872005 A  ERRORERROR'
2019-02-05 18:51:12 [DEBUG   ] Got command RPT from MCS: ref #1412140
2019-02-05 18:51:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 18:51:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412140  77 58519 67872006 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 18:51:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 18:51:26 [DEBUG   ] Got command BAM from MCS: ref #1412156
2019-02-05 18:51:26 [INFO    ] Finished processing BAM request
2019-02-05 18:51:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 18:51:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412156   8 58519 67886025 A  ERROR'
2019-02-05 18:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 18:51:26 [DEBUG   ] spawn_process: at 2019-02-05 18:51:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 18:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 18:51:26 [DEBUG   ] spawn_process: at 2019-02-05 18:51:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 18:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 18:51:26 [DEBUG   ] spawn_process: at 2019-02-05 18:51:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 18:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 18:51:26 [DEBUG   ] spawn_process: at 2019-02-05 18:51:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 18:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 18:51:26 [DEBUG   ] spawn_process: at 2019-02-05 18:51:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 18:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 18:51:26 [DEBUG   ] spawn_process: at 2019-02-05 18:51:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 18:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 18:51:26 [DEBUG   ] spawn_process: at 2019-02-05 18:51:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 18:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 18:51:26 [DEBUG   ] spawn_process: at 2019-02-05 18:51:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 18:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 18:51:26 [DEBUG   ] spawn_process: at 2019-02-05 18:51:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 18:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 18:51:26 [DEBUG   ] spawn_process: at 2019-02-05 18:51:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 18:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 18:51:26 [DEBUG   ] spawn_process: at 2019-02-05 18:51:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 18:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 18:51:26 [DEBUG   ] spawn_process: at 2019-02-05 18:51:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 18:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 18:51:26 [DEBUG   ] spawn_process: at 2019-02-05 18:51:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 18:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 18:51:26 [DEBUG   ] spawn_process: at 2019-02-05 18:51:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 18:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 18:51:26 [DEBUG   ] spawn_process: at 2019-02-05 18:51:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 18:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 18:51:26 [DEBUG   ] spawn_process: at 2019-02-05 18:51:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 18:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 18:51:26 [DEBUG   ] spawn_process: at 2019-02-05 18:51:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 18:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 18:51:26 [DEBUG   ] spawn_process: at 2019-02-05 18:51:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 18:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 18:51:26 [DEBUG   ] spawn_process: at 2019-02-05 18:51:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 18:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 18:51:26 [DEBUG   ] spawn_process: at 2019-02-05 18:51:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 18:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 18:51:26 [DEBUG   ] spawn_process: at 2019-02-05 18:51:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 18:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 18:51:26 [DEBUG   ] spawn_process: at 2019-02-05 18:51:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 18:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 18:51:26 [DEBUG   ] spawn_process: at 2019-02-05 18:51:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 18:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 18:51:26 [DEBUG   ] spawn_process: at 2019-02-05 18:51:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 18:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 18:51:26 [DEBUG   ] spawn_process: at 2019-02-05 18:51:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 18:51:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 18:51:26 [DEBUG   ] spawn_process: at 2019-02-05 18:51:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 18:51:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 18:51:45 [DEBUG   ] Got command BAM from MCS: ref #1412157
2019-02-05 18:51:45 [INFO    ] Finished processing BAM request
2019-02-05 18:51:45 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 18:51:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412157   8 58519 67905029 A  ERROR'
2019-02-05 18:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 18:51:45 [DEBUG   ] spawn_process: at 2019-02-05 18:51:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 18:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 18:51:45 [DEBUG   ] spawn_process: at 2019-02-05 18:51:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 18:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 18:51:45 [DEBUG   ] spawn_process: at 2019-02-05 18:51:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 18:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 18:51:45 [DEBUG   ] spawn_process: at 2019-02-05 18:51:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 18:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 18:51:45 [DEBUG   ] spawn_process: at 2019-02-05 18:51:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 18:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 18:51:45 [DEBUG   ] spawn_process: at 2019-02-05 18:51:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 18:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 18:51:45 [DEBUG   ] spawn_process: at 2019-02-05 18:51:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 18:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 18:51:45 [DEBUG   ] spawn_process: at 2019-02-05 18:51:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 18:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 18:51:45 [DEBUG   ] spawn_process: at 2019-02-05 18:51:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 18:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 18:51:45 [DEBUG   ] spawn_process: at 2019-02-05 18:51:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 18:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 18:51:45 [DEBUG   ] spawn_process: at 2019-02-05 18:51:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 18:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 18:51:45 [DEBUG   ] spawn_process: at 2019-02-05 18:51:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 18:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 18:51:45 [DEBUG   ] spawn_process: at 2019-02-05 18:51:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 18:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 18:51:45 [DEBUG   ] spawn_process: at 2019-02-05 18:51:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 18:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 18:51:45 [DEBUG   ] spawn_process: at 2019-02-05 18:51:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 18:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 18:51:45 [DEBUG   ] spawn_process: at 2019-02-05 18:51:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 18:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 18:51:45 [DEBUG   ] spawn_process: at 2019-02-05 18:51:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 18:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 18:51:45 [DEBUG   ] spawn_process: at 2019-02-05 18:51:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 18:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 18:51:45 [DEBUG   ] spawn_process: at 2019-02-05 18:51:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 18:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 18:51:45 [DEBUG   ] spawn_process: at 2019-02-05 18:51:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 18:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 18:51:45 [DEBUG   ] spawn_process: at 2019-02-05 18:51:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 18:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 18:51:45 [DEBUG   ] spawn_process: at 2019-02-05 18:51:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 18:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 18:51:45 [DEBUG   ] spawn_process: at 2019-02-05 18:51:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 18:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 18:51:45 [DEBUG   ] spawn_process: at 2019-02-05 18:51:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 18:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 18:51:45 [DEBUG   ] spawn_process: at 2019-02-05 18:51:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 18:51:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 18:51:45 [DEBUG   ] spawn_process: at 2019-02-05 18:51:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 18:51:48 [DEBUG   ] Got command BAM from MCS: ref #1412158
2019-02-05 18:51:48 [INFO    ] Finished processing BAM request
2019-02-05 18:51:48 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 18:51:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412158   8 58519 67908025 A  ERROR'
2019-02-05 18:51:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-02-05 18:51:48 [DEBUG   ] spawn_process: at 2019-02-05 18:51:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-02-05 18:51:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-02-05 18:51:48 [DEBUG   ] spawn_process: at 2019-02-05 18:51:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-02-05 18:51:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-02-05 18:51:48 [DEBUG   ] spawn_process: at 2019-02-05 18:51:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-02-05 18:51:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-02-05 18:51:48 [DEBUG   ] spawn_process: at 2019-02-05 18:51:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-02-05 18:51:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-02-05 18:51:48 [DEBUG   ] spawn_process: at 2019-02-05 18:51:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-02-05 18:51:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-02-05 18:51:48 [DEBUG   ] spawn_process: at 2019-02-05 18:51:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-02-05 18:51:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-02-05 18:51:48 [DEBUG   ] spawn_process: at 2019-02-05 18:51:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-02-05 18:51:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-02-05 18:51:48 [DEBUG   ] spawn_process: at 2019-02-05 18:51:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-02-05 18:51:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-02-05 18:51:48 [DEBUG   ] spawn_process: at 2019-02-05 18:51:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-02-05 18:51:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-02-05 18:51:48 [DEBUG   ] spawn_process: at 2019-02-05 18:51:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-02-05 18:51:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-02-05 18:51:48 [DEBUG   ] spawn_process: at 2019-02-05 18:51:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-02-05 18:51:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-02-05 18:51:48 [DEBUG   ] spawn_process: at 2019-02-05 18:51:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-02-05 18:51:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-02-05 18:51:48 [DEBUG   ] spawn_process: at 2019-02-05 18:51:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-02-05 18:51:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-02-05 18:51:48 [DEBUG   ] spawn_process: at 2019-02-05 18:51:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-02-05 18:51:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-02-05 18:51:48 [DEBUG   ] spawn_process: at 2019-02-05 18:51:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-02-05 18:51:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-02-05 18:51:48 [DEBUG   ] spawn_process: at 2019-02-05 18:51:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-02-05 18:51:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-02-05 18:51:48 [DEBUG   ] spawn_process: at 2019-02-05 18:51:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-02-05 18:51:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-02-05 18:51:48 [DEBUG   ] spawn_process: at 2019-02-05 18:51:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-02-05 18:51:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-02-05 18:51:48 [DEBUG   ] spawn_process: at 2019-02-05 18:51:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-02-05 18:51:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-02-05 18:51:48 [DEBUG   ] spawn_process: at 2019-02-05 18:51:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-02-05 18:51:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-02-05 18:51:48 [DEBUG   ] spawn_process: at 2019-02-05 18:51:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-02-05 18:51:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-02-05 18:51:48 [DEBUG   ] spawn_process: at 2019-02-05 18:51:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-02-05 18:51:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-02-05 18:51:48 [DEBUG   ] spawn_process: at 2019-02-05 18:51:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-02-05 18:51:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-02-05 18:51:48 [DEBUG   ] spawn_process: at 2019-02-05 18:51:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-02-05 18:51:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-02-05 18:51:48 [DEBUG   ] spawn_process: at 2019-02-05 18:51:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-02-05 18:51:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-02-05 18:51:48 [DEBUG   ] spawn_process: at 2019-02-05 18:51:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-02-05 18:51:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 18:51:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:51:56 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2019-02-05 18:51:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-05 18:51:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:51:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:51:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:51:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:51:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:51:56 [DEBUG   ] Finished updating board flags in 1.026 seconds
2019-02-05 18:52:10 [DEBUG   ] Got command BAM from MCS: ref #1412159
2019-02-05 18:52:10 [INFO    ] Finished processing BAM request
2019-02-05 18:52:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 18:52:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412159   8 58519 67930033 A  ERROR'
2019-02-05 18:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 18:52:10 [DEBUG   ] spawn_process: at 2019-02-05 18:52:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 18:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 18:52:10 [DEBUG   ] spawn_process: at 2019-02-05 18:52:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 18:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 18:52:10 [DEBUG   ] spawn_process: at 2019-02-05 18:52:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 18:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 18:52:10 [DEBUG   ] spawn_process: at 2019-02-05 18:52:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 18:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 18:52:10 [DEBUG   ] spawn_process: at 2019-02-05 18:52:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 18:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 18:52:10 [DEBUG   ] spawn_process: at 2019-02-05 18:52:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 18:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 18:52:10 [DEBUG   ] spawn_process: at 2019-02-05 18:52:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 18:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 18:52:10 [DEBUG   ] spawn_process: at 2019-02-05 18:52:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 18:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 18:52:10 [DEBUG   ] spawn_process: at 2019-02-05 18:52:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 18:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 18:52:10 [DEBUG   ] spawn_process: at 2019-02-05 18:52:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 18:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 18:52:10 [DEBUG   ] spawn_process: at 2019-02-05 18:52:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 18:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 18:52:10 [DEBUG   ] spawn_process: at 2019-02-05 18:52:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 18:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 18:52:10 [DEBUG   ] spawn_process: at 2019-02-05 18:52:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 18:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 18:52:10 [DEBUG   ] spawn_process: at 2019-02-05 18:52:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 18:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 18:52:10 [DEBUG   ] spawn_process: at 2019-02-05 18:52:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 18:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 18:52:10 [DEBUG   ] spawn_process: at 2019-02-05 18:52:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 18:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 18:52:10 [DEBUG   ] spawn_process: at 2019-02-05 18:52:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 18:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 18:52:10 [DEBUG   ] spawn_process: at 2019-02-05 18:52:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 18:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 18:52:10 [DEBUG   ] spawn_process: at 2019-02-05 18:52:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 18:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 18:52:10 [DEBUG   ] spawn_process: at 2019-02-05 18:52:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 18:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 18:52:10 [DEBUG   ] spawn_process: at 2019-02-05 18:52:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 18:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 18:52:10 [DEBUG   ] spawn_process: at 2019-02-05 18:52:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 18:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 18:52:10 [DEBUG   ] spawn_process: at 2019-02-05 18:52:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 18:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 18:52:10 [DEBUG   ] spawn_process: at 2019-02-05 18:52:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 18:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 18:52:10 [DEBUG   ] spawn_process: at 2019-02-05 18:52:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 18:52:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 18:52:10 [DEBUG   ] spawn_process: at 2019-02-05 18:52:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 18:52:15 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-05 18:52:32 [DEBUG   ] Got command BAM from MCS: ref #1412160
2019-02-05 18:52:32 [INFO    ] Finished processing BAM request
2019-02-05 18:52:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 18:52:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412160   8 58519 67952029 A  ERROR'
2019-02-05 18:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-02-05 18:52:32 [DEBUG   ] spawn_process: at 2019-02-05 18:52:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-02-05 18:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-02-05 18:52:32 [DEBUG   ] spawn_process: at 2019-02-05 18:52:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-02-05 18:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-02-05 18:52:32 [DEBUG   ] spawn_process: at 2019-02-05 18:52:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-02-05 18:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-02-05 18:52:32 [DEBUG   ] spawn_process: at 2019-02-05 18:52:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-02-05 18:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-02-05 18:52:32 [DEBUG   ] spawn_process: at 2019-02-05 18:52:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-02-05 18:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-02-05 18:52:32 [DEBUG   ] spawn_process: at 2019-02-05 18:52:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-02-05 18:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-02-05 18:52:32 [DEBUG   ] spawn_process: at 2019-02-05 18:52:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-02-05 18:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-02-05 18:52:32 [DEBUG   ] spawn_process: at 2019-02-05 18:52:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-02-05 18:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-02-05 18:52:32 [DEBUG   ] spawn_process: at 2019-02-05 18:52:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-02-05 18:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-02-05 18:52:32 [DEBUG   ] spawn_process: at 2019-02-05 18:52:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-02-05 18:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-02-05 18:52:32 [DEBUG   ] spawn_process: at 2019-02-05 18:52:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-02-05 18:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-02-05 18:52:32 [DEBUG   ] spawn_process: at 2019-02-05 18:52:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-02-05 18:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-02-05 18:52:32 [DEBUG   ] spawn_process: at 2019-02-05 18:52:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-02-05 18:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-02-05 18:52:32 [DEBUG   ] spawn_process: at 2019-02-05 18:52:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-02-05 18:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-02-05 18:52:32 [DEBUG   ] spawn_process: at 2019-02-05 18:52:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-02-05 18:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-02-05 18:52:32 [DEBUG   ] spawn_process: at 2019-02-05 18:52:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-02-05 18:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-02-05 18:52:32 [DEBUG   ] spawn_process: at 2019-02-05 18:52:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-02-05 18:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-02-05 18:52:32 [DEBUG   ] spawn_process: at 2019-02-05 18:52:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-02-05 18:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-02-05 18:52:32 [DEBUG   ] spawn_process: at 2019-02-05 18:52:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-02-05 18:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-02-05 18:52:32 [DEBUG   ] spawn_process: at 2019-02-05 18:52:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-02-05 18:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-02-05 18:52:32 [DEBUG   ] spawn_process: at 2019-02-05 18:52:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-02-05 18:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-02-05 18:52:32 [DEBUG   ] spawn_process: at 2019-02-05 18:52:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-02-05 18:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-02-05 18:52:32 [DEBUG   ] spawn_process: at 2019-02-05 18:52:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-02-05 18:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-02-05 18:52:32 [DEBUG   ] spawn_process: at 2019-02-05 18:52:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-02-05 18:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-02-05 18:52:32 [DEBUG   ] spawn_process: at 2019-02-05 18:52:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-02-05 18:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-02-05 18:52:32 [DEBUG   ] spawn_process: at 2019-02-05 18:52:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-02-05 18:52:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 18:52:54 [DEBUG   ] Got command BAM from MCS: ref #1412161
2019-02-05 18:52:54 [INFO    ] Finished processing BAM request
2019-02-05 18:52:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 18:52:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412161   8 58519 67974033 A  ERROR'
2019-02-05 18:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 18:52:54 [DEBUG   ] spawn_process: at 2019-02-05 18:52:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 18:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 18:52:54 [DEBUG   ] spawn_process: at 2019-02-05 18:52:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 18:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 18:52:54 [DEBUG   ] spawn_process: at 2019-02-05 18:52:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 18:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 18:52:54 [DEBUG   ] spawn_process: at 2019-02-05 18:52:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 18:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 18:52:54 [DEBUG   ] spawn_process: at 2019-02-05 18:52:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 18:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 18:52:54 [DEBUG   ] spawn_process: at 2019-02-05 18:52:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 18:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 18:52:54 [DEBUG   ] spawn_process: at 2019-02-05 18:52:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 18:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 18:52:54 [DEBUG   ] spawn_process: at 2019-02-05 18:52:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 18:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 18:52:54 [DEBUG   ] spawn_process: at 2019-02-05 18:52:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 18:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 18:52:54 [DEBUG   ] spawn_process: at 2019-02-05 18:52:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 18:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 18:52:54 [DEBUG   ] spawn_process: at 2019-02-05 18:52:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 18:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 18:52:54 [DEBUG   ] spawn_process: at 2019-02-05 18:52:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 18:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 18:52:54 [DEBUG   ] spawn_process: at 2019-02-05 18:52:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 18:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 18:52:54 [DEBUG   ] spawn_process: at 2019-02-05 18:52:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 18:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 18:52:54 [DEBUG   ] spawn_process: at 2019-02-05 18:52:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 18:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 18:52:54 [DEBUG   ] spawn_process: at 2019-02-05 18:52:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 18:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 18:52:54 [DEBUG   ] spawn_process: at 2019-02-05 18:52:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 18:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 18:52:54 [DEBUG   ] spawn_process: at 2019-02-05 18:52:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 18:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 18:52:54 [DEBUG   ] spawn_process: at 2019-02-05 18:52:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 18:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 18:52:54 [DEBUG   ] spawn_process: at 2019-02-05 18:52:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 18:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 18:52:54 [DEBUG   ] spawn_process: at 2019-02-05 18:52:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 18:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 18:52:54 [DEBUG   ] spawn_process: at 2019-02-05 18:52:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 18:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 18:52:54 [DEBUG   ] spawn_process: at 2019-02-05 18:52:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 18:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 18:52:54 [DEBUG   ] spawn_process: at 2019-02-05 18:52:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 18:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 18:52:54 [DEBUG   ] spawn_process: at 2019-02-05 18:52:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 18:52:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 18:52:54 [DEBUG   ] spawn_process: at 2019-02-05 18:52:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 18:52:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 18:52:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:52:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 18:52:56 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-02-05 18:52:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:52:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:52:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:52:56 [WARNING ] (13, 1, 'bot')
2019-02-05 18:52:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:52:56 [DEBUG   ] Finished updating board flags in 0.987 seconds
2019-02-05 18:53:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 18:53:17 [DEBUG   ] Got command BAM from MCS: ref #1412166
2019-02-05 18:53:17 [INFO    ] Finished processing BAM request
2019-02-05 18:53:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 18:53:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412166   8 58519 67997025 A  ERROR'
2019-02-05 18:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 18:53:17 [DEBUG   ] spawn_process: at 2019-02-05 18:53:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 18:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 18:53:17 [DEBUG   ] spawn_process: at 2019-02-05 18:53:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 18:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 18:53:17 [DEBUG   ] spawn_process: at 2019-02-05 18:53:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 18:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 18:53:17 [DEBUG   ] spawn_process: at 2019-02-05 18:53:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 18:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 18:53:17 [DEBUG   ] spawn_process: at 2019-02-05 18:53:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 18:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 18:53:17 [DEBUG   ] spawn_process: at 2019-02-05 18:53:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 18:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 18:53:17 [DEBUG   ] spawn_process: at 2019-02-05 18:53:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 18:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 18:53:17 [DEBUG   ] spawn_process: at 2019-02-05 18:53:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 18:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 18:53:17 [DEBUG   ] spawn_process: at 2019-02-05 18:53:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 18:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 18:53:17 [DEBUG   ] spawn_process: at 2019-02-05 18:53:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 18:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 18:53:17 [DEBUG   ] spawn_process: at 2019-02-05 18:53:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 18:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 18:53:17 [DEBUG   ] spawn_process: at 2019-02-05 18:53:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 18:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 18:53:17 [DEBUG   ] spawn_process: at 2019-02-05 18:53:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 18:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 18:53:17 [DEBUG   ] spawn_process: at 2019-02-05 18:53:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 18:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 18:53:17 [DEBUG   ] spawn_process: at 2019-02-05 18:53:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 18:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 18:53:17 [DEBUG   ] spawn_process: at 2019-02-05 18:53:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 18:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 18:53:17 [DEBUG   ] spawn_process: at 2019-02-05 18:53:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 18:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 18:53:17 [DEBUG   ] spawn_process: at 2019-02-05 18:53:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 18:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 18:53:17 [DEBUG   ] spawn_process: at 2019-02-05 18:53:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 18:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 18:53:17 [DEBUG   ] spawn_process: at 2019-02-05 18:53:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 18:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 18:53:17 [DEBUG   ] spawn_process: at 2019-02-05 18:53:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 18:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 18:53:17 [DEBUG   ] spawn_process: at 2019-02-05 18:53:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 18:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 18:53:17 [DEBUG   ] spawn_process: at 2019-02-05 18:53:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 18:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 18:53:17 [DEBUG   ] spawn_process: at 2019-02-05 18:53:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 18:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 18:53:17 [DEBUG   ] spawn_process: at 2019-02-05 18:53:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 18:53:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 18:53:17 [DEBUG   ] spawn_process: at 2019-02-05 18:53:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 18:53:28 [DEBUG   ] Got command BAM from MCS: ref #1412167
2019-02-05 18:53:28 [INFO    ] Finished processing BAM request
2019-02-05 18:53:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 18:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412167   8 58519 68008033 A  ERROR'
2019-02-05 18:53:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 18:53:28 [DEBUG   ] spawn_process: at 2019-02-05 18:53:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 18:53:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 18:53:28 [DEBUG   ] spawn_process: at 2019-02-05 18:53:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 18:53:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 18:53:28 [DEBUG   ] spawn_process: at 2019-02-05 18:53:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 18:53:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 18:53:28 [DEBUG   ] spawn_process: at 2019-02-05 18:53:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 18:53:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 18:53:28 [DEBUG   ] spawn_process: at 2019-02-05 18:53:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 18:53:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 18:53:28 [DEBUG   ] spawn_process: at 2019-02-05 18:53:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 18:53:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 18:53:28 [DEBUG   ] spawn_process: at 2019-02-05 18:53:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 18:53:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 18:53:28 [DEBUG   ] spawn_process: at 2019-02-05 18:53:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 18:53:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 18:53:28 [DEBUG   ] spawn_process: at 2019-02-05 18:53:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 18:53:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 18:53:28 [DEBUG   ] spawn_process: at 2019-02-05 18:53:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 18:53:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 18:53:28 [DEBUG   ] spawn_process: at 2019-02-05 18:53:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 18:53:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 18:53:28 [DEBUG   ] spawn_process: at 2019-02-05 18:53:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 18:53:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 18:53:28 [DEBUG   ] spawn_process: at 2019-02-05 18:53:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 18:53:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 18:53:28 [DEBUG   ] spawn_process: at 2019-02-05 18:53:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 18:53:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 18:53:28 [DEBUG   ] spawn_process: at 2019-02-05 18:53:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 18:53:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 18:53:28 [DEBUG   ] spawn_process: at 2019-02-05 18:53:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 18:53:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 18:53:28 [DEBUG   ] spawn_process: at 2019-02-05 18:53:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 18:53:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 18:53:28 [DEBUG   ] spawn_process: at 2019-02-05 18:53:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 18:53:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 18:53:28 [DEBUG   ] spawn_process: at 2019-02-05 18:53:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 18:53:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 18:53:28 [DEBUG   ] spawn_process: at 2019-02-05 18:53:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 18:53:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 18:53:28 [DEBUG   ] spawn_process: at 2019-02-05 18:53:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 18:53:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 18:53:28 [DEBUG   ] spawn_process: at 2019-02-05 18:53:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 18:53:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 18:53:28 [DEBUG   ] spawn_process: at 2019-02-05 18:53:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 18:53:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 18:53:28 [DEBUG   ] spawn_process: at 2019-02-05 18:53:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 18:53:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 18:53:28 [DEBUG   ] spawn_process: at 2019-02-05 18:53:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 18:53:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 18:53:28 [DEBUG   ] spawn_process: at 2019-02-05 18:53:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 18:53:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 18:53:40 [DEBUG   ] Got command BAM from MCS: ref #1412168
2019-02-05 18:53:40 [INFO    ] Finished processing BAM request
2019-02-05 18:53:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 18:53:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412168   8 58519 68020029 A  ERROR'
2019-02-05 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-02-05 18:53:40 [DEBUG   ] spawn_process: at 2019-02-05 18:53:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-02-05 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-02-05 18:53:40 [DEBUG   ] spawn_process: at 2019-02-05 18:53:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-02-05 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-02-05 18:53:40 [DEBUG   ] spawn_process: at 2019-02-05 18:53:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-02-05 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-02-05 18:53:40 [DEBUG   ] spawn_process: at 2019-02-05 18:53:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-02-05 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-02-05 18:53:40 [DEBUG   ] spawn_process: at 2019-02-05 18:53:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-02-05 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-02-05 18:53:40 [DEBUG   ] spawn_process: at 2019-02-05 18:53:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-02-05 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-02-05 18:53:40 [DEBUG   ] spawn_process: at 2019-02-05 18:53:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-02-05 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-02-05 18:53:40 [DEBUG   ] spawn_process: at 2019-02-05 18:53:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-02-05 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-02-05 18:53:40 [DEBUG   ] spawn_process: at 2019-02-05 18:53:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-02-05 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-02-05 18:53:40 [DEBUG   ] spawn_process: at 2019-02-05 18:53:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-02-05 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-02-05 18:53:40 [DEBUG   ] spawn_process: at 2019-02-05 18:53:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-02-05 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-02-05 18:53:40 [DEBUG   ] spawn_process: at 2019-02-05 18:53:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-02-05 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-02-05 18:53:40 [DEBUG   ] spawn_process: at 2019-02-05 18:53:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-02-05 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-02-05 18:53:40 [DEBUG   ] spawn_process: at 2019-02-05 18:53:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-02-05 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-02-05 18:53:40 [DEBUG   ] spawn_process: at 2019-02-05 18:53:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-02-05 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-02-05 18:53:40 [DEBUG   ] spawn_process: at 2019-02-05 18:53:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-02-05 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-02-05 18:53:40 [DEBUG   ] spawn_process: at 2019-02-05 18:53:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-02-05 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-02-05 18:53:40 [DEBUG   ] spawn_process: at 2019-02-05 18:53:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-02-05 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-02-05 18:53:40 [DEBUG   ] spawn_process: at 2019-02-05 18:53:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-02-05 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-02-05 18:53:40 [DEBUG   ] spawn_process: at 2019-02-05 18:53:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-02-05 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-02-05 18:53:40 [DEBUG   ] spawn_process: at 2019-02-05 18:53:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-02-05 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-02-05 18:53:40 [DEBUG   ] spawn_process: at 2019-02-05 18:53:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-02-05 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-02-05 18:53:40 [DEBUG   ] spawn_process: at 2019-02-05 18:53:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-02-05 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-02-05 18:53:40 [DEBUG   ] spawn_process: at 2019-02-05 18:53:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-02-05 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-02-05 18:53:40 [DEBUG   ] spawn_process: at 2019-02-05 18:53:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-02-05 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-02-05 18:53:40 [DEBUG   ] spawn_process: at 2019-02-05 18:53:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-02-05 18:53:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 18:53:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:53:57 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-02-05 18:53:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-02-05 18:53:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:53:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:53:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:53:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:53:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:53:57 [DEBUG   ] Finished updating board flags in 1.397 seconds
2019-02-05 18:54:03 [DEBUG   ] Got command BAM from MCS: ref #1412169
2019-02-05 18:54:03 [INFO    ] Finished processing BAM request
2019-02-05 18:54:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 18:54:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412169   8 58519 68043025 A  ERROR'
2019-02-05 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-02-05 18:54:03 [DEBUG   ] spawn_process: at 2019-02-05 18:54:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-02-05 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-02-05 18:54:03 [DEBUG   ] spawn_process: at 2019-02-05 18:54:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-02-05 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-02-05 18:54:03 [DEBUG   ] spawn_process: at 2019-02-05 18:54:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-02-05 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-02-05 18:54:03 [DEBUG   ] spawn_process: at 2019-02-05 18:54:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-02-05 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-02-05 18:54:03 [DEBUG   ] spawn_process: at 2019-02-05 18:54:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-02-05 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-02-05 18:54:03 [DEBUG   ] spawn_process: at 2019-02-05 18:54:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-02-05 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-02-05 18:54:03 [DEBUG   ] spawn_process: at 2019-02-05 18:54:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-02-05 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-02-05 18:54:03 [DEBUG   ] spawn_process: at 2019-02-05 18:54:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-02-05 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-02-05 18:54:03 [DEBUG   ] spawn_process: at 2019-02-05 18:54:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-02-05 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-02-05 18:54:03 [DEBUG   ] spawn_process: at 2019-02-05 18:54:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-02-05 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-02-05 18:54:03 [DEBUG   ] spawn_process: at 2019-02-05 18:54:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-02-05 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-02-05 18:54:03 [DEBUG   ] spawn_process: at 2019-02-05 18:54:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-02-05 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-02-05 18:54:03 [DEBUG   ] spawn_process: at 2019-02-05 18:54:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-02-05 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-02-05 18:54:03 [DEBUG   ] spawn_process: at 2019-02-05 18:54:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-02-05 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-02-05 18:54:03 [DEBUG   ] spawn_process: at 2019-02-05 18:54:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-02-05 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-02-05 18:54:03 [DEBUG   ] spawn_process: at 2019-02-05 18:54:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-02-05 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-02-05 18:54:03 [DEBUG   ] spawn_process: at 2019-02-05 18:54:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-02-05 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-02-05 18:54:03 [DEBUG   ] spawn_process: at 2019-02-05 18:54:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-02-05 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-02-05 18:54:03 [DEBUG   ] spawn_process: at 2019-02-05 18:54:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-02-05 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-02-05 18:54:03 [DEBUG   ] spawn_process: at 2019-02-05 18:54:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-02-05 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-02-05 18:54:03 [DEBUG   ] spawn_process: at 2019-02-05 18:54:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-02-05 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-02-05 18:54:03 [DEBUG   ] spawn_process: at 2019-02-05 18:54:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-02-05 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-02-05 18:54:03 [DEBUG   ] spawn_process: at 2019-02-05 18:54:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-02-05 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-02-05 18:54:03 [DEBUG   ] spawn_process: at 2019-02-05 18:54:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-02-05 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-02-05 18:54:03 [DEBUG   ] spawn_process: at 2019-02-05 18:54:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-02-05 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-02-05 18:54:03 [DEBUG   ] spawn_process: at 2019-02-05 18:54:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-02-05 18:54:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 18:54:27 [DEBUG   ] Got command BAM from MCS: ref #1412172
2019-02-05 18:54:27 [INFO    ] Finished processing BAM request
2019-02-05 18:54:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 18:54:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412172   8 58519 68067029 A  ERROR'
2019-02-05 18:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 18:54:27 [DEBUG   ] spawn_process: at 2019-02-05 18:54:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 18:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 18:54:27 [DEBUG   ] spawn_process: at 2019-02-05 18:54:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 18:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 18:54:27 [DEBUG   ] spawn_process: at 2019-02-05 18:54:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 18:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 18:54:27 [DEBUG   ] spawn_process: at 2019-02-05 18:54:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 18:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 18:54:27 [DEBUG   ] spawn_process: at 2019-02-05 18:54:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 18:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 18:54:27 [DEBUG   ] spawn_process: at 2019-02-05 18:54:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 18:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 18:54:27 [DEBUG   ] spawn_process: at 2019-02-05 18:54:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 18:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 18:54:27 [DEBUG   ] spawn_process: at 2019-02-05 18:54:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 18:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 18:54:27 [DEBUG   ] spawn_process: at 2019-02-05 18:54:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 18:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 18:54:27 [DEBUG   ] spawn_process: at 2019-02-05 18:54:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 18:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 18:54:27 [DEBUG   ] spawn_process: at 2019-02-05 18:54:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 18:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 18:54:27 [DEBUG   ] spawn_process: at 2019-02-05 18:54:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 18:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 18:54:27 [DEBUG   ] spawn_process: at 2019-02-05 18:54:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 18:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 18:54:27 [DEBUG   ] spawn_process: at 2019-02-05 18:54:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 18:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 18:54:27 [DEBUG   ] spawn_process: at 2019-02-05 18:54:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 18:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 18:54:27 [DEBUG   ] spawn_process: at 2019-02-05 18:54:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 18:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 18:54:27 [DEBUG   ] spawn_process: at 2019-02-05 18:54:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 18:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 18:54:27 [DEBUG   ] spawn_process: at 2019-02-05 18:54:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 18:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 18:54:27 [DEBUG   ] spawn_process: at 2019-02-05 18:54:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 18:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 18:54:27 [DEBUG   ] spawn_process: at 2019-02-05 18:54:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 18:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 18:54:27 [DEBUG   ] spawn_process: at 2019-02-05 18:54:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 18:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 18:54:27 [DEBUG   ] spawn_process: at 2019-02-05 18:54:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 18:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 18:54:27 [DEBUG   ] spawn_process: at 2019-02-05 18:54:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 18:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 18:54:27 [DEBUG   ] spawn_process: at 2019-02-05 18:54:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 18:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 18:54:27 [DEBUG   ] spawn_process: at 2019-02-05 18:54:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 18:54:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 18:54:27 [DEBUG   ] spawn_process: at 2019-02-05 18:54:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 18:54:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 18:54:51 [DEBUG   ] Got command BAM from MCS: ref #1412173
2019-02-05 18:54:51 [INFO    ] Finished processing BAM request
2019-02-05 18:54:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 18:54:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412173   8 58519 68091033 A  ERROR'
2019-02-05 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 18:54:51 [DEBUG   ] spawn_process: at 2019-02-05 18:54:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 18:54:51 [DEBUG   ] spawn_process: at 2019-02-05 18:54:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 18:54:51 [DEBUG   ] spawn_process: at 2019-02-05 18:54:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 18:54:51 [DEBUG   ] spawn_process: at 2019-02-05 18:54:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 18:54:51 [DEBUG   ] spawn_process: at 2019-02-05 18:54:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 18:54:51 [DEBUG   ] spawn_process: at 2019-02-05 18:54:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 18:54:51 [DEBUG   ] spawn_process: at 2019-02-05 18:54:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 18:54:51 [DEBUG   ] spawn_process: at 2019-02-05 18:54:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 18:54:51 [DEBUG   ] spawn_process: at 2019-02-05 18:54:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 18:54:51 [DEBUG   ] spawn_process: at 2019-02-05 18:54:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 18:54:51 [DEBUG   ] spawn_process: at 2019-02-05 18:54:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 18:54:51 [DEBUG   ] spawn_process: at 2019-02-05 18:54:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 18:54:51 [DEBUG   ] spawn_process: at 2019-02-05 18:54:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 18:54:51 [DEBUG   ] spawn_process: at 2019-02-05 18:54:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 18:54:51 [DEBUG   ] spawn_process: at 2019-02-05 18:54:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 18:54:51 [DEBUG   ] spawn_process: at 2019-02-05 18:54:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 18:54:51 [DEBUG   ] spawn_process: at 2019-02-05 18:54:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 18:54:51 [DEBUG   ] spawn_process: at 2019-02-05 18:54:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 18:54:51 [DEBUG   ] spawn_process: at 2019-02-05 18:54:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 18:54:51 [DEBUG   ] spawn_process: at 2019-02-05 18:54:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 18:54:51 [DEBUG   ] spawn_process: at 2019-02-05 18:54:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 18:54:51 [DEBUG   ] spawn_process: at 2019-02-05 18:54:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 18:54:51 [DEBUG   ] spawn_process: at 2019-02-05 18:54:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 18:54:51 [DEBUG   ] spawn_process: at 2019-02-05 18:54:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 18:54:51 [DEBUG   ] spawn_process: at 2019-02-05 18:54:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 18:54:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 18:54:51 [DEBUG   ] spawn_process: at 2019-02-05 18:54:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 18:54:55 [DEBUG   ] Got command RPT from MCS: ref #1412174
2019-02-05 18:54:55 [DEBUG   ] summary = ERROR
2019-02-05 18:54:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412174  13 58519 68095197 A  ERRORERROR'
2019-02-05 18:54:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 18:54:55 [DEBUG   ] Got command RPT from MCS: ref #1412175
2019-02-05 18:54:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 18:54:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412175  77 58519 68095389 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 18:54:55 [DEBUG   ] Got command RPT from MCS: ref #1412176
2019-02-05 18:54:55 [DEBUG   ] summary = ERROR
2019-02-05 18:54:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412176  13 58519 68095593 A  ERRORERROR'
2019-02-05 18:54:55 [DEBUG   ] Got command RPT from MCS: ref #1412178
2019-02-05 18:54:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 18:54:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412178  77 58519 68095797 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 18:54:56 [DEBUG   ] Got command RPT from MCS: ref #1412179
2019-02-05 18:54:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 18:54:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412179  12 58519 68096001 A  ERRORB¢ff'
2019-02-05 18:54:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-02-05 18:54:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2019-02-05 18:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:54:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-02-05 18:54:57 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-02-05 18:54:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-05 18:54:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:54:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:54:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:54:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:54:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:54:57 [DEBUG   ] Finished updating board flags in 1.214 seconds
2019-02-05 18:55:12 [DEBUG   ] Got command BAM from MCS: ref #1412184
2019-02-05 18:55:12 [INFO    ] Finished processing BAM request
2019-02-05 18:55:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 18:55:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412184   8 58519 68112025 A  ERROR'
2019-02-05 18:55:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 18:55:12 [DEBUG   ] spawn_process: at 2019-02-05 18:55:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 18:55:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 18:55:12 [DEBUG   ] spawn_process: at 2019-02-05 18:55:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 18:55:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 18:55:12 [DEBUG   ] spawn_process: at 2019-02-05 18:55:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 18:55:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 18:55:12 [DEBUG   ] spawn_process: at 2019-02-05 18:55:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 18:55:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 18:55:12 [DEBUG   ] spawn_process: at 2019-02-05 18:55:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 18:55:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 18:55:12 [DEBUG   ] spawn_process: at 2019-02-05 18:55:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 18:55:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 18:55:12 [DEBUG   ] spawn_process: at 2019-02-05 18:55:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 18:55:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 18:55:12 [DEBUG   ] spawn_process: at 2019-02-05 18:55:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 18:55:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 18:55:12 [DEBUG   ] spawn_process: at 2019-02-05 18:55:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 18:55:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 18:55:12 [DEBUG   ] spawn_process: at 2019-02-05 18:55:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 18:55:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 18:55:12 [DEBUG   ] spawn_process: at 2019-02-05 18:55:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 18:55:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 18:55:12 [DEBUG   ] spawn_process: at 2019-02-05 18:55:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 18:55:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 18:55:12 [DEBUG   ] spawn_process: at 2019-02-05 18:55:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 18:55:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 18:55:12 [DEBUG   ] spawn_process: at 2019-02-05 18:55:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 18:55:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 18:55:12 [DEBUG   ] spawn_process: at 2019-02-05 18:55:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 18:55:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 18:55:12 [DEBUG   ] spawn_process: at 2019-02-05 18:55:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 18:55:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 18:55:12 [DEBUG   ] spawn_process: at 2019-02-05 18:55:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 18:55:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 18:55:12 [DEBUG   ] spawn_process: at 2019-02-05 18:55:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 18:55:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 18:55:12 [DEBUG   ] spawn_process: at 2019-02-05 18:55:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 18:55:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 18:55:12 [DEBUG   ] spawn_process: at 2019-02-05 18:55:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 18:55:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 18:55:12 [DEBUG   ] spawn_process: at 2019-02-05 18:55:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 18:55:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 18:55:12 [DEBUG   ] spawn_process: at 2019-02-05 18:55:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 18:55:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 18:55:12 [DEBUG   ] spawn_process: at 2019-02-05 18:55:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 18:55:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 18:55:12 [DEBUG   ] spawn_process: at 2019-02-05 18:55:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 18:55:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 18:55:12 [DEBUG   ] spawn_process: at 2019-02-05 18:55:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 18:55:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 18:55:12 [DEBUG   ] spawn_process: at 2019-02-05 18:55:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 18:55:15 [DEBUG   ] Got command BAM from MCS: ref #1412185
2019-02-05 18:55:15 [INFO    ] Finished processing BAM request
2019-02-05 18:55:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 18:55:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412185   8 58519 68115029 A  ERROR'
2019-02-05 18:55:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 18:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-02-05 18:55:15 [DEBUG   ] spawn_process: at 2019-02-05 18:55:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-02-05 18:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-02-05 18:55:15 [DEBUG   ] spawn_process: at 2019-02-05 18:55:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-02-05 18:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-02-05 18:55:15 [DEBUG   ] spawn_process: at 2019-02-05 18:55:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-02-05 18:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-02-05 18:55:15 [DEBUG   ] spawn_process: at 2019-02-05 18:55:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-02-05 18:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-02-05 18:55:15 [DEBUG   ] spawn_process: at 2019-02-05 18:55:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-02-05 18:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-02-05 18:55:15 [DEBUG   ] spawn_process: at 2019-02-05 18:55:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-02-05 18:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-02-05 18:55:15 [DEBUG   ] spawn_process: at 2019-02-05 18:55:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-02-05 18:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-02-05 18:55:15 [DEBUG   ] spawn_process: at 2019-02-05 18:55:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-02-05 18:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-02-05 18:55:15 [DEBUG   ] spawn_process: at 2019-02-05 18:55:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-02-05 18:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-02-05 18:55:15 [DEBUG   ] spawn_process: at 2019-02-05 18:55:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-02-05 18:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-02-05 18:55:15 [DEBUG   ] spawn_process: at 2019-02-05 18:55:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-02-05 18:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-02-05 18:55:15 [DEBUG   ] spawn_process: at 2019-02-05 18:55:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-02-05 18:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-02-05 18:55:15 [DEBUG   ] spawn_process: at 2019-02-05 18:55:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-02-05 18:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-02-05 18:55:15 [DEBUG   ] spawn_process: at 2019-02-05 18:55:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-02-05 18:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-02-05 18:55:15 [DEBUG   ] spawn_process: at 2019-02-05 18:55:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-02-05 18:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-02-05 18:55:15 [DEBUG   ] spawn_process: at 2019-02-05 18:55:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-02-05 18:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-02-05 18:55:15 [DEBUG   ] spawn_process: at 2019-02-05 18:55:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-02-05 18:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-02-05 18:55:15 [DEBUG   ] spawn_process: at 2019-02-05 18:55:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-02-05 18:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-02-05 18:55:15 [DEBUG   ] spawn_process: at 2019-02-05 18:55:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-02-05 18:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-02-05 18:55:15 [DEBUG   ] spawn_process: at 2019-02-05 18:55:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-02-05 18:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-02-05 18:55:15 [DEBUG   ] spawn_process: at 2019-02-05 18:55:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-02-05 18:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-02-05 18:55:15 [DEBUG   ] spawn_process: at 2019-02-05 18:55:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-02-05 18:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-02-05 18:55:15 [DEBUG   ] spawn_process: at 2019-02-05 18:55:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-02-05 18:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-02-05 18:55:15 [DEBUG   ] spawn_process: at 2019-02-05 18:55:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-02-05 18:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-02-05 18:55:15 [DEBUG   ] spawn_process: at 2019-02-05 18:55:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-02-05 18:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-02-05 18:55:15 [DEBUG   ] spawn_process: at 2019-02-05 18:55:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-02-05 18:55:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 18:55:40 [DEBUG   ] Got command BAM from MCS: ref #1412186
2019-02-05 18:55:40 [INFO    ] Finished processing BAM request
2019-02-05 18:55:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 18:55:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412186   8 58519 68140029 A  ERROR'
2019-02-05 18:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-02-05 18:55:40 [DEBUG   ] spawn_process: at 2019-02-05 18:55:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-02-05 18:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-02-05 18:55:40 [DEBUG   ] spawn_process: at 2019-02-05 18:55:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-02-05 18:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-02-05 18:55:40 [DEBUG   ] spawn_process: at 2019-02-05 18:55:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-02-05 18:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-02-05 18:55:40 [DEBUG   ] spawn_process: at 2019-02-05 18:55:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-02-05 18:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-02-05 18:55:40 [DEBUG   ] spawn_process: at 2019-02-05 18:55:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-02-05 18:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-02-05 18:55:40 [DEBUG   ] spawn_process: at 2019-02-05 18:55:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-02-05 18:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-02-05 18:55:40 [DEBUG   ] spawn_process: at 2019-02-05 18:55:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-02-05 18:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-02-05 18:55:40 [DEBUG   ] spawn_process: at 2019-02-05 18:55:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-02-05 18:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-02-05 18:55:40 [DEBUG   ] spawn_process: at 2019-02-05 18:55:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-02-05 18:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-02-05 18:55:40 [DEBUG   ] spawn_process: at 2019-02-05 18:55:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-02-05 18:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-02-05 18:55:40 [DEBUG   ] spawn_process: at 2019-02-05 18:55:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-02-05 18:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-02-05 18:55:40 [DEBUG   ] spawn_process: at 2019-02-05 18:55:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-02-05 18:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-02-05 18:55:40 [DEBUG   ] spawn_process: at 2019-02-05 18:55:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-02-05 18:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-02-05 18:55:40 [DEBUG   ] spawn_process: at 2019-02-05 18:55:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-02-05 18:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-02-05 18:55:40 [DEBUG   ] spawn_process: at 2019-02-05 18:55:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-02-05 18:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-02-05 18:55:40 [DEBUG   ] spawn_process: at 2019-02-05 18:55:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-02-05 18:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-02-05 18:55:40 [DEBUG   ] spawn_process: at 2019-02-05 18:55:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-02-05 18:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-02-05 18:55:40 [DEBUG   ] spawn_process: at 2019-02-05 18:55:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-02-05 18:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-02-05 18:55:40 [DEBUG   ] spawn_process: at 2019-02-05 18:55:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-02-05 18:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-02-05 18:55:40 [DEBUG   ] spawn_process: at 2019-02-05 18:55:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-02-05 18:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-02-05 18:55:40 [DEBUG   ] spawn_process: at 2019-02-05 18:55:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-02-05 18:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-02-05 18:55:40 [DEBUG   ] spawn_process: at 2019-02-05 18:55:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-02-05 18:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-02-05 18:55:40 [DEBUG   ] spawn_process: at 2019-02-05 18:55:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-02-05 18:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-02-05 18:55:40 [DEBUG   ] spawn_process: at 2019-02-05 18:55:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-02-05 18:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-02-05 18:55:40 [DEBUG   ] spawn_process: at 2019-02-05 18:55:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-02-05 18:55:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-02-05 18:55:40 [DEBUG   ] spawn_process: at 2019-02-05 18:55:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-02-05 18:55:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 18:55:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2019-02-05 18:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:55:57 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-02-05 18:55:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:55:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:55:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:55:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:55:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:55:57 [DEBUG   ] Finished updating board flags in 1.153 seconds
2019-02-05 18:56:05 [DEBUG   ] Got command BAM from MCS: ref #1412187
2019-02-05 18:56:05 [INFO    ] Finished processing BAM request
2019-02-05 18:56:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 18:56:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412187   8 58519 68165029 A  ERROR'
2019-02-05 18:56:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 18:56:05 [DEBUG   ] spawn_process: at 2019-02-05 18:56:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 18:56:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 18:56:05 [DEBUG   ] spawn_process: at 2019-02-05 18:56:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 18:56:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 18:56:05 [DEBUG   ] spawn_process: at 2019-02-05 18:56:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 18:56:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 18:56:05 [DEBUG   ] spawn_process: at 2019-02-05 18:56:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 18:56:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 18:56:05 [DEBUG   ] spawn_process: at 2019-02-05 18:56:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 18:56:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 18:56:05 [DEBUG   ] spawn_process: at 2019-02-05 18:56:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 18:56:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 18:56:05 [DEBUG   ] spawn_process: at 2019-02-05 18:56:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 18:56:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 18:56:05 [DEBUG   ] spawn_process: at 2019-02-05 18:56:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 18:56:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 18:56:05 [DEBUG   ] spawn_process: at 2019-02-05 18:56:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 18:56:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 18:56:05 [DEBUG   ] spawn_process: at 2019-02-05 18:56:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 18:56:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 18:56:05 [DEBUG   ] spawn_process: at 2019-02-05 18:56:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 18:56:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 18:56:05 [DEBUG   ] spawn_process: at 2019-02-05 18:56:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 18:56:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 18:56:05 [DEBUG   ] spawn_process: at 2019-02-05 18:56:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 18:56:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 18:56:05 [DEBUG   ] spawn_process: at 2019-02-05 18:56:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 18:56:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 18:56:05 [DEBUG   ] spawn_process: at 2019-02-05 18:56:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 18:56:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 18:56:05 [DEBUG   ] spawn_process: at 2019-02-05 18:56:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 18:56:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 18:56:05 [DEBUG   ] spawn_process: at 2019-02-05 18:56:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 18:56:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 18:56:05 [DEBUG   ] spawn_process: at 2019-02-05 18:56:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 18:56:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 18:56:05 [DEBUG   ] spawn_process: at 2019-02-05 18:56:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 18:56:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 18:56:05 [DEBUG   ] spawn_process: at 2019-02-05 18:56:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 18:56:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 18:56:05 [DEBUG   ] spawn_process: at 2019-02-05 18:56:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 18:56:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 18:56:05 [DEBUG   ] spawn_process: at 2019-02-05 18:56:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 18:56:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 18:56:05 [DEBUG   ] spawn_process: at 2019-02-05 18:56:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 18:56:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 18:56:05 [DEBUG   ] spawn_process: at 2019-02-05 18:56:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 18:56:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 18:56:05 [DEBUG   ] spawn_process: at 2019-02-05 18:56:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 18:56:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 18:56:05 [DEBUG   ] spawn_process: at 2019-02-05 18:56:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 18:56:12 [DEBUG   ] Got command RPT from MCS: ref #1412188
2019-02-05 18:56:12 [DEBUG   ] summary = ERROR
2019-02-05 18:56:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412188  13 58519 68172001 A  ERRORERROR'
2019-02-05 18:56:12 [DEBUG   ] Got command RPT from MCS: ref #1412189
2019-02-05 18:56:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 18:56:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412189  77 58519 68172002 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 18:56:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 18:56:30 [DEBUG   ] Got command BAM from MCS: ref #1412209
2019-02-05 18:56:30 [INFO    ] Finished processing BAM request
2019-02-05 18:56:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 18:56:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412209   8 58519 68190025 A  ERROR'
2019-02-05 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 18:56:30 [DEBUG   ] spawn_process: at 2019-02-05 18:56:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 18:56:30 [DEBUG   ] spawn_process: at 2019-02-05 18:56:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 18:56:30 [DEBUG   ] spawn_process: at 2019-02-05 18:56:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 18:56:30 [DEBUG   ] spawn_process: at 2019-02-05 18:56:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 18:56:30 [DEBUG   ] spawn_process: at 2019-02-05 18:56:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 18:56:30 [DEBUG   ] spawn_process: at 2019-02-05 18:56:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 18:56:30 [DEBUG   ] spawn_process: at 2019-02-05 18:56:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 18:56:30 [DEBUG   ] spawn_process: at 2019-02-05 18:56:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 18:56:30 [DEBUG   ] spawn_process: at 2019-02-05 18:56:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 18:56:30 [DEBUG   ] spawn_process: at 2019-02-05 18:56:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 18:56:30 [DEBUG   ] spawn_process: at 2019-02-05 18:56:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 18:56:30 [DEBUG   ] spawn_process: at 2019-02-05 18:56:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 18:56:30 [DEBUG   ] spawn_process: at 2019-02-05 18:56:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 18:56:30 [DEBUG   ] spawn_process: at 2019-02-05 18:56:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 18:56:30 [DEBUG   ] spawn_process: at 2019-02-05 18:56:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 18:56:30 [DEBUG   ] spawn_process: at 2019-02-05 18:56:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 18:56:30 [DEBUG   ] spawn_process: at 2019-02-05 18:56:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 18:56:30 [DEBUG   ] spawn_process: at 2019-02-05 18:56:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 18:56:30 [DEBUG   ] spawn_process: at 2019-02-05 18:56:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 18:56:30 [DEBUG   ] spawn_process: at 2019-02-05 18:56:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 18:56:30 [DEBUG   ] spawn_process: at 2019-02-05 18:56:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 18:56:30 [DEBUG   ] spawn_process: at 2019-02-05 18:56:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 18:56:30 [DEBUG   ] spawn_process: at 2019-02-05 18:56:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 18:56:30 [DEBUG   ] spawn_process: at 2019-02-05 18:56:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 18:56:30 [DEBUG   ] spawn_process: at 2019-02-05 18:56:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 18:56:30 [DEBUG   ] spawn_process: at 2019-02-05 18:56:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 18:56:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 18:56:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 18:56:56 [DEBUG   ] Got command BAM from MCS: ref #1412210
2019-02-05 18:56:56 [INFO    ] Finished processing BAM request
2019-02-05 18:56:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 18:56:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412210   8 58519 68216025 A  ERROR'
2019-02-05 18:56:56 [DEBUG   ] Got command BAM from MCS: ref #1412211
2019-02-05 18:56:56 [INFO    ] Finished processing BAM request
2019-02-05 18:56:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 18:56:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412211   8 58519 68216029 A  ERROR'
2019-02-05 18:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 18:56:56 [DEBUG   ] spawn_process: at 2019-02-05 18:56:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 18:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 18:56:56 [DEBUG   ] spawn_process: at 2019-02-05 18:56:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 18:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 18:56:56 [DEBUG   ] spawn_process: at 2019-02-05 18:56:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 18:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 18:56:56 [DEBUG   ] spawn_process: at 2019-02-05 18:56:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 18:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 18:56:56 [DEBUG   ] spawn_process: at 2019-02-05 18:56:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 18:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 18:56:56 [DEBUG   ] spawn_process: at 2019-02-05 18:56:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 18:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 18:56:56 [DEBUG   ] spawn_process: at 2019-02-05 18:56:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 18:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 18:56:56 [DEBUG   ] spawn_process: at 2019-02-05 18:56:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 18:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 18:56:56 [DEBUG   ] spawn_process: at 2019-02-05 18:56:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 18:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 18:56:56 [DEBUG   ] spawn_process: at 2019-02-05 18:56:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 18:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 18:56:56 [DEBUG   ] spawn_process: at 2019-02-05 18:56:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 18:56:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 18:56:56 [DEBUG   ] spawn_process: at 2019-02-05 18:56:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 18:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 18:56:56 [DEBUG   ] spawn_process: at 2019-02-05 18:56:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 18:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 18:56:56 [DEBUG   ] spawn_process: at 2019-02-05 18:56:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 18:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 18:56:56 [DEBUG   ] spawn_process: at 2019-02-05 18:56:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 18:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 18:56:56 [DEBUG   ] spawn_process: at 2019-02-05 18:56:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 18:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 18:56:56 [DEBUG   ] spawn_process: at 2019-02-05 18:56:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 18:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 18:56:56 [DEBUG   ] spawn_process: at 2019-02-05 18:56:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 18:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 18:56:56 [DEBUG   ] spawn_process: at 2019-02-05 18:56:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 18:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 18:56:56 [DEBUG   ] spawn_process: at 2019-02-05 18:56:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 18:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 18:56:56 [DEBUG   ] spawn_process: at 2019-02-05 18:56:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 18:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 18:56:56 [DEBUG   ] spawn_process: at 2019-02-05 18:56:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 18:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 18:56:56 [DEBUG   ] spawn_process: at 2019-02-05 18:56:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 18:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 18:56:56 [DEBUG   ] spawn_process: at 2019-02-05 18:56:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 18:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 18:56:56 [DEBUG   ] spawn_process: at 2019-02-05 18:56:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 18:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 18:56:56 [DEBUG   ] spawn_process: at 2019-02-05 18:56:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 18:56:57 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-02-05 18:56:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-02-05 18:56:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:56:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:56:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:56:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:56:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:56:57 [DEBUG   ] Finished updating board flags in 0.994 seconds
2019-02-05 18:57:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 18:57:22 [DEBUG   ] Got command BAM from MCS: ref #1412212
2019-02-05 18:57:22 [INFO    ] Finished processing BAM request
2019-02-05 18:57:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 18:57:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412212   8 58519 68242025 A  ERROR'
2019-02-05 18:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-02-05 18:57:22 [DEBUG   ] spawn_process: at 2019-02-05 18:57:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-02-05 18:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-02-05 18:57:22 [DEBUG   ] spawn_process: at 2019-02-05 18:57:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-02-05 18:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-02-05 18:57:22 [DEBUG   ] spawn_process: at 2019-02-05 18:57:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-02-05 18:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-02-05 18:57:22 [DEBUG   ] spawn_process: at 2019-02-05 18:57:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-02-05 18:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-02-05 18:57:22 [DEBUG   ] spawn_process: at 2019-02-05 18:57:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-02-05 18:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-02-05 18:57:22 [DEBUG   ] spawn_process: at 2019-02-05 18:57:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-02-05 18:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-02-05 18:57:22 [DEBUG   ] spawn_process: at 2019-02-05 18:57:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-02-05 18:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-02-05 18:57:22 [DEBUG   ] spawn_process: at 2019-02-05 18:57:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-02-05 18:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-02-05 18:57:22 [DEBUG   ] spawn_process: at 2019-02-05 18:57:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-02-05 18:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-02-05 18:57:22 [DEBUG   ] spawn_process: at 2019-02-05 18:57:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-02-05 18:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-02-05 18:57:22 [DEBUG   ] spawn_process: at 2019-02-05 18:57:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-02-05 18:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-02-05 18:57:22 [DEBUG   ] spawn_process: at 2019-02-05 18:57:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-02-05 18:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-02-05 18:57:22 [DEBUG   ] spawn_process: at 2019-02-05 18:57:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-02-05 18:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-02-05 18:57:22 [DEBUG   ] spawn_process: at 2019-02-05 18:57:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-02-05 18:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-02-05 18:57:22 [DEBUG   ] spawn_process: at 2019-02-05 18:57:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-02-05 18:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-02-05 18:57:22 [DEBUG   ] spawn_process: at 2019-02-05 18:57:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-02-05 18:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-02-05 18:57:22 [DEBUG   ] spawn_process: at 2019-02-05 18:57:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-02-05 18:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-02-05 18:57:22 [DEBUG   ] spawn_process: at 2019-02-05 18:57:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-02-05 18:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-02-05 18:57:22 [DEBUG   ] spawn_process: at 2019-02-05 18:57:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-02-05 18:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-02-05 18:57:22 [DEBUG   ] spawn_process: at 2019-02-05 18:57:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-02-05 18:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-02-05 18:57:22 [DEBUG   ] spawn_process: at 2019-02-05 18:57:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-02-05 18:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-02-05 18:57:22 [DEBUG   ] spawn_process: at 2019-02-05 18:57:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-02-05 18:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-02-05 18:57:22 [DEBUG   ] spawn_process: at 2019-02-05 18:57:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-02-05 18:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-02-05 18:57:22 [DEBUG   ] spawn_process: at 2019-02-05 18:57:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-02-05 18:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-02-05 18:57:22 [DEBUG   ] spawn_process: at 2019-02-05 18:57:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-02-05 18:57:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-02-05 18:57:22 [DEBUG   ] spawn_process: at 2019-02-05 18:57:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-02-05 18:57:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 18:57:48 [DEBUG   ] Got command BAM from MCS: ref #1412213
2019-02-05 18:57:48 [INFO    ] Finished processing BAM request
2019-02-05 18:57:48 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 18:57:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412213   8 58519 68268029 A  ERROR'
2019-02-05 18:57:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-02-05 18:57:48 [DEBUG   ] spawn_process: at 2019-02-05 18:57:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-02-05 18:57:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-02-05 18:57:48 [DEBUG   ] spawn_process: at 2019-02-05 18:57:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-02-05 18:57:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-02-05 18:57:48 [DEBUG   ] spawn_process: at 2019-02-05 18:57:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-02-05 18:57:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-02-05 18:57:48 [DEBUG   ] spawn_process: at 2019-02-05 18:57:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-02-05 18:57:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-02-05 18:57:48 [DEBUG   ] spawn_process: at 2019-02-05 18:57:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-02-05 18:57:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-02-05 18:57:48 [DEBUG   ] spawn_process: at 2019-02-05 18:57:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-02-05 18:57:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-02-05 18:57:48 [DEBUG   ] spawn_process: at 2019-02-05 18:57:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-02-05 18:57:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-02-05 18:57:48 [DEBUG   ] spawn_process: at 2019-02-05 18:57:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-02-05 18:57:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-02-05 18:57:48 [DEBUG   ] spawn_process: at 2019-02-05 18:57:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-02-05 18:57:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-02-05 18:57:48 [DEBUG   ] spawn_process: at 2019-02-05 18:57:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-02-05 18:57:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-02-05 18:57:48 [DEBUG   ] spawn_process: at 2019-02-05 18:57:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-02-05 18:57:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-02-05 18:57:48 [DEBUG   ] spawn_process: at 2019-02-05 18:57:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-02-05 18:57:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-02-05 18:57:48 [DEBUG   ] spawn_process: at 2019-02-05 18:57:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-02-05 18:57:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-02-05 18:57:48 [DEBUG   ] spawn_process: at 2019-02-05 18:57:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-02-05 18:57:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-02-05 18:57:48 [DEBUG   ] spawn_process: at 2019-02-05 18:57:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-02-05 18:57:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-02-05 18:57:48 [DEBUG   ] spawn_process: at 2019-02-05 18:57:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-02-05 18:57:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-02-05 18:57:48 [DEBUG   ] spawn_process: at 2019-02-05 18:57:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-02-05 18:57:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-02-05 18:57:48 [DEBUG   ] spawn_process: at 2019-02-05 18:57:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-02-05 18:57:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-02-05 18:57:48 [DEBUG   ] spawn_process: at 2019-02-05 18:57:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-02-05 18:57:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-02-05 18:57:48 [DEBUG   ] spawn_process: at 2019-02-05 18:57:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-02-05 18:57:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-02-05 18:57:48 [DEBUG   ] spawn_process: at 2019-02-05 18:57:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-02-05 18:57:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-02-05 18:57:48 [DEBUG   ] spawn_process: at 2019-02-05 18:57:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-02-05 18:57:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-02-05 18:57:48 [DEBUG   ] spawn_process: at 2019-02-05 18:57:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-02-05 18:57:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-02-05 18:57:48 [DEBUG   ] spawn_process: at 2019-02-05 18:57:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-02-05 18:57:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-02-05 18:57:48 [DEBUG   ] spawn_process: at 2019-02-05 18:57:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-02-05 18:57:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-02-05 18:57:48 [DEBUG   ] spawn_process: at 2019-02-05 18:57:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-02-05 18:57:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 18:57:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:57:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-02-05 18:57:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-05 18:57:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-02-05 18:57:58 [WARNING ] (13, 1, 'bot')
2019-02-05 18:57:58 [WARNING ] (13, 1, 'bot')
2019-02-05 18:57:58 [WARNING ] (13, 1, 'bot')
2019-02-05 18:57:58 [WARNING ] (13, 1, 'bot')
2019-02-05 18:57:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:57:58 [DEBUG   ] Finished updating board flags in 1.836 seconds
2019-02-05 18:58:15 [DEBUG   ] Got command BAM from MCS: ref #1412214
2019-02-05 18:58:15 [INFO    ] Finished processing BAM request
2019-02-05 18:58:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 18:58:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412214   8 58519 68295025 A  ERROR'
2019-02-05 18:58:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 18:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 18:58:15 [DEBUG   ] spawn_process: at 2019-02-05 18:58:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 18:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 18:58:15 [DEBUG   ] spawn_process: at 2019-02-05 18:58:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 18:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 18:58:15 [DEBUG   ] spawn_process: at 2019-02-05 18:58:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 18:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 18:58:15 [DEBUG   ] spawn_process: at 2019-02-05 18:58:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 18:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 18:58:15 [DEBUG   ] spawn_process: at 2019-02-05 18:58:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 18:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 18:58:15 [DEBUG   ] spawn_process: at 2019-02-05 18:58:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 18:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 18:58:15 [DEBUG   ] spawn_process: at 2019-02-05 18:58:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 18:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 18:58:15 [DEBUG   ] spawn_process: at 2019-02-05 18:58:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 18:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 18:58:15 [DEBUG   ] spawn_process: at 2019-02-05 18:58:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 18:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 18:58:15 [DEBUG   ] spawn_process: at 2019-02-05 18:58:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 18:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 18:58:15 [DEBUG   ] spawn_process: at 2019-02-05 18:58:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 18:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 18:58:15 [DEBUG   ] spawn_process: at 2019-02-05 18:58:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 18:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 18:58:15 [DEBUG   ] spawn_process: at 2019-02-05 18:58:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 18:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 18:58:15 [DEBUG   ] spawn_process: at 2019-02-05 18:58:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 18:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 18:58:15 [DEBUG   ] spawn_process: at 2019-02-05 18:58:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 18:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 18:58:15 [DEBUG   ] spawn_process: at 2019-02-05 18:58:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 18:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 18:58:15 [DEBUG   ] spawn_process: at 2019-02-05 18:58:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 18:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 18:58:15 [DEBUG   ] spawn_process: at 2019-02-05 18:58:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 18:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 18:58:15 [DEBUG   ] spawn_process: at 2019-02-05 18:58:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 18:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 18:58:15 [DEBUG   ] spawn_process: at 2019-02-05 18:58:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 18:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 18:58:15 [DEBUG   ] spawn_process: at 2019-02-05 18:58:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 18:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 18:58:15 [DEBUG   ] spawn_process: at 2019-02-05 18:58:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 18:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 18:58:15 [DEBUG   ] spawn_process: at 2019-02-05 18:58:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 18:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 18:58:15 [DEBUG   ] spawn_process: at 2019-02-05 18:58:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 18:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 18:58:15 [DEBUG   ] spawn_process: at 2019-02-05 18:58:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 18:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 18:58:15 [DEBUG   ] spawn_process: at 2019-02-05 18:58:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 18:58:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 18:58:41 [DEBUG   ] Got command BAM from MCS: ref #1412215
2019-02-05 18:58:41 [INFO    ] Finished processing BAM request
2019-02-05 18:58:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 18:58:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412215   8 58519 68321033 A  ERROR'
2019-02-05 18:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-02-05 18:58:41 [DEBUG   ] spawn_process: at 2019-02-05 18:58:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-02-05 18:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-02-05 18:58:41 [DEBUG   ] spawn_process: at 2019-02-05 18:58:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-02-05 18:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-02-05 18:58:41 [DEBUG   ] spawn_process: at 2019-02-05 18:58:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-02-05 18:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-02-05 18:58:41 [DEBUG   ] spawn_process: at 2019-02-05 18:58:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-02-05 18:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-02-05 18:58:41 [DEBUG   ] spawn_process: at 2019-02-05 18:58:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-02-05 18:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-02-05 18:58:41 [DEBUG   ] spawn_process: at 2019-02-05 18:58:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-02-05 18:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-02-05 18:58:41 [DEBUG   ] spawn_process: at 2019-02-05 18:58:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-02-05 18:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-02-05 18:58:41 [DEBUG   ] spawn_process: at 2019-02-05 18:58:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-02-05 18:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-02-05 18:58:41 [DEBUG   ] spawn_process: at 2019-02-05 18:58:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-02-05 18:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-02-05 18:58:41 [DEBUG   ] spawn_process: at 2019-02-05 18:58:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-02-05 18:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-02-05 18:58:41 [DEBUG   ] spawn_process: at 2019-02-05 18:58:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-02-05 18:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-02-05 18:58:41 [DEBUG   ] spawn_process: at 2019-02-05 18:58:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-02-05 18:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-02-05 18:58:41 [DEBUG   ] spawn_process: at 2019-02-05 18:58:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-02-05 18:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-02-05 18:58:41 [DEBUG   ] spawn_process: at 2019-02-05 18:58:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-02-05 18:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-02-05 18:58:41 [DEBUG   ] spawn_process: at 2019-02-05 18:58:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-02-05 18:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-02-05 18:58:41 [DEBUG   ] spawn_process: at 2019-02-05 18:58:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-02-05 18:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-02-05 18:58:41 [DEBUG   ] spawn_process: at 2019-02-05 18:58:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-02-05 18:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-02-05 18:58:41 [DEBUG   ] spawn_process: at 2019-02-05 18:58:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-02-05 18:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-02-05 18:58:41 [DEBUG   ] spawn_process: at 2019-02-05 18:58:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-02-05 18:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-02-05 18:58:41 [DEBUG   ] spawn_process: at 2019-02-05 18:58:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-02-05 18:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-02-05 18:58:41 [DEBUG   ] spawn_process: at 2019-02-05 18:58:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-02-05 18:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-02-05 18:58:41 [DEBUG   ] spawn_process: at 2019-02-05 18:58:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-02-05 18:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-02-05 18:58:41 [DEBUG   ] spawn_process: at 2019-02-05 18:58:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-02-05 18:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-02-05 18:58:41 [DEBUG   ] spawn_process: at 2019-02-05 18:58:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-02-05 18:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-02-05 18:58:41 [DEBUG   ] spawn_process: at 2019-02-05 18:58:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-02-05 18:58:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-02-05 18:58:41 [DEBUG   ] spawn_process: at 2019-02-05 18:58:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-02-05 18:58:42 [DEBUG   ] Got command BAM from MCS: ref #1412216
2019-02-05 18:58:42 [INFO    ] Finished processing BAM request
2019-02-05 18:58:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 18:58:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412216   8 58519 68322033 A  ERROR'
2019-02-05 18:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-02-05 18:58:42 [DEBUG   ] spawn_process: at 2019-02-05 18:58:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-02-05 18:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-02-05 18:58:42 [DEBUG   ] spawn_process: at 2019-02-05 18:58:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-02-05 18:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-02-05 18:58:42 [DEBUG   ] spawn_process: at 2019-02-05 18:58:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-02-05 18:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-02-05 18:58:42 [DEBUG   ] spawn_process: at 2019-02-05 18:58:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-02-05 18:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-02-05 18:58:42 [DEBUG   ] spawn_process: at 2019-02-05 18:58:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-02-05 18:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-02-05 18:58:42 [DEBUG   ] spawn_process: at 2019-02-05 18:58:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-02-05 18:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-02-05 18:58:42 [DEBUG   ] spawn_process: at 2019-02-05 18:58:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-02-05 18:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-02-05 18:58:42 [DEBUG   ] spawn_process: at 2019-02-05 18:58:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-02-05 18:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-02-05 18:58:42 [DEBUG   ] spawn_process: at 2019-02-05 18:58:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-02-05 18:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-02-05 18:58:42 [DEBUG   ] spawn_process: at 2019-02-05 18:58:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-02-05 18:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-02-05 18:58:42 [DEBUG   ] spawn_process: at 2019-02-05 18:58:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-02-05 18:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-02-05 18:58:42 [DEBUG   ] spawn_process: at 2019-02-05 18:58:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-02-05 18:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-02-05 18:58:42 [DEBUG   ] spawn_process: at 2019-02-05 18:58:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-02-05 18:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-02-05 18:58:42 [DEBUG   ] spawn_process: at 2019-02-05 18:58:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-02-05 18:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-02-05 18:58:42 [DEBUG   ] spawn_process: at 2019-02-05 18:58:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-02-05 18:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-02-05 18:58:42 [DEBUG   ] spawn_process: at 2019-02-05 18:58:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-02-05 18:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-02-05 18:58:42 [DEBUG   ] spawn_process: at 2019-02-05 18:58:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-02-05 18:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-02-05 18:58:42 [DEBUG   ] spawn_process: at 2019-02-05 18:58:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-02-05 18:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-02-05 18:58:42 [DEBUG   ] spawn_process: at 2019-02-05 18:58:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-02-05 18:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-02-05 18:58:42 [DEBUG   ] spawn_process: at 2019-02-05 18:58:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-02-05 18:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-02-05 18:58:42 [DEBUG   ] spawn_process: at 2019-02-05 18:58:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-02-05 18:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-02-05 18:58:42 [DEBUG   ] spawn_process: at 2019-02-05 18:58:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-02-05 18:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-02-05 18:58:42 [DEBUG   ] spawn_process: at 2019-02-05 18:58:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-02-05 18:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-02-05 18:58:42 [DEBUG   ] spawn_process: at 2019-02-05 18:58:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-02-05 18:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-02-05 18:58:42 [DEBUG   ] spawn_process: at 2019-02-05 18:58:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-02-05 18:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-02-05 18:58:42 [DEBUG   ] spawn_process: at 2019-02-05 18:58:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-02-05 18:58:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 18:58:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 18:58:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:58:57 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-02-05 18:58:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:58:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:58:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:58:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:58:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:58:57 [DEBUG   ] Finished updating board flags in 1.229 seconds
2019-02-05 18:59:09 [DEBUG   ] Got command BAM from MCS: ref #1412217
2019-02-05 18:59:09 [INFO    ] Finished processing BAM request
2019-02-05 18:59:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 18:59:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412217   8 58519 68349025 A  ERROR'
2019-02-05 18:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 18:59:09 [DEBUG   ] spawn_process: at 2019-02-05 18:59:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 18:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 18:59:09 [DEBUG   ] spawn_process: at 2019-02-05 18:59:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 18:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 18:59:09 [DEBUG   ] spawn_process: at 2019-02-05 18:59:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 18:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 18:59:09 [DEBUG   ] spawn_process: at 2019-02-05 18:59:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 18:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 18:59:09 [DEBUG   ] spawn_process: at 2019-02-05 18:59:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 18:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 18:59:09 [DEBUG   ] spawn_process: at 2019-02-05 18:59:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 18:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 18:59:09 [DEBUG   ] spawn_process: at 2019-02-05 18:59:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 18:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 18:59:09 [DEBUG   ] spawn_process: at 2019-02-05 18:59:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 18:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 18:59:09 [DEBUG   ] spawn_process: at 2019-02-05 18:59:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 18:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 18:59:09 [DEBUG   ] spawn_process: at 2019-02-05 18:59:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 18:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 18:59:09 [DEBUG   ] spawn_process: at 2019-02-05 18:59:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 18:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 18:59:09 [DEBUG   ] spawn_process: at 2019-02-05 18:59:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 18:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 18:59:09 [DEBUG   ] spawn_process: at 2019-02-05 18:59:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 18:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 18:59:09 [DEBUG   ] spawn_process: at 2019-02-05 18:59:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 18:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 18:59:09 [DEBUG   ] spawn_process: at 2019-02-05 18:59:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 18:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 18:59:09 [DEBUG   ] spawn_process: at 2019-02-05 18:59:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 18:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 18:59:09 [DEBUG   ] spawn_process: at 2019-02-05 18:59:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 18:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 18:59:09 [DEBUG   ] spawn_process: at 2019-02-05 18:59:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 18:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 18:59:09 [DEBUG   ] spawn_process: at 2019-02-05 18:59:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 18:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 18:59:09 [DEBUG   ] spawn_process: at 2019-02-05 18:59:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 18:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 18:59:09 [DEBUG   ] spawn_process: at 2019-02-05 18:59:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 18:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 18:59:09 [DEBUG   ] spawn_process: at 2019-02-05 18:59:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 18:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 18:59:09 [DEBUG   ] spawn_process: at 2019-02-05 18:59:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 18:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 18:59:09 [DEBUG   ] spawn_process: at 2019-02-05 18:59:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 18:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 18:59:09 [DEBUG   ] spawn_process: at 2019-02-05 18:59:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 18:59:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 18:59:09 [DEBUG   ] spawn_process: at 2019-02-05 18:59:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 18:59:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 18:59:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 18:59:37 [DEBUG   ] Got command BAM from MCS: ref #1412222
2019-02-05 18:59:37 [INFO    ] Finished processing BAM request
2019-02-05 18:59:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 18:59:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412222   8 58519 68377033 A  ERROR'
2019-02-05 18:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-02-05 18:59:37 [DEBUG   ] spawn_process: at 2019-02-05 18:59:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-02-05 18:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-02-05 18:59:37 [DEBUG   ] spawn_process: at 2019-02-05 18:59:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-02-05 18:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-02-05 18:59:37 [DEBUG   ] spawn_process: at 2019-02-05 18:59:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-02-05 18:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-02-05 18:59:37 [DEBUG   ] spawn_process: at 2019-02-05 18:59:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-02-05 18:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-02-05 18:59:37 [DEBUG   ] spawn_process: at 2019-02-05 18:59:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-02-05 18:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-02-05 18:59:37 [DEBUG   ] spawn_process: at 2019-02-05 18:59:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-02-05 18:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-02-05 18:59:37 [DEBUG   ] spawn_process: at 2019-02-05 18:59:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-02-05 18:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-02-05 18:59:37 [DEBUG   ] spawn_process: at 2019-02-05 18:59:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-02-05 18:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-02-05 18:59:37 [DEBUG   ] spawn_process: at 2019-02-05 18:59:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-02-05 18:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-02-05 18:59:37 [DEBUG   ] spawn_process: at 2019-02-05 18:59:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-02-05 18:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-02-05 18:59:37 [DEBUG   ] spawn_process: at 2019-02-05 18:59:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-02-05 18:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-02-05 18:59:37 [DEBUG   ] spawn_process: at 2019-02-05 18:59:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-02-05 18:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-02-05 18:59:37 [DEBUG   ] spawn_process: at 2019-02-05 18:59:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-02-05 18:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-02-05 18:59:37 [DEBUG   ] spawn_process: at 2019-02-05 18:59:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-02-05 18:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-02-05 18:59:37 [DEBUG   ] spawn_process: at 2019-02-05 18:59:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-02-05 18:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-02-05 18:59:37 [DEBUG   ] spawn_process: at 2019-02-05 18:59:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-02-05 18:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-02-05 18:59:37 [DEBUG   ] spawn_process: at 2019-02-05 18:59:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-02-05 18:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-02-05 18:59:37 [DEBUG   ] spawn_process: at 2019-02-05 18:59:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-02-05 18:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-02-05 18:59:37 [DEBUG   ] spawn_process: at 2019-02-05 18:59:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-02-05 18:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-02-05 18:59:37 [DEBUG   ] spawn_process: at 2019-02-05 18:59:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-02-05 18:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-02-05 18:59:37 [DEBUG   ] spawn_process: at 2019-02-05 18:59:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-02-05 18:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-02-05 18:59:37 [DEBUG   ] spawn_process: at 2019-02-05 18:59:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-02-05 18:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-02-05 18:59:37 [DEBUG   ] spawn_process: at 2019-02-05 18:59:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-02-05 18:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-02-05 18:59:37 [DEBUG   ] spawn_process: at 2019-02-05 18:59:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-02-05 18:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-02-05 18:59:37 [DEBUG   ] spawn_process: at 2019-02-05 18:59:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-02-05 18:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-02-05 18:59:37 [DEBUG   ] spawn_process: at 2019-02-05 18:59:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-02-05 18:59:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 18:59:55 [DEBUG   ] Got command RPT from MCS: ref #1412223
2019-02-05 18:59:55 [DEBUG   ] summary = ERROR
2019-02-05 18:59:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412223  13 58519 68395277 A  ERRORERROR'
2019-02-05 18:59:55 [DEBUG   ] Got command RPT from MCS: ref #1412224
2019-02-05 18:59:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 18:59:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412224  77 58519 68395481 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 18:59:55 [DEBUG   ] Got command RPT from MCS: ref #1412225
2019-02-05 18:59:55 [DEBUG   ] summary = ERROR
2019-02-05 18:59:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412225  13 58519 68395673 A  ERRORERROR'
2019-02-05 18:59:55 [DEBUG   ] Got command RPT from MCS: ref #1412226
2019-02-05 18:59:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 18:59:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412226  77 58519 68395877 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 18:59:56 [DEBUG   ] Got command RPT from MCS: ref #1412227
2019-02-05 18:59:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 18:59:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412227  12 58519 68396081 A  ERRORB£ff'
2019-02-05 18:59:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 18:59:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 18:59:57 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-02-05 18:59:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:59:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:59:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:59:57 [WARNING ] (13, 1, 'bot')
2019-02-05 18:59:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 18:59:57 [DEBUG   ] Finished updating board flags in 1.203 seconds
2019-02-05 19:00:05 [DEBUG   ] Got command BAM from MCS: ref #1412228
2019-02-05 19:00:05 [INFO    ] Finished processing BAM request
2019-02-05 19:00:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:00:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412228   8 58519 68405025 A  ERROR'
2019-02-05 19:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-02-05 19:00:05 [DEBUG   ] spawn_process: at 2019-02-05 19:00:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-02-05 19:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-02-05 19:00:05 [DEBUG   ] spawn_process: at 2019-02-05 19:00:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-02-05 19:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-02-05 19:00:05 [DEBUG   ] spawn_process: at 2019-02-05 19:00:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-02-05 19:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-02-05 19:00:05 [DEBUG   ] spawn_process: at 2019-02-05 19:00:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-02-05 19:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-02-05 19:00:05 [DEBUG   ] spawn_process: at 2019-02-05 19:00:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-02-05 19:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-02-05 19:00:05 [DEBUG   ] spawn_process: at 2019-02-05 19:00:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-02-05 19:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-02-05 19:00:05 [DEBUG   ] spawn_process: at 2019-02-05 19:00:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-02-05 19:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-02-05 19:00:05 [DEBUG   ] spawn_process: at 2019-02-05 19:00:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-02-05 19:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-02-05 19:00:05 [DEBUG   ] spawn_process: at 2019-02-05 19:00:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-02-05 19:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-02-05 19:00:05 [DEBUG   ] spawn_process: at 2019-02-05 19:00:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-02-05 19:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-02-05 19:00:05 [DEBUG   ] spawn_process: at 2019-02-05 19:00:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-02-05 19:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-02-05 19:00:05 [DEBUG   ] spawn_process: at 2019-02-05 19:00:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-02-05 19:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-02-05 19:00:05 [DEBUG   ] spawn_process: at 2019-02-05 19:00:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-02-05 19:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-02-05 19:00:05 [DEBUG   ] spawn_process: at 2019-02-05 19:00:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-02-05 19:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-02-05 19:00:05 [DEBUG   ] spawn_process: at 2019-02-05 19:00:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-02-05 19:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-02-05 19:00:05 [DEBUG   ] spawn_process: at 2019-02-05 19:00:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-02-05 19:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-02-05 19:00:05 [DEBUG   ] spawn_process: at 2019-02-05 19:00:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-02-05 19:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-02-05 19:00:05 [DEBUG   ] spawn_process: at 2019-02-05 19:00:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-02-05 19:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-02-05 19:00:05 [DEBUG   ] spawn_process: at 2019-02-05 19:00:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-02-05 19:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-02-05 19:00:05 [DEBUG   ] spawn_process: at 2019-02-05 19:00:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-02-05 19:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-02-05 19:00:05 [DEBUG   ] spawn_process: at 2019-02-05 19:00:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-02-05 19:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-02-05 19:00:05 [DEBUG   ] spawn_process: at 2019-02-05 19:00:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-02-05 19:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-02-05 19:00:05 [DEBUG   ] spawn_process: at 2019-02-05 19:00:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-02-05 19:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-02-05 19:00:05 [DEBUG   ] spawn_process: at 2019-02-05 19:00:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-02-05 19:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-02-05 19:00:05 [DEBUG   ] spawn_process: at 2019-02-05 19:00:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-02-05 19:00:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-02-05 19:00:05 [DEBUG   ] spawn_process: at 2019-02-05 19:00:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-02-05 19:00:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 19:00:26 [DEBUG   ] Got command BAM from MCS: ref #1412229
2019-02-05 19:00:26 [INFO    ] Finished processing BAM request
2019-02-05 19:00:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:00:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412229   8 58519 68426033 A  ERROR'
2019-02-05 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-02-05 19:00:26 [DEBUG   ] spawn_process: at 2019-02-05 19:00:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-02-05 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-02-05 19:00:26 [DEBUG   ] spawn_process: at 2019-02-05 19:00:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-02-05 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-02-05 19:00:26 [DEBUG   ] spawn_process: at 2019-02-05 19:00:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-02-05 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-02-05 19:00:26 [DEBUG   ] spawn_process: at 2019-02-05 19:00:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-02-05 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-02-05 19:00:26 [DEBUG   ] spawn_process: at 2019-02-05 19:00:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-02-05 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-02-05 19:00:26 [DEBUG   ] spawn_process: at 2019-02-05 19:00:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-02-05 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-02-05 19:00:26 [DEBUG   ] spawn_process: at 2019-02-05 19:00:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-02-05 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-02-05 19:00:26 [DEBUG   ] spawn_process: at 2019-02-05 19:00:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-02-05 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-02-05 19:00:26 [DEBUG   ] spawn_process: at 2019-02-05 19:00:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-02-05 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-02-05 19:00:26 [DEBUG   ] spawn_process: at 2019-02-05 19:00:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-02-05 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-02-05 19:00:26 [DEBUG   ] spawn_process: at 2019-02-05 19:00:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-02-05 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-02-05 19:00:26 [DEBUG   ] spawn_process: at 2019-02-05 19:00:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-02-05 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-02-05 19:00:26 [DEBUG   ] spawn_process: at 2019-02-05 19:00:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-02-05 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-02-05 19:00:26 [DEBUG   ] spawn_process: at 2019-02-05 19:00:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-02-05 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-02-05 19:00:26 [DEBUG   ] spawn_process: at 2019-02-05 19:00:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-02-05 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-02-05 19:00:26 [DEBUG   ] spawn_process: at 2019-02-05 19:00:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-02-05 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-02-05 19:00:26 [DEBUG   ] spawn_process: at 2019-02-05 19:00:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-02-05 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-02-05 19:00:26 [DEBUG   ] spawn_process: at 2019-02-05 19:00:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-02-05 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-02-05 19:00:26 [DEBUG   ] spawn_process: at 2019-02-05 19:00:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-02-05 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-02-05 19:00:26 [DEBUG   ] spawn_process: at 2019-02-05 19:00:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-02-05 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-02-05 19:00:26 [DEBUG   ] spawn_process: at 2019-02-05 19:00:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-02-05 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-02-05 19:00:26 [DEBUG   ] spawn_process: at 2019-02-05 19:00:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-02-05 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-02-05 19:00:26 [DEBUG   ] spawn_process: at 2019-02-05 19:00:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-02-05 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-02-05 19:00:26 [DEBUG   ] spawn_process: at 2019-02-05 19:00:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-02-05 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-02-05 19:00:26 [DEBUG   ] spawn_process: at 2019-02-05 19:00:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-02-05 19:00:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-02-05 19:00:26 [DEBUG   ] spawn_process: at 2019-02-05 19:00:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-02-05 19:00:34 [DEBUG   ] Got command BAM from MCS: ref #1412230
2019-02-05 19:00:34 [INFO    ] Finished processing BAM request
2019-02-05 19:00:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:00:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412230   8 58519 68434029 A  ERROR'
2019-02-05 19:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-02-05 19:00:34 [DEBUG   ] spawn_process: at 2019-02-05 19:00:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-02-05 19:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-02-05 19:00:34 [DEBUG   ] spawn_process: at 2019-02-05 19:00:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-02-05 19:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-02-05 19:00:34 [DEBUG   ] spawn_process: at 2019-02-05 19:00:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-02-05 19:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-02-05 19:00:34 [DEBUG   ] spawn_process: at 2019-02-05 19:00:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-02-05 19:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-02-05 19:00:34 [DEBUG   ] spawn_process: at 2019-02-05 19:00:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-02-05 19:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-02-05 19:00:34 [DEBUG   ] spawn_process: at 2019-02-05 19:00:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-02-05 19:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-02-05 19:00:34 [DEBUG   ] spawn_process: at 2019-02-05 19:00:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-02-05 19:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-02-05 19:00:34 [DEBUG   ] spawn_process: at 2019-02-05 19:00:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-02-05 19:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-02-05 19:00:34 [DEBUG   ] spawn_process: at 2019-02-05 19:00:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-02-05 19:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-02-05 19:00:34 [DEBUG   ] spawn_process: at 2019-02-05 19:00:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-02-05 19:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-02-05 19:00:34 [DEBUG   ] spawn_process: at 2019-02-05 19:00:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-02-05 19:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-02-05 19:00:34 [DEBUG   ] spawn_process: at 2019-02-05 19:00:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-02-05 19:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-02-05 19:00:34 [DEBUG   ] spawn_process: at 2019-02-05 19:00:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-02-05 19:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-02-05 19:00:34 [DEBUG   ] spawn_process: at 2019-02-05 19:00:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-02-05 19:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-02-05 19:00:34 [DEBUG   ] spawn_process: at 2019-02-05 19:00:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-02-05 19:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-02-05 19:00:34 [DEBUG   ] spawn_process: at 2019-02-05 19:00:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-02-05 19:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-02-05 19:00:34 [DEBUG   ] spawn_process: at 2019-02-05 19:00:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-02-05 19:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-02-05 19:00:34 [DEBUG   ] spawn_process: at 2019-02-05 19:00:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-02-05 19:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-02-05 19:00:34 [DEBUG   ] spawn_process: at 2019-02-05 19:00:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-02-05 19:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-02-05 19:00:34 [DEBUG   ] spawn_process: at 2019-02-05 19:00:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-02-05 19:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-02-05 19:00:34 [DEBUG   ] spawn_process: at 2019-02-05 19:00:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-02-05 19:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-02-05 19:00:34 [DEBUG   ] spawn_process: at 2019-02-05 19:00:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-02-05 19:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-02-05 19:00:34 [DEBUG   ] spawn_process: at 2019-02-05 19:00:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-02-05 19:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-02-05 19:00:34 [DEBUG   ] spawn_process: at 2019-02-05 19:00:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-02-05 19:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-02-05 19:00:34 [DEBUG   ] spawn_process: at 2019-02-05 19:00:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-02-05 19:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-02-05 19:00:34 [DEBUG   ] spawn_process: at 2019-02-05 19:00:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-02-05 19:00:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 19:00:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 19:00:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 19:00:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-02-05 19:00:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-02-05 19:00:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:00:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-02-05 19:00:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-02-05 19:00:57 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-02-05 19:00:57 [WARNING ] (13, 1, 'bot')
2019-02-05 19:00:57 [WARNING ] (13, 1, 'bot')
2019-02-05 19:00:57 [WARNING ] (13, 1, 'bot')
2019-02-05 19:00:57 [WARNING ] (13, 1, 'bot')
2019-02-05 19:00:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:00:57 [DEBUG   ] Finished updating board flags in 1.219 seconds
2019-02-05 19:01:03 [DEBUG   ] Got command BAM from MCS: ref #1412231
2019-02-05 19:01:03 [INFO    ] Finished processing BAM request
2019-02-05 19:01:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:01:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412231   8 58519 68463029 A  ERROR'
2019-02-05 19:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 19:01:03 [DEBUG   ] spawn_process: at 2019-02-05 19:01:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 19:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 19:01:03 [DEBUG   ] spawn_process: at 2019-02-05 19:01:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 19:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 19:01:03 [DEBUG   ] spawn_process: at 2019-02-05 19:01:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 19:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 19:01:03 [DEBUG   ] spawn_process: at 2019-02-05 19:01:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 19:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 19:01:03 [DEBUG   ] spawn_process: at 2019-02-05 19:01:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 19:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 19:01:03 [DEBUG   ] spawn_process: at 2019-02-05 19:01:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 19:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 19:01:03 [DEBUG   ] spawn_process: at 2019-02-05 19:01:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 19:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 19:01:03 [DEBUG   ] spawn_process: at 2019-02-05 19:01:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 19:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 19:01:03 [DEBUG   ] spawn_process: at 2019-02-05 19:01:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 19:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 19:01:03 [DEBUG   ] spawn_process: at 2019-02-05 19:01:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 19:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 19:01:03 [DEBUG   ] spawn_process: at 2019-02-05 19:01:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 19:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 19:01:03 [DEBUG   ] spawn_process: at 2019-02-05 19:01:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 19:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 19:01:03 [DEBUG   ] spawn_process: at 2019-02-05 19:01:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 19:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 19:01:03 [DEBUG   ] spawn_process: at 2019-02-05 19:01:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 19:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 19:01:03 [DEBUG   ] spawn_process: at 2019-02-05 19:01:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 19:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 19:01:03 [DEBUG   ] spawn_process: at 2019-02-05 19:01:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 19:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 19:01:03 [DEBUG   ] spawn_process: at 2019-02-05 19:01:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 19:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 19:01:03 [DEBUG   ] spawn_process: at 2019-02-05 19:01:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 19:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 19:01:03 [DEBUG   ] spawn_process: at 2019-02-05 19:01:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 19:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 19:01:03 [DEBUG   ] spawn_process: at 2019-02-05 19:01:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 19:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 19:01:03 [DEBUG   ] spawn_process: at 2019-02-05 19:01:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 19:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 19:01:03 [DEBUG   ] spawn_process: at 2019-02-05 19:01:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 19:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 19:01:03 [DEBUG   ] spawn_process: at 2019-02-05 19:01:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 19:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 19:01:03 [DEBUG   ] spawn_process: at 2019-02-05 19:01:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 19:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 19:01:03 [DEBUG   ] spawn_process: at 2019-02-05 19:01:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 19:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 19:01:03 [DEBUG   ] spawn_process: at 2019-02-05 19:01:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 19:01:12 [DEBUG   ] Got command RPT from MCS: ref #1412232
2019-02-05 19:01:12 [DEBUG   ] summary = ERROR
2019-02-05 19:01:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412232  13 58519 68472005 A  ERRORERROR'
2019-02-05 19:01:12 [DEBUG   ] Got command RPT from MCS: ref #1412233
2019-02-05 19:01:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 19:01:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412233  77 58519 68472006 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 19:01:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 19:01:32 [DEBUG   ] Got command BAM from MCS: ref #1412249
2019-02-05 19:01:32 [INFO    ] Finished processing BAM request
2019-02-05 19:01:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:01:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412249   8 58519 68492033 A  ERROR'
2019-02-05 19:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 19:01:32 [DEBUG   ] spawn_process: at 2019-02-05 19:01:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 19:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 19:01:32 [DEBUG   ] spawn_process: at 2019-02-05 19:01:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 19:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 19:01:32 [DEBUG   ] spawn_process: at 2019-02-05 19:01:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 19:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 19:01:32 [DEBUG   ] spawn_process: at 2019-02-05 19:01:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 19:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 19:01:32 [DEBUG   ] spawn_process: at 2019-02-05 19:01:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 19:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 19:01:32 [DEBUG   ] spawn_process: at 2019-02-05 19:01:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 19:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 19:01:32 [DEBUG   ] spawn_process: at 2019-02-05 19:01:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 19:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 19:01:32 [DEBUG   ] spawn_process: at 2019-02-05 19:01:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 19:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 19:01:32 [DEBUG   ] spawn_process: at 2019-02-05 19:01:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 19:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 19:01:32 [DEBUG   ] spawn_process: at 2019-02-05 19:01:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 19:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 19:01:32 [DEBUG   ] spawn_process: at 2019-02-05 19:01:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 19:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 19:01:32 [DEBUG   ] spawn_process: at 2019-02-05 19:01:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 19:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 19:01:32 [DEBUG   ] spawn_process: at 2019-02-05 19:01:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 19:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 19:01:32 [DEBUG   ] spawn_process: at 2019-02-05 19:01:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 19:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 19:01:32 [DEBUG   ] spawn_process: at 2019-02-05 19:01:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 19:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 19:01:32 [DEBUG   ] spawn_process: at 2019-02-05 19:01:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 19:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 19:01:32 [DEBUG   ] spawn_process: at 2019-02-05 19:01:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 19:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 19:01:32 [DEBUG   ] spawn_process: at 2019-02-05 19:01:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 19:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 19:01:32 [DEBUG   ] spawn_process: at 2019-02-05 19:01:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 19:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 19:01:32 [DEBUG   ] spawn_process: at 2019-02-05 19:01:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 19:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 19:01:32 [DEBUG   ] spawn_process: at 2019-02-05 19:01:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 19:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 19:01:32 [DEBUG   ] spawn_process: at 2019-02-05 19:01:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 19:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 19:01:32 [DEBUG   ] spawn_process: at 2019-02-05 19:01:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 19:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 19:01:32 [DEBUG   ] spawn_process: at 2019-02-05 19:01:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 19:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 19:01:32 [DEBUG   ] spawn_process: at 2019-02-05 19:01:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 19:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 19:01:32 [DEBUG   ] spawn_process: at 2019-02-05 19:01:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 19:01:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 19:01:55 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2019-02-05 19:01:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:01:57 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-02-05 19:01:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-05 19:01:57 [WARNING ] (13, 1, 'bot')
2019-02-05 19:01:57 [WARNING ] (13, 1, 'bot')
2019-02-05 19:01:57 [WARNING ] (13, 1, 'bot')
2019-02-05 19:01:57 [WARNING ] (13, 1, 'bot')
2019-02-05 19:01:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:01:57 [DEBUG   ] Finished updating board flags in 1.165 seconds
2019-02-05 19:02:02 [DEBUG   ] Got command BAM from MCS: ref #1412250
2019-02-05 19:02:02 [INFO    ] Finished processing BAM request
2019-02-05 19:02:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:02:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412250   8 58519 68522029 A  ERROR'
2019-02-05 19:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 19:02:02 [DEBUG   ] spawn_process: at 2019-02-05 19:02:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 19:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 19:02:02 [DEBUG   ] spawn_process: at 2019-02-05 19:02:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 19:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 19:02:02 [DEBUG   ] spawn_process: at 2019-02-05 19:02:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 19:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 19:02:02 [DEBUG   ] spawn_process: at 2019-02-05 19:02:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 19:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 19:02:02 [DEBUG   ] spawn_process: at 2019-02-05 19:02:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 19:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 19:02:02 [DEBUG   ] spawn_process: at 2019-02-05 19:02:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 19:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 19:02:02 [DEBUG   ] spawn_process: at 2019-02-05 19:02:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 19:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 19:02:02 [DEBUG   ] spawn_process: at 2019-02-05 19:02:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 19:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 19:02:02 [DEBUG   ] spawn_process: at 2019-02-05 19:02:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 19:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 19:02:02 [DEBUG   ] spawn_process: at 2019-02-05 19:02:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 19:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 19:02:02 [DEBUG   ] spawn_process: at 2019-02-05 19:02:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 19:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 19:02:02 [DEBUG   ] spawn_process: at 2019-02-05 19:02:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 19:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 19:02:02 [DEBUG   ] spawn_process: at 2019-02-05 19:02:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 19:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 19:02:02 [DEBUG   ] spawn_process: at 2019-02-05 19:02:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 19:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 19:02:02 [DEBUG   ] spawn_process: at 2019-02-05 19:02:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 19:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 19:02:02 [DEBUG   ] spawn_process: at 2019-02-05 19:02:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 19:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 19:02:02 [DEBUG   ] spawn_process: at 2019-02-05 19:02:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 19:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 19:02:02 [DEBUG   ] spawn_process: at 2019-02-05 19:02:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 19:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 19:02:02 [DEBUG   ] spawn_process: at 2019-02-05 19:02:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 19:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 19:02:02 [DEBUG   ] spawn_process: at 2019-02-05 19:02:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 19:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 19:02:02 [DEBUG   ] spawn_process: at 2019-02-05 19:02:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 19:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 19:02:02 [DEBUG   ] spawn_process: at 2019-02-05 19:02:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 19:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 19:02:02 [DEBUG   ] spawn_process: at 2019-02-05 19:02:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 19:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 19:02:02 [DEBUG   ] spawn_process: at 2019-02-05 19:02:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 19:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 19:02:02 [DEBUG   ] spawn_process: at 2019-02-05 19:02:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 19:02:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 19:02:02 [DEBUG   ] spawn_process: at 2019-02-05 19:02:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 19:02:12 [DEBUG   ] Got command BAM from MCS: ref #1412251
2019-02-05 19:02:12 [INFO    ] Finished processing BAM request
2019-02-05 19:02:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:02:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412251   8 58519 68532033 A  ERROR'
2019-02-05 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 19:02:12 [DEBUG   ] spawn_process: at 2019-02-05 19:02:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 19:02:12 [DEBUG   ] spawn_process: at 2019-02-05 19:02:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 19:02:12 [DEBUG   ] spawn_process: at 2019-02-05 19:02:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 19:02:12 [DEBUG   ] spawn_process: at 2019-02-05 19:02:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 19:02:12 [DEBUG   ] spawn_process: at 2019-02-05 19:02:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 19:02:12 [DEBUG   ] spawn_process: at 2019-02-05 19:02:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 19:02:12 [DEBUG   ] spawn_process: at 2019-02-05 19:02:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 19:02:12 [DEBUG   ] spawn_process: at 2019-02-05 19:02:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 19:02:12 [DEBUG   ] spawn_process: at 2019-02-05 19:02:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 19:02:12 [DEBUG   ] spawn_process: at 2019-02-05 19:02:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 19:02:12 [DEBUG   ] spawn_process: at 2019-02-05 19:02:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 19:02:12 [DEBUG   ] spawn_process: at 2019-02-05 19:02:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 19:02:12 [DEBUG   ] spawn_process: at 2019-02-05 19:02:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 19:02:12 [DEBUG   ] spawn_process: at 2019-02-05 19:02:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 19:02:12 [DEBUG   ] spawn_process: at 2019-02-05 19:02:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 19:02:12 [DEBUG   ] spawn_process: at 2019-02-05 19:02:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 19:02:12 [DEBUG   ] spawn_process: at 2019-02-05 19:02:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 19:02:12 [DEBUG   ] spawn_process: at 2019-02-05 19:02:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 19:02:12 [DEBUG   ] spawn_process: at 2019-02-05 19:02:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 19:02:12 [DEBUG   ] spawn_process: at 2019-02-05 19:02:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 19:02:12 [DEBUG   ] spawn_process: at 2019-02-05 19:02:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 19:02:12 [DEBUG   ] spawn_process: at 2019-02-05 19:02:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 19:02:12 [DEBUG   ] spawn_process: at 2019-02-05 19:02:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 19:02:12 [DEBUG   ] spawn_process: at 2019-02-05 19:02:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 19:02:12 [DEBUG   ] spawn_process: at 2019-02-05 19:02:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 19:02:12 [DEBUG   ] spawn_process: at 2019-02-05 19:02:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 19:02:15 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-05 19:02:32 [DEBUG   ] Got command BAM from MCS: ref #1412256
2019-02-05 19:02:32 [INFO    ] Finished processing BAM request
2019-02-05 19:02:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:02:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412256   8 58519 68552041 A  ERROR'
2019-02-05 19:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 19:02:32 [DEBUG   ] spawn_process: at 2019-02-05 19:02:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 19:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 19:02:32 [DEBUG   ] spawn_process: at 2019-02-05 19:02:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 19:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 19:02:32 [DEBUG   ] spawn_process: at 2019-02-05 19:02:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 19:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 19:02:32 [DEBUG   ] spawn_process: at 2019-02-05 19:02:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 19:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 19:02:32 [DEBUG   ] spawn_process: at 2019-02-05 19:02:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 19:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 19:02:32 [DEBUG   ] spawn_process: at 2019-02-05 19:02:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 19:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 19:02:32 [DEBUG   ] spawn_process: at 2019-02-05 19:02:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 19:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 19:02:32 [DEBUG   ] spawn_process: at 2019-02-05 19:02:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 19:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 19:02:32 [DEBUG   ] spawn_process: at 2019-02-05 19:02:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 19:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 19:02:32 [DEBUG   ] spawn_process: at 2019-02-05 19:02:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 19:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 19:02:32 [DEBUG   ] spawn_process: at 2019-02-05 19:02:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 19:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 19:02:32 [DEBUG   ] spawn_process: at 2019-02-05 19:02:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 19:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 19:02:32 [DEBUG   ] spawn_process: at 2019-02-05 19:02:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 19:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 19:02:32 [DEBUG   ] spawn_process: at 2019-02-05 19:02:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 19:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 19:02:32 [DEBUG   ] spawn_process: at 2019-02-05 19:02:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 19:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 19:02:32 [DEBUG   ] spawn_process: at 2019-02-05 19:02:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 19:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 19:02:32 [DEBUG   ] spawn_process: at 2019-02-05 19:02:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 19:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 19:02:32 [DEBUG   ] spawn_process: at 2019-02-05 19:02:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 19:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 19:02:32 [DEBUG   ] spawn_process: at 2019-02-05 19:02:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 19:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 19:02:32 [DEBUG   ] spawn_process: at 2019-02-05 19:02:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 19:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 19:02:32 [DEBUG   ] spawn_process: at 2019-02-05 19:02:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 19:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 19:02:32 [DEBUG   ] spawn_process: at 2019-02-05 19:02:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 19:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 19:02:32 [DEBUG   ] spawn_process: at 2019-02-05 19:02:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 19:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 19:02:32 [DEBUG   ] spawn_process: at 2019-02-05 19:02:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 19:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 19:02:32 [DEBUG   ] spawn_process: at 2019-02-05 19:02:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 19:02:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 19:02:32 [DEBUG   ] spawn_process: at 2019-02-05 19:02:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 19:02:35 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-05 19:02:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-05 19:02:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:02:57 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-02-05 19:02:57 [WARNING ] (13, 1, 'bot')
2019-02-05 19:02:57 [WARNING ] (13, 1, 'bot')
2019-02-05 19:02:57 [WARNING ] (13, 1, 'bot')
2019-02-05 19:02:57 [WARNING ] (13, 1, 'bot')
2019-02-05 19:02:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:02:57 [DEBUG   ] Finished updating board flags in 1.023 seconds
2019-02-05 19:03:03 [DEBUG   ] Got command BAM from MCS: ref #1412257
2019-02-05 19:03:03 [INFO    ] Finished processing BAM request
2019-02-05 19:03:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:03:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412257   8 58519 68583029 A  ERROR'
2019-02-05 19:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-02-05 19:03:03 [DEBUG   ] spawn_process: at 2019-02-05 19:03:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-02-05 19:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-02-05 19:03:03 [DEBUG   ] spawn_process: at 2019-02-05 19:03:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-02-05 19:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-02-05 19:03:03 [DEBUG   ] spawn_process: at 2019-02-05 19:03:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-02-05 19:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-02-05 19:03:03 [DEBUG   ] spawn_process: at 2019-02-05 19:03:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-02-05 19:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-02-05 19:03:03 [DEBUG   ] spawn_process: at 2019-02-05 19:03:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-02-05 19:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-02-05 19:03:03 [DEBUG   ] spawn_process: at 2019-02-05 19:03:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-02-05 19:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-02-05 19:03:03 [DEBUG   ] spawn_process: at 2019-02-05 19:03:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-02-05 19:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-02-05 19:03:03 [DEBUG   ] spawn_process: at 2019-02-05 19:03:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-02-05 19:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-02-05 19:03:03 [DEBUG   ] spawn_process: at 2019-02-05 19:03:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-02-05 19:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-02-05 19:03:03 [DEBUG   ] spawn_process: at 2019-02-05 19:03:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-02-05 19:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-02-05 19:03:03 [DEBUG   ] spawn_process: at 2019-02-05 19:03:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-02-05 19:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-02-05 19:03:03 [DEBUG   ] spawn_process: at 2019-02-05 19:03:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-02-05 19:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-02-05 19:03:03 [DEBUG   ] spawn_process: at 2019-02-05 19:03:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-02-05 19:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-02-05 19:03:03 [DEBUG   ] spawn_process: at 2019-02-05 19:03:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-02-05 19:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-02-05 19:03:03 [DEBUG   ] spawn_process: at 2019-02-05 19:03:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-02-05 19:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-02-05 19:03:03 [DEBUG   ] spawn_process: at 2019-02-05 19:03:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-02-05 19:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-02-05 19:03:03 [DEBUG   ] spawn_process: at 2019-02-05 19:03:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-02-05 19:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-02-05 19:03:03 [DEBUG   ] spawn_process: at 2019-02-05 19:03:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-02-05 19:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-02-05 19:03:03 [DEBUG   ] spawn_process: at 2019-02-05 19:03:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-02-05 19:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-02-05 19:03:03 [DEBUG   ] spawn_process: at 2019-02-05 19:03:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-02-05 19:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-02-05 19:03:03 [DEBUG   ] spawn_process: at 2019-02-05 19:03:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-02-05 19:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-02-05 19:03:03 [DEBUG   ] spawn_process: at 2019-02-05 19:03:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-02-05 19:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-02-05 19:03:03 [DEBUG   ] spawn_process: at 2019-02-05 19:03:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-02-05 19:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-02-05 19:03:03 [DEBUG   ] spawn_process: at 2019-02-05 19:03:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-02-05 19:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-02-05 19:03:03 [DEBUG   ] spawn_process: at 2019-02-05 19:03:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-02-05 19:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-02-05 19:03:03 [DEBUG   ] spawn_process: at 2019-02-05 19:03:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-02-05 19:03:15 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-05 19:03:34 [DEBUG   ] Got command BAM from MCS: ref #1412258
2019-02-05 19:03:34 [INFO    ] Finished processing BAM request
2019-02-05 19:03:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:03:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412258   8 58519 68614025 A  ERROR'
2019-02-05 19:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-02-05 19:03:34 [DEBUG   ] spawn_process: at 2019-02-05 19:03:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-02-05 19:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-02-05 19:03:34 [DEBUG   ] spawn_process: at 2019-02-05 19:03:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-02-05 19:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-02-05 19:03:34 [DEBUG   ] spawn_process: at 2019-02-05 19:03:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-02-05 19:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-02-05 19:03:34 [DEBUG   ] spawn_process: at 2019-02-05 19:03:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-02-05 19:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-02-05 19:03:34 [DEBUG   ] spawn_process: at 2019-02-05 19:03:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-02-05 19:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-02-05 19:03:34 [DEBUG   ] spawn_process: at 2019-02-05 19:03:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-02-05 19:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-02-05 19:03:34 [DEBUG   ] spawn_process: at 2019-02-05 19:03:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-02-05 19:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-02-05 19:03:34 [DEBUG   ] spawn_process: at 2019-02-05 19:03:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-02-05 19:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-02-05 19:03:34 [DEBUG   ] spawn_process: at 2019-02-05 19:03:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-02-05 19:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-02-05 19:03:34 [DEBUG   ] spawn_process: at 2019-02-05 19:03:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-02-05 19:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-02-05 19:03:34 [DEBUG   ] spawn_process: at 2019-02-05 19:03:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-02-05 19:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-02-05 19:03:34 [DEBUG   ] spawn_process: at 2019-02-05 19:03:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-02-05 19:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-02-05 19:03:34 [DEBUG   ] spawn_process: at 2019-02-05 19:03:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-02-05 19:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-02-05 19:03:34 [DEBUG   ] spawn_process: at 2019-02-05 19:03:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-02-05 19:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-02-05 19:03:34 [DEBUG   ] spawn_process: at 2019-02-05 19:03:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-02-05 19:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-02-05 19:03:34 [DEBUG   ] spawn_process: at 2019-02-05 19:03:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-02-05 19:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-02-05 19:03:34 [DEBUG   ] spawn_process: at 2019-02-05 19:03:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-02-05 19:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-02-05 19:03:34 [DEBUG   ] spawn_process: at 2019-02-05 19:03:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-02-05 19:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-02-05 19:03:34 [DEBUG   ] spawn_process: at 2019-02-05 19:03:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-02-05 19:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-02-05 19:03:34 [DEBUG   ] spawn_process: at 2019-02-05 19:03:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-02-05 19:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-02-05 19:03:34 [DEBUG   ] spawn_process: at 2019-02-05 19:03:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-02-05 19:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-02-05 19:03:34 [DEBUG   ] spawn_process: at 2019-02-05 19:03:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-02-05 19:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-02-05 19:03:34 [DEBUG   ] spawn_process: at 2019-02-05 19:03:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-02-05 19:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-02-05 19:03:34 [DEBUG   ] spawn_process: at 2019-02-05 19:03:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-02-05 19:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-02-05 19:03:34 [DEBUG   ] spawn_process: at 2019-02-05 19:03:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-02-05 19:03:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-02-05 19:03:34 [DEBUG   ] spawn_process: at 2019-02-05 19:03:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-02-05 19:03:35 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 19:03:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-05 19:03:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:03:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 19:03:57 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-02-05 19:03:57 [WARNING ] (13, 1, 'bot')
2019-02-05 19:03:57 [WARNING ] (13, 1, 'bot')
2019-02-05 19:03:57 [WARNING ] (13, 1, 'bot')
2019-02-05 19:03:57 [WARNING ] (13, 1, 'bot')
2019-02-05 19:03:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:03:57 [DEBUG   ] Finished updating board flags in 1.025 seconds
2019-02-05 19:03:58 [DEBUG   ] Got command BAM from MCS: ref #1412259
2019-02-05 19:03:58 [INFO    ] Finished processing BAM request
2019-02-05 19:03:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:03:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412259   8 58519 68638029 A  ERROR'
2019-02-05 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-02-05 19:03:58 [DEBUG   ] spawn_process: at 2019-02-05 19:03:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-02-05 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-02-05 19:03:58 [DEBUG   ] spawn_process: at 2019-02-05 19:03:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-02-05 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-02-05 19:03:58 [DEBUG   ] spawn_process: at 2019-02-05 19:03:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-02-05 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-02-05 19:03:58 [DEBUG   ] spawn_process: at 2019-02-05 19:03:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-02-05 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-02-05 19:03:58 [DEBUG   ] spawn_process: at 2019-02-05 19:03:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-02-05 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-02-05 19:03:58 [DEBUG   ] spawn_process: at 2019-02-05 19:03:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-02-05 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-02-05 19:03:58 [DEBUG   ] spawn_process: at 2019-02-05 19:03:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-02-05 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-02-05 19:03:58 [DEBUG   ] spawn_process: at 2019-02-05 19:03:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-02-05 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-02-05 19:03:58 [DEBUG   ] spawn_process: at 2019-02-05 19:03:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-02-05 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-02-05 19:03:58 [DEBUG   ] spawn_process: at 2019-02-05 19:03:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-02-05 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-02-05 19:03:58 [DEBUG   ] spawn_process: at 2019-02-05 19:03:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-02-05 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-02-05 19:03:58 [DEBUG   ] spawn_process: at 2019-02-05 19:03:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-02-05 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-02-05 19:03:58 [DEBUG   ] spawn_process: at 2019-02-05 19:03:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-02-05 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-02-05 19:03:58 [DEBUG   ] spawn_process: at 2019-02-05 19:03:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-02-05 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-02-05 19:03:58 [DEBUG   ] spawn_process: at 2019-02-05 19:03:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-02-05 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-02-05 19:03:58 [DEBUG   ] spawn_process: at 2019-02-05 19:03:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-02-05 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-02-05 19:03:58 [DEBUG   ] spawn_process: at 2019-02-05 19:03:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-02-05 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-02-05 19:03:58 [DEBUG   ] spawn_process: at 2019-02-05 19:03:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-02-05 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-02-05 19:03:58 [DEBUG   ] spawn_process: at 2019-02-05 19:03:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-02-05 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-02-05 19:03:58 [DEBUG   ] spawn_process: at 2019-02-05 19:03:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-02-05 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-02-05 19:03:58 [DEBUG   ] spawn_process: at 2019-02-05 19:03:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-02-05 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-02-05 19:03:58 [DEBUG   ] spawn_process: at 2019-02-05 19:03:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-02-05 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-02-05 19:03:58 [DEBUG   ] spawn_process: at 2019-02-05 19:03:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-02-05 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-02-05 19:03:58 [DEBUG   ] spawn_process: at 2019-02-05 19:03:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-02-05 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-02-05 19:03:58 [DEBUG   ] spawn_process: at 2019-02-05 19:03:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-02-05 19:03:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-02-05 19:03:58 [DEBUG   ] spawn_process: at 2019-02-05 19:03:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-02-05 19:04:06 [DEBUG   ] Got command BAM from MCS: ref #1412260
2019-02-05 19:04:06 [INFO    ] Finished processing BAM request
2019-02-05 19:04:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412260   8 58519 68646033 A  ERROR'
2019-02-05 19:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-02-05 19:04:06 [DEBUG   ] spawn_process: at 2019-02-05 19:04:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-02-05 19:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-02-05 19:04:06 [DEBUG   ] spawn_process: at 2019-02-05 19:04:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-02-05 19:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-02-05 19:04:06 [DEBUG   ] spawn_process: at 2019-02-05 19:04:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-02-05 19:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-02-05 19:04:06 [DEBUG   ] spawn_process: at 2019-02-05 19:04:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-02-05 19:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-02-05 19:04:06 [DEBUG   ] spawn_process: at 2019-02-05 19:04:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-02-05 19:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-02-05 19:04:06 [DEBUG   ] spawn_process: at 2019-02-05 19:04:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-02-05 19:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-02-05 19:04:06 [DEBUG   ] spawn_process: at 2019-02-05 19:04:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-02-05 19:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-02-05 19:04:06 [DEBUG   ] spawn_process: at 2019-02-05 19:04:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-02-05 19:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-02-05 19:04:06 [DEBUG   ] spawn_process: at 2019-02-05 19:04:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-02-05 19:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-02-05 19:04:06 [DEBUG   ] spawn_process: at 2019-02-05 19:04:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-02-05 19:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-02-05 19:04:06 [DEBUG   ] spawn_process: at 2019-02-05 19:04:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-02-05 19:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-02-05 19:04:06 [DEBUG   ] spawn_process: at 2019-02-05 19:04:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-02-05 19:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-02-05 19:04:06 [DEBUG   ] spawn_process: at 2019-02-05 19:04:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-02-05 19:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-02-05 19:04:06 [DEBUG   ] spawn_process: at 2019-02-05 19:04:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-02-05 19:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-02-05 19:04:06 [DEBUG   ] spawn_process: at 2019-02-05 19:04:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-02-05 19:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-02-05 19:04:06 [DEBUG   ] spawn_process: at 2019-02-05 19:04:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-02-05 19:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-02-05 19:04:06 [DEBUG   ] spawn_process: at 2019-02-05 19:04:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-02-05 19:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-02-05 19:04:06 [DEBUG   ] spawn_process: at 2019-02-05 19:04:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-02-05 19:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-02-05 19:04:06 [DEBUG   ] spawn_process: at 2019-02-05 19:04:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-02-05 19:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-02-05 19:04:06 [DEBUG   ] spawn_process: at 2019-02-05 19:04:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-02-05 19:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-02-05 19:04:06 [DEBUG   ] spawn_process: at 2019-02-05 19:04:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-02-05 19:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-02-05 19:04:06 [DEBUG   ] spawn_process: at 2019-02-05 19:04:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-02-05 19:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-02-05 19:04:06 [DEBUG   ] spawn_process: at 2019-02-05 19:04:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-02-05 19:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-02-05 19:04:06 [DEBUG   ] spawn_process: at 2019-02-05 19:04:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-02-05 19:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-02-05 19:04:06 [DEBUG   ] spawn_process: at 2019-02-05 19:04:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-02-05 19:04:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-02-05 19:04:06 [DEBUG   ] spawn_process: at 2019-02-05 19:04:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-02-05 19:04:15 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 19:04:35 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 19:04:38 [DEBUG   ] Got command BAM from MCS: ref #1412263
2019-02-05 19:04:38 [INFO    ] Finished processing BAM request
2019-02-05 19:04:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:04:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412263   8 58519 68678029 A  ERROR'
2019-02-05 19:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 19:04:38 [DEBUG   ] spawn_process: at 2019-02-05 19:04:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 19:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 19:04:38 [DEBUG   ] spawn_process: at 2019-02-05 19:04:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 19:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 19:04:38 [DEBUG   ] spawn_process: at 2019-02-05 19:04:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 19:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 19:04:38 [DEBUG   ] spawn_process: at 2019-02-05 19:04:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 19:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 19:04:38 [DEBUG   ] spawn_process: at 2019-02-05 19:04:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 19:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 19:04:38 [DEBUG   ] spawn_process: at 2019-02-05 19:04:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 19:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 19:04:38 [DEBUG   ] spawn_process: at 2019-02-05 19:04:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 19:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 19:04:38 [DEBUG   ] spawn_process: at 2019-02-05 19:04:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 19:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 19:04:38 [DEBUG   ] spawn_process: at 2019-02-05 19:04:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 19:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 19:04:38 [DEBUG   ] spawn_process: at 2019-02-05 19:04:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 19:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 19:04:38 [DEBUG   ] spawn_process: at 2019-02-05 19:04:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 19:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 19:04:38 [DEBUG   ] spawn_process: at 2019-02-05 19:04:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 19:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 19:04:38 [DEBUG   ] spawn_process: at 2019-02-05 19:04:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 19:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 19:04:38 [DEBUG   ] spawn_process: at 2019-02-05 19:04:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 19:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 19:04:38 [DEBUG   ] spawn_process: at 2019-02-05 19:04:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 19:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 19:04:38 [DEBUG   ] spawn_process: at 2019-02-05 19:04:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 19:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 19:04:38 [DEBUG   ] spawn_process: at 2019-02-05 19:04:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 19:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 19:04:38 [DEBUG   ] spawn_process: at 2019-02-05 19:04:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 19:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 19:04:38 [DEBUG   ] spawn_process: at 2019-02-05 19:04:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 19:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 19:04:38 [DEBUG   ] spawn_process: at 2019-02-05 19:04:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 19:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 19:04:38 [DEBUG   ] spawn_process: at 2019-02-05 19:04:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 19:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 19:04:38 [DEBUG   ] spawn_process: at 2019-02-05 19:04:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 19:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 19:04:38 [DEBUG   ] spawn_process: at 2019-02-05 19:04:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 19:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 19:04:38 [DEBUG   ] spawn_process: at 2019-02-05 19:04:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 19:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 19:04:38 [DEBUG   ] spawn_process: at 2019-02-05 19:04:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 19:04:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 19:04:38 [DEBUG   ] spawn_process: at 2019-02-05 19:04:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 19:04:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-05 19:04:55 [DEBUG   ] Got command RPT from MCS: ref #1412264
2019-02-05 19:04:55 [DEBUG   ] summary = ERROR
2019-02-05 19:04:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412264  13 58519 68695357 A  ERRORERROR'
2019-02-05 19:04:55 [DEBUG   ] Got command RPT from MCS: ref #1412265
2019-02-05 19:04:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 19:04:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412265  77 58519 68695561 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 19:04:55 [DEBUG   ] Got command RPT from MCS: ref #1412266
2019-02-05 19:04:55 [DEBUG   ] summary = ERROR
2019-02-05 19:04:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412266  13 58519 68695765 A  ERRORERROR'
2019-02-05 19:04:55 [DEBUG   ] Got command RPT from MCS: ref #1412268
2019-02-05 19:04:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 19:04:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412268  77 58519 68695969 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 19:04:56 [DEBUG   ] Got command RPT from MCS: ref #1412270
2019-02-05 19:04:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 19:04:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412270  12 58519 68696161 A  ERRORB£ff'
2019-02-05 19:04:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:04:57 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-02-05 19:04:57 [WARNING ] (13, 1, 'bot')
2019-02-05 19:04:57 [WARNING ] (13, 1, 'bot')
2019-02-05 19:04:57 [WARNING ] (13, 1, 'bot')
2019-02-05 19:04:57 [WARNING ] (13, 1, 'bot')
2019-02-05 19:04:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:04:57 [DEBUG   ] Finished updating board flags in 0.946 seconds
2019-02-05 19:05:11 [DEBUG   ] Got command BAM from MCS: ref #1412274
2019-02-05 19:05:11 [INFO    ] Finished processing BAM request
2019-02-05 19:05:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:05:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412274   8 58519 68711025 A  ERROR'
2019-02-05 19:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-02-05 19:05:11 [DEBUG   ] spawn_process: at 2019-02-05 19:05:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-02-05 19:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-02-05 19:05:11 [DEBUG   ] spawn_process: at 2019-02-05 19:05:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-02-05 19:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-02-05 19:05:11 [DEBUG   ] spawn_process: at 2019-02-05 19:05:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-02-05 19:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-02-05 19:05:11 [DEBUG   ] spawn_process: at 2019-02-05 19:05:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-02-05 19:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-02-05 19:05:11 [DEBUG   ] spawn_process: at 2019-02-05 19:05:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-02-05 19:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-02-05 19:05:11 [DEBUG   ] spawn_process: at 2019-02-05 19:05:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-02-05 19:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-02-05 19:05:11 [DEBUG   ] spawn_process: at 2019-02-05 19:05:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-02-05 19:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-02-05 19:05:11 [DEBUG   ] spawn_process: at 2019-02-05 19:05:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-02-05 19:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-02-05 19:05:11 [DEBUG   ] spawn_process: at 2019-02-05 19:05:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-02-05 19:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-02-05 19:05:11 [DEBUG   ] spawn_process: at 2019-02-05 19:05:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-02-05 19:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-02-05 19:05:11 [DEBUG   ] spawn_process: at 2019-02-05 19:05:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-02-05 19:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-02-05 19:05:11 [DEBUG   ] spawn_process: at 2019-02-05 19:05:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-02-05 19:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-02-05 19:05:11 [DEBUG   ] spawn_process: at 2019-02-05 19:05:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-02-05 19:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-02-05 19:05:11 [DEBUG   ] spawn_process: at 2019-02-05 19:05:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-02-05 19:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-02-05 19:05:11 [DEBUG   ] spawn_process: at 2019-02-05 19:05:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-02-05 19:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-02-05 19:05:11 [DEBUG   ] spawn_process: at 2019-02-05 19:05:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-02-05 19:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-02-05 19:05:11 [DEBUG   ] spawn_process: at 2019-02-05 19:05:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-02-05 19:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-02-05 19:05:11 [DEBUG   ] spawn_process: at 2019-02-05 19:05:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-02-05 19:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-02-05 19:05:11 [DEBUG   ] spawn_process: at 2019-02-05 19:05:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-02-05 19:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-02-05 19:05:11 [DEBUG   ] spawn_process: at 2019-02-05 19:05:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-02-05 19:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-02-05 19:05:11 [DEBUG   ] spawn_process: at 2019-02-05 19:05:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-02-05 19:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-02-05 19:05:11 [DEBUG   ] spawn_process: at 2019-02-05 19:05:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-02-05 19:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-02-05 19:05:11 [DEBUG   ] spawn_process: at 2019-02-05 19:05:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-02-05 19:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-02-05 19:05:11 [DEBUG   ] spawn_process: at 2019-02-05 19:05:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-02-05 19:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-02-05 19:05:11 [DEBUG   ] spawn_process: at 2019-02-05 19:05:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-02-05 19:05:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-02-05 19:05:11 [DEBUG   ] spawn_process: at 2019-02-05 19:05:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-02-05 19:05:15 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 19:05:35 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-05 19:05:44 [DEBUG   ] Got command BAM from MCS: ref #1412279
2019-02-05 19:05:44 [INFO    ] Finished processing BAM request
2019-02-05 19:05:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:05:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412279   8 58519 68744029 A  ERROR'
2019-02-05 19:05:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 19:05:44 [DEBUG   ] spawn_process: at 2019-02-05 19:05:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 19:05:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 19:05:44 [DEBUG   ] spawn_process: at 2019-02-05 19:05:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 19:05:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 19:05:44 [DEBUG   ] spawn_process: at 2019-02-05 19:05:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 19:05:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 19:05:44 [DEBUG   ] spawn_process: at 2019-02-05 19:05:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 19:05:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 19:05:44 [DEBUG   ] spawn_process: at 2019-02-05 19:05:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 19:05:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 19:05:44 [DEBUG   ] spawn_process: at 2019-02-05 19:05:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 19:05:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 19:05:44 [DEBUG   ] spawn_process: at 2019-02-05 19:05:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 19:05:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 19:05:44 [DEBUG   ] spawn_process: at 2019-02-05 19:05:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 19:05:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 19:05:44 [DEBUG   ] spawn_process: at 2019-02-05 19:05:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 19:05:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 19:05:44 [DEBUG   ] spawn_process: at 2019-02-05 19:05:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 19:05:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 19:05:44 [DEBUG   ] spawn_process: at 2019-02-05 19:05:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 19:05:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 19:05:44 [DEBUG   ] spawn_process: at 2019-02-05 19:05:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 19:05:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 19:05:44 [DEBUG   ] spawn_process: at 2019-02-05 19:05:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 19:05:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 19:05:44 [DEBUG   ] spawn_process: at 2019-02-05 19:05:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 19:05:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 19:05:44 [DEBUG   ] spawn_process: at 2019-02-05 19:05:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 19:05:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 19:05:44 [DEBUG   ] spawn_process: at 2019-02-05 19:05:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 19:05:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 19:05:44 [DEBUG   ] spawn_process: at 2019-02-05 19:05:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 19:05:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 19:05:44 [DEBUG   ] spawn_process: at 2019-02-05 19:05:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 19:05:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 19:05:44 [DEBUG   ] spawn_process: at 2019-02-05 19:05:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 19:05:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 19:05:44 [DEBUG   ] spawn_process: at 2019-02-05 19:05:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 19:05:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 19:05:44 [DEBUG   ] spawn_process: at 2019-02-05 19:05:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 19:05:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 19:05:44 [DEBUG   ] spawn_process: at 2019-02-05 19:05:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 19:05:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 19:05:44 [DEBUG   ] spawn_process: at 2019-02-05 19:05:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 19:05:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 19:05:44 [DEBUG   ] spawn_process: at 2019-02-05 19:05:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 19:05:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 19:05:44 [DEBUG   ] spawn_process: at 2019-02-05 19:05:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 19:05:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 19:05:44 [DEBUG   ] spawn_process: at 2019-02-05 19:05:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 19:05:45 [DEBUG   ] Got command BAM from MCS: ref #1412280
2019-02-05 19:05:45 [INFO    ] Finished processing BAM request
2019-02-05 19:05:45 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:05:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412280   8 58519 68745029 A  ERROR'
2019-02-05 19:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-02-05 19:05:45 [DEBUG   ] spawn_process: at 2019-02-05 19:05:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-02-05 19:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-02-05 19:05:45 [DEBUG   ] spawn_process: at 2019-02-05 19:05:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-02-05 19:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-02-05 19:05:45 [DEBUG   ] spawn_process: at 2019-02-05 19:05:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-02-05 19:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-02-05 19:05:45 [DEBUG   ] spawn_process: at 2019-02-05 19:05:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-02-05 19:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-02-05 19:05:45 [DEBUG   ] spawn_process: at 2019-02-05 19:05:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-02-05 19:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-02-05 19:05:45 [DEBUG   ] spawn_process: at 2019-02-05 19:05:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-02-05 19:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-02-05 19:05:45 [DEBUG   ] spawn_process: at 2019-02-05 19:05:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-02-05 19:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-02-05 19:05:45 [DEBUG   ] spawn_process: at 2019-02-05 19:05:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-02-05 19:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-02-05 19:05:45 [DEBUG   ] spawn_process: at 2019-02-05 19:05:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-02-05 19:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-02-05 19:05:45 [DEBUG   ] spawn_process: at 2019-02-05 19:05:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-02-05 19:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-02-05 19:05:45 [DEBUG   ] spawn_process: at 2019-02-05 19:05:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-02-05 19:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-02-05 19:05:45 [DEBUG   ] spawn_process: at 2019-02-05 19:05:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-02-05 19:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-02-05 19:05:45 [DEBUG   ] spawn_process: at 2019-02-05 19:05:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-02-05 19:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-02-05 19:05:45 [DEBUG   ] spawn_process: at 2019-02-05 19:05:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-02-05 19:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-02-05 19:05:45 [DEBUG   ] spawn_process: at 2019-02-05 19:05:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-02-05 19:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-02-05 19:05:45 [DEBUG   ] spawn_process: at 2019-02-05 19:05:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-02-05 19:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-02-05 19:05:45 [DEBUG   ] spawn_process: at 2019-02-05 19:05:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-02-05 19:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-02-05 19:05:45 [DEBUG   ] spawn_process: at 2019-02-05 19:05:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-02-05 19:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-02-05 19:05:45 [DEBUG   ] spawn_process: at 2019-02-05 19:05:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-02-05 19:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-02-05 19:05:45 [DEBUG   ] spawn_process: at 2019-02-05 19:05:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-02-05 19:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-02-05 19:05:45 [DEBUG   ] spawn_process: at 2019-02-05 19:05:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-02-05 19:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-02-05 19:05:45 [DEBUG   ] spawn_process: at 2019-02-05 19:05:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-02-05 19:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-02-05 19:05:45 [DEBUG   ] spawn_process: at 2019-02-05 19:05:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-02-05 19:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-02-05 19:05:45 [DEBUG   ] spawn_process: at 2019-02-05 19:05:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-02-05 19:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-02-05 19:05:45 [DEBUG   ] spawn_process: at 2019-02-05 19:05:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-02-05 19:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-02-05 19:05:45 [DEBUG   ] spawn_process: at 2019-02-05 19:05:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-02-05 19:05:55 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 19:05:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-02-05 19:05:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2019-02-05 19:05:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:05:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 19:05:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-02-05 19:05:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-05 19:05:58 [WARNING ] (13, 1, 'bot')
2019-02-05 19:05:58 [WARNING ] (13, 1, 'bot')
2019-02-05 19:05:58 [WARNING ] (13, 1, 'bot')
2019-02-05 19:05:58 [WARNING ] (13, 1, 'bot')
2019-02-05 19:05:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:05:58 [DEBUG   ] Finished updating board flags in 1.369 seconds
2019-02-05 19:06:12 [DEBUG   ] Got command RPT from MCS: ref #1412281
2019-02-05 19:06:12 [DEBUG   ] summary = ERROR
2019-02-05 19:06:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412281  13 58519 68772009 A  ERRORERROR'
2019-02-05 19:06:12 [DEBUG   ] Got command RPT from MCS: ref #1412282
2019-02-05 19:06:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 19:06:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412282  77 58519 68772010 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 19:06:15 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 19:06:18 [DEBUG   ] Got command BAM from MCS: ref #1412298
2019-02-05 19:06:18 [INFO    ] Finished processing BAM request
2019-02-05 19:06:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:06:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412298   8 58519 68778025 A  ERROR'
2019-02-05 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 19:06:18 [DEBUG   ] spawn_process: at 2019-02-05 19:06:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 19:06:18 [DEBUG   ] spawn_process: at 2019-02-05 19:06:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 19:06:18 [DEBUG   ] spawn_process: at 2019-02-05 19:06:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 19:06:18 [DEBUG   ] spawn_process: at 2019-02-05 19:06:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 19:06:18 [DEBUG   ] spawn_process: at 2019-02-05 19:06:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 19:06:18 [DEBUG   ] spawn_process: at 2019-02-05 19:06:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 19:06:18 [DEBUG   ] spawn_process: at 2019-02-05 19:06:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 19:06:18 [DEBUG   ] spawn_process: at 2019-02-05 19:06:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 19:06:18 [DEBUG   ] spawn_process: at 2019-02-05 19:06:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 19:06:18 [DEBUG   ] spawn_process: at 2019-02-05 19:06:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 19:06:18 [DEBUG   ] spawn_process: at 2019-02-05 19:06:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 19:06:18 [DEBUG   ] spawn_process: at 2019-02-05 19:06:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 19:06:18 [DEBUG   ] spawn_process: at 2019-02-05 19:06:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 19:06:18 [DEBUG   ] spawn_process: at 2019-02-05 19:06:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 19:06:18 [DEBUG   ] spawn_process: at 2019-02-05 19:06:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 19:06:18 [DEBUG   ] spawn_process: at 2019-02-05 19:06:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 19:06:18 [DEBUG   ] spawn_process: at 2019-02-05 19:06:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 19:06:18 [DEBUG   ] spawn_process: at 2019-02-05 19:06:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 19:06:18 [DEBUG   ] spawn_process: at 2019-02-05 19:06:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 19:06:18 [DEBUG   ] spawn_process: at 2019-02-05 19:06:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 19:06:18 [DEBUG   ] spawn_process: at 2019-02-05 19:06:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 19:06:18 [DEBUG   ] spawn_process: at 2019-02-05 19:06:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 19:06:18 [DEBUG   ] spawn_process: at 2019-02-05 19:06:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 19:06:18 [DEBUG   ] spawn_process: at 2019-02-05 19:06:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 19:06:18 [DEBUG   ] spawn_process: at 2019-02-05 19:06:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 19:06:18 [DEBUG   ] spawn_process: at 2019-02-05 19:06:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 19:06:35 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-05 19:06:53 [DEBUG   ] Got command BAM from MCS: ref #1412299
2019-02-05 19:06:53 [INFO    ] Finished processing BAM request
2019-02-05 19:06:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:06:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412299   8 58519 68813029 A  ERROR'
2019-02-05 19:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 19:06:53 [DEBUG   ] spawn_process: at 2019-02-05 19:06:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 19:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 19:06:53 [DEBUG   ] spawn_process: at 2019-02-05 19:06:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 19:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 19:06:53 [DEBUG   ] spawn_process: at 2019-02-05 19:06:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 19:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 19:06:53 [DEBUG   ] spawn_process: at 2019-02-05 19:06:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 19:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 19:06:53 [DEBUG   ] spawn_process: at 2019-02-05 19:06:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 19:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 19:06:53 [DEBUG   ] spawn_process: at 2019-02-05 19:06:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 19:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 19:06:53 [DEBUG   ] spawn_process: at 2019-02-05 19:06:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 19:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 19:06:53 [DEBUG   ] spawn_process: at 2019-02-05 19:06:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 19:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 19:06:53 [DEBUG   ] spawn_process: at 2019-02-05 19:06:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 19:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 19:06:53 [DEBUG   ] spawn_process: at 2019-02-05 19:06:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 19:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 19:06:53 [DEBUG   ] spawn_process: at 2019-02-05 19:06:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 19:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 19:06:53 [DEBUG   ] spawn_process: at 2019-02-05 19:06:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 19:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 19:06:53 [DEBUG   ] spawn_process: at 2019-02-05 19:06:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 19:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 19:06:53 [DEBUG   ] spawn_process: at 2019-02-05 19:06:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 19:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 19:06:53 [DEBUG   ] spawn_process: at 2019-02-05 19:06:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 19:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 19:06:53 [DEBUG   ] spawn_process: at 2019-02-05 19:06:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 19:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 19:06:53 [DEBUG   ] spawn_process: at 2019-02-05 19:06:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 19:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 19:06:53 [DEBUG   ] spawn_process: at 2019-02-05 19:06:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 19:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 19:06:53 [DEBUG   ] spawn_process: at 2019-02-05 19:06:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 19:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 19:06:53 [DEBUG   ] spawn_process: at 2019-02-05 19:06:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 19:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 19:06:53 [DEBUG   ] spawn_process: at 2019-02-05 19:06:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 19:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 19:06:53 [DEBUG   ] spawn_process: at 2019-02-05 19:06:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 19:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 19:06:53 [DEBUG   ] spawn_process: at 2019-02-05 19:06:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 19:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 19:06:53 [DEBUG   ] spawn_process: at 2019-02-05 19:06:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 19:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 19:06:53 [DEBUG   ] spawn_process: at 2019-02-05 19:06:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 19:06:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 19:06:53 [DEBUG   ] spawn_process: at 2019-02-05 19:06:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 19:06:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-05 19:06:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-02-05 19:06:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:06:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-02-05 19:06:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-05 19:06:58 [WARNING ] (13, 1, 'bot')
2019-02-05 19:06:58 [WARNING ] (13, 1, 'bot')
2019-02-05 19:06:58 [WARNING ] (13, 1, 'bot')
2019-02-05 19:06:58 [WARNING ] (13, 1, 'bot')
2019-02-05 19:06:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:06:58 [DEBUG   ] Finished updating board flags in 1.183 seconds
2019-02-05 19:07:15 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-05 19:07:28 [DEBUG   ] Got command BAM from MCS: ref #1412300
2019-02-05 19:07:28 [INFO    ] Finished processing BAM request
2019-02-05 19:07:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:07:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412300   8 58519 68848029 A  ERROR'
2019-02-05 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-02-05 19:07:28 [DEBUG   ] spawn_process: at 2019-02-05 19:07:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-02-05 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-02-05 19:07:28 [DEBUG   ] spawn_process: at 2019-02-05 19:07:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-02-05 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-02-05 19:07:28 [DEBUG   ] spawn_process: at 2019-02-05 19:07:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-02-05 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-02-05 19:07:28 [DEBUG   ] spawn_process: at 2019-02-05 19:07:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-02-05 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-02-05 19:07:28 [DEBUG   ] spawn_process: at 2019-02-05 19:07:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-02-05 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-02-05 19:07:28 [DEBUG   ] spawn_process: at 2019-02-05 19:07:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-02-05 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-02-05 19:07:28 [DEBUG   ] spawn_process: at 2019-02-05 19:07:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-02-05 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-02-05 19:07:28 [DEBUG   ] spawn_process: at 2019-02-05 19:07:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-02-05 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-02-05 19:07:28 [DEBUG   ] spawn_process: at 2019-02-05 19:07:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-02-05 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-02-05 19:07:28 [DEBUG   ] spawn_process: at 2019-02-05 19:07:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-02-05 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-02-05 19:07:28 [DEBUG   ] spawn_process: at 2019-02-05 19:07:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-02-05 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-02-05 19:07:28 [DEBUG   ] spawn_process: at 2019-02-05 19:07:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-02-05 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-02-05 19:07:28 [DEBUG   ] spawn_process: at 2019-02-05 19:07:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-02-05 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-02-05 19:07:28 [DEBUG   ] spawn_process: at 2019-02-05 19:07:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-02-05 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-02-05 19:07:28 [DEBUG   ] spawn_process: at 2019-02-05 19:07:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-02-05 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-02-05 19:07:28 [DEBUG   ] spawn_process: at 2019-02-05 19:07:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-02-05 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-02-05 19:07:28 [DEBUG   ] spawn_process: at 2019-02-05 19:07:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-02-05 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-02-05 19:07:28 [DEBUG   ] spawn_process: at 2019-02-05 19:07:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-02-05 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-02-05 19:07:28 [DEBUG   ] spawn_process: at 2019-02-05 19:07:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-02-05 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-02-05 19:07:28 [DEBUG   ] spawn_process: at 2019-02-05 19:07:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-02-05 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-02-05 19:07:28 [DEBUG   ] spawn_process: at 2019-02-05 19:07:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-02-05 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-02-05 19:07:28 [DEBUG   ] spawn_process: at 2019-02-05 19:07:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-02-05 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-02-05 19:07:28 [DEBUG   ] spawn_process: at 2019-02-05 19:07:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-02-05 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-02-05 19:07:28 [DEBUG   ] spawn_process: at 2019-02-05 19:07:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-02-05 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-02-05 19:07:28 [DEBUG   ] spawn_process: at 2019-02-05 19:07:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-02-05 19:07:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-02-05 19:07:28 [DEBUG   ] spawn_process: at 2019-02-05 19:07:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-02-05 19:07:31 [DEBUG   ] Got command BAM from MCS: ref #1412301
2019-02-05 19:07:31 [INFO    ] Finished processing BAM request
2019-02-05 19:07:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:07:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412301   8 58519 68851033 A  ERROR'
2019-02-05 19:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 19:07:31 [DEBUG   ] spawn_process: at 2019-02-05 19:07:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 19:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 19:07:31 [DEBUG   ] spawn_process: at 2019-02-05 19:07:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 19:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 19:07:31 [DEBUG   ] spawn_process: at 2019-02-05 19:07:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 19:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 19:07:31 [DEBUG   ] spawn_process: at 2019-02-05 19:07:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 19:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 19:07:31 [DEBUG   ] spawn_process: at 2019-02-05 19:07:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 19:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 19:07:31 [DEBUG   ] spawn_process: at 2019-02-05 19:07:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 19:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 19:07:31 [DEBUG   ] spawn_process: at 2019-02-05 19:07:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 19:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 19:07:31 [DEBUG   ] spawn_process: at 2019-02-05 19:07:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 19:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 19:07:31 [DEBUG   ] spawn_process: at 2019-02-05 19:07:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 19:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 19:07:31 [DEBUG   ] spawn_process: at 2019-02-05 19:07:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 19:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 19:07:31 [DEBUG   ] spawn_process: at 2019-02-05 19:07:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 19:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 19:07:31 [DEBUG   ] spawn_process: at 2019-02-05 19:07:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 19:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 19:07:31 [DEBUG   ] spawn_process: at 2019-02-05 19:07:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 19:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 19:07:31 [DEBUG   ] spawn_process: at 2019-02-05 19:07:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 19:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 19:07:31 [DEBUG   ] spawn_process: at 2019-02-05 19:07:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 19:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 19:07:31 [DEBUG   ] spawn_process: at 2019-02-05 19:07:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 19:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 19:07:31 [DEBUG   ] spawn_process: at 2019-02-05 19:07:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 19:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 19:07:31 [DEBUG   ] spawn_process: at 2019-02-05 19:07:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 19:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 19:07:31 [DEBUG   ] spawn_process: at 2019-02-05 19:07:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 19:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 19:07:31 [DEBUG   ] spawn_process: at 2019-02-05 19:07:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 19:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 19:07:31 [DEBUG   ] spawn_process: at 2019-02-05 19:07:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 19:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 19:07:31 [DEBUG   ] spawn_process: at 2019-02-05 19:07:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 19:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 19:07:31 [DEBUG   ] spawn_process: at 2019-02-05 19:07:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 19:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 19:07:31 [DEBUG   ] spawn_process: at 2019-02-05 19:07:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 19:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 19:07:31 [DEBUG   ] spawn_process: at 2019-02-05 19:07:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 19:07:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 19:07:31 [DEBUG   ] spawn_process: at 2019-02-05 19:07:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 19:07:35 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-02-05 19:07:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 19:07:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:07:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-02-05 19:07:58 [WARNING ] (13, 1, 'bot')
2019-02-05 19:07:58 [WARNING ] (13, 1, 'bot')
2019-02-05 19:07:58 [WARNING ] (13, 1, 'bot')
2019-02-05 19:07:58 [WARNING ] (13, 1, 'bot')
2019-02-05 19:07:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:07:58 [DEBUG   ] Finished updating board flags in 1.008 seconds
2019-02-05 19:08:04 [DEBUG   ] Got command BAM from MCS: ref #1412302
2019-02-05 19:08:04 [INFO    ] Finished processing BAM request
2019-02-05 19:08:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:08:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412302   8 58519 68884033 A  ERROR'
2019-02-05 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-02-05 19:08:04 [DEBUG   ] spawn_process: at 2019-02-05 19:08:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-02-05 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-02-05 19:08:04 [DEBUG   ] spawn_process: at 2019-02-05 19:08:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-02-05 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-02-05 19:08:04 [DEBUG   ] spawn_process: at 2019-02-05 19:08:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-02-05 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-02-05 19:08:04 [DEBUG   ] spawn_process: at 2019-02-05 19:08:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-02-05 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-02-05 19:08:04 [DEBUG   ] spawn_process: at 2019-02-05 19:08:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-02-05 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-02-05 19:08:04 [DEBUG   ] spawn_process: at 2019-02-05 19:08:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-02-05 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-02-05 19:08:04 [DEBUG   ] spawn_process: at 2019-02-05 19:08:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-02-05 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-02-05 19:08:04 [DEBUG   ] spawn_process: at 2019-02-05 19:08:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-02-05 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-02-05 19:08:04 [DEBUG   ] spawn_process: at 2019-02-05 19:08:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-02-05 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-02-05 19:08:04 [DEBUG   ] spawn_process: at 2019-02-05 19:08:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-02-05 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-02-05 19:08:04 [DEBUG   ] spawn_process: at 2019-02-05 19:08:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-02-05 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-02-05 19:08:04 [DEBUG   ] spawn_process: at 2019-02-05 19:08:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-02-05 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-02-05 19:08:04 [DEBUG   ] spawn_process: at 2019-02-05 19:08:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-02-05 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-02-05 19:08:04 [DEBUG   ] spawn_process: at 2019-02-05 19:08:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-02-05 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-02-05 19:08:04 [DEBUG   ] spawn_process: at 2019-02-05 19:08:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-02-05 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-02-05 19:08:04 [DEBUG   ] spawn_process: at 2019-02-05 19:08:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-02-05 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-02-05 19:08:04 [DEBUG   ] spawn_process: at 2019-02-05 19:08:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-02-05 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-02-05 19:08:04 [DEBUG   ] spawn_process: at 2019-02-05 19:08:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-02-05 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-02-05 19:08:04 [DEBUG   ] spawn_process: at 2019-02-05 19:08:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-02-05 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-02-05 19:08:04 [DEBUG   ] spawn_process: at 2019-02-05 19:08:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-02-05 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-02-05 19:08:04 [DEBUG   ] spawn_process: at 2019-02-05 19:08:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-02-05 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-02-05 19:08:04 [DEBUG   ] spawn_process: at 2019-02-05 19:08:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-02-05 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-02-05 19:08:04 [DEBUG   ] spawn_process: at 2019-02-05 19:08:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-02-05 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-02-05 19:08:04 [DEBUG   ] spawn_process: at 2019-02-05 19:08:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-02-05 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-02-05 19:08:04 [DEBUG   ] spawn_process: at 2019-02-05 19:08:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-02-05 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-02-05 19:08:04 [DEBUG   ] spawn_process: at 2019-02-05 19:08:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-02-05 19:08:16 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-05 19:08:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 19:08:41 [DEBUG   ] Got command BAM from MCS: ref #1412307
2019-02-05 19:08:41 [INFO    ] Finished processing BAM request
2019-02-05 19:08:41 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:08:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412307   8 58519 68921029 A  ERROR'
2019-02-05 19:08:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-02-05 19:08:41 [DEBUG   ] spawn_process: at 2019-02-05 19:08:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-02-05 19:08:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-02-05 19:08:41 [DEBUG   ] spawn_process: at 2019-02-05 19:08:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-02-05 19:08:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-02-05 19:08:41 [DEBUG   ] spawn_process: at 2019-02-05 19:08:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-02-05 19:08:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-02-05 19:08:41 [DEBUG   ] spawn_process: at 2019-02-05 19:08:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-02-05 19:08:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-02-05 19:08:41 [DEBUG   ] spawn_process: at 2019-02-05 19:08:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-02-05 19:08:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-02-05 19:08:41 [DEBUG   ] spawn_process: at 2019-02-05 19:08:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-02-05 19:08:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-02-05 19:08:41 [DEBUG   ] spawn_process: at 2019-02-05 19:08:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-02-05 19:08:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-02-05 19:08:41 [DEBUG   ] spawn_process: at 2019-02-05 19:08:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-02-05 19:08:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-02-05 19:08:41 [DEBUG   ] spawn_process: at 2019-02-05 19:08:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-02-05 19:08:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-02-05 19:08:41 [DEBUG   ] spawn_process: at 2019-02-05 19:08:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-02-05 19:08:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-02-05 19:08:41 [DEBUG   ] spawn_process: at 2019-02-05 19:08:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-02-05 19:08:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-02-05 19:08:41 [DEBUG   ] spawn_process: at 2019-02-05 19:08:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-02-05 19:08:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-02-05 19:08:41 [DEBUG   ] spawn_process: at 2019-02-05 19:08:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-02-05 19:08:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-02-05 19:08:41 [DEBUG   ] spawn_process: at 2019-02-05 19:08:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-02-05 19:08:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-02-05 19:08:41 [DEBUG   ] spawn_process: at 2019-02-05 19:08:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-02-05 19:08:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-02-05 19:08:41 [DEBUG   ] spawn_process: at 2019-02-05 19:08:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-02-05 19:08:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-02-05 19:08:41 [DEBUG   ] spawn_process: at 2019-02-05 19:08:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-02-05 19:08:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-02-05 19:08:41 [DEBUG   ] spawn_process: at 2019-02-05 19:08:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-02-05 19:08:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-02-05 19:08:41 [DEBUG   ] spawn_process: at 2019-02-05 19:08:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-02-05 19:08:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-02-05 19:08:41 [DEBUG   ] spawn_process: at 2019-02-05 19:08:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-02-05 19:08:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-02-05 19:08:41 [DEBUG   ] spawn_process: at 2019-02-05 19:08:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-02-05 19:08:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-02-05 19:08:41 [DEBUG   ] spawn_process: at 2019-02-05 19:08:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-02-05 19:08:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-02-05 19:08:41 [DEBUG   ] spawn_process: at 2019-02-05 19:08:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-02-05 19:08:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-02-05 19:08:41 [DEBUG   ] spawn_process: at 2019-02-05 19:08:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-02-05 19:08:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-02-05 19:08:41 [DEBUG   ] spawn_process: at 2019-02-05 19:08:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-02-05 19:08:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-02-05 19:08:41 [DEBUG   ] spawn_process: at 2019-02-05 19:08:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-02-05 19:08:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 19:08:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:08:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-02-05 19:08:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-02-05 19:08:58 [WARNING ] (13, 1, 'bot')
2019-02-05 19:08:58 [WARNING ] (13, 1, 'bot')
2019-02-05 19:08:58 [WARNING ] (13, 1, 'bot')
2019-02-05 19:08:58 [WARNING ] (13, 1, 'bot')
2019-02-05 19:08:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:08:58 [DEBUG   ] Finished updating board flags in 1.011 seconds
2019-02-05 19:09:15 [DEBUG   ] Got command BAM from MCS: ref #1412308
2019-02-05 19:09:15 [INFO    ] Finished processing BAM request
2019-02-05 19:09:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:09:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412308   8 58519 68955029 A  ERROR'
2019-02-05 19:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-02-05 19:09:15 [DEBUG   ] spawn_process: at 2019-02-05 19:09:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-02-05 19:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-02-05 19:09:15 [DEBUG   ] spawn_process: at 2019-02-05 19:09:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-02-05 19:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-02-05 19:09:15 [DEBUG   ] spawn_process: at 2019-02-05 19:09:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-02-05 19:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-02-05 19:09:15 [DEBUG   ] spawn_process: at 2019-02-05 19:09:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-02-05 19:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-02-05 19:09:15 [DEBUG   ] spawn_process: at 2019-02-05 19:09:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-02-05 19:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-02-05 19:09:15 [DEBUG   ] spawn_process: at 2019-02-05 19:09:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-02-05 19:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-02-05 19:09:15 [DEBUG   ] spawn_process: at 2019-02-05 19:09:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-02-05 19:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-02-05 19:09:15 [DEBUG   ] spawn_process: at 2019-02-05 19:09:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-02-05 19:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-02-05 19:09:15 [DEBUG   ] spawn_process: at 2019-02-05 19:09:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-02-05 19:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-02-05 19:09:15 [DEBUG   ] spawn_process: at 2019-02-05 19:09:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-02-05 19:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-02-05 19:09:15 [DEBUG   ] spawn_process: at 2019-02-05 19:09:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-02-05 19:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-02-05 19:09:15 [DEBUG   ] spawn_process: at 2019-02-05 19:09:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-02-05 19:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-02-05 19:09:15 [DEBUG   ] spawn_process: at 2019-02-05 19:09:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-02-05 19:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-02-05 19:09:15 [DEBUG   ] spawn_process: at 2019-02-05 19:09:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-02-05 19:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-02-05 19:09:15 [DEBUG   ] spawn_process: at 2019-02-05 19:09:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-02-05 19:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-02-05 19:09:15 [DEBUG   ] spawn_process: at 2019-02-05 19:09:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-02-05 19:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-02-05 19:09:15 [DEBUG   ] spawn_process: at 2019-02-05 19:09:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-02-05 19:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-02-05 19:09:15 [DEBUG   ] spawn_process: at 2019-02-05 19:09:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-02-05 19:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-02-05 19:09:15 [DEBUG   ] spawn_process: at 2019-02-05 19:09:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-02-05 19:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-02-05 19:09:15 [DEBUG   ] spawn_process: at 2019-02-05 19:09:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-02-05 19:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-02-05 19:09:15 [DEBUG   ] spawn_process: at 2019-02-05 19:09:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-02-05 19:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-02-05 19:09:15 [DEBUG   ] spawn_process: at 2019-02-05 19:09:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-02-05 19:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-02-05 19:09:15 [DEBUG   ] spawn_process: at 2019-02-05 19:09:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-02-05 19:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-02-05 19:09:15 [DEBUG   ] spawn_process: at 2019-02-05 19:09:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-02-05 19:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-02-05 19:09:15 [DEBUG   ] spawn_process: at 2019-02-05 19:09:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-02-05 19:09:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-02-05 19:09:15 [DEBUG   ] spawn_process: at 2019-02-05 19:09:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-02-05 19:09:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 19:09:18 [DEBUG   ] Got command BAM from MCS: ref #1412309
2019-02-05 19:09:18 [INFO    ] Finished processing BAM request
2019-02-05 19:09:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:09:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412309   8 58519 68958029 A  ERROR'
2019-02-05 19:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 19:09:18 [DEBUG   ] spawn_process: at 2019-02-05 19:09:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 19:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 19:09:18 [DEBUG   ] spawn_process: at 2019-02-05 19:09:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 19:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 19:09:18 [DEBUG   ] spawn_process: at 2019-02-05 19:09:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 19:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 19:09:18 [DEBUG   ] spawn_process: at 2019-02-05 19:09:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 19:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 19:09:18 [DEBUG   ] spawn_process: at 2019-02-05 19:09:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 19:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 19:09:18 [DEBUG   ] spawn_process: at 2019-02-05 19:09:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 19:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 19:09:18 [DEBUG   ] spawn_process: at 2019-02-05 19:09:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 19:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 19:09:18 [DEBUG   ] spawn_process: at 2019-02-05 19:09:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 19:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 19:09:18 [DEBUG   ] spawn_process: at 2019-02-05 19:09:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 19:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 19:09:18 [DEBUG   ] spawn_process: at 2019-02-05 19:09:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 19:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 19:09:18 [DEBUG   ] spawn_process: at 2019-02-05 19:09:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 19:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 19:09:18 [DEBUG   ] spawn_process: at 2019-02-05 19:09:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 19:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 19:09:18 [DEBUG   ] spawn_process: at 2019-02-05 19:09:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 19:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 19:09:18 [DEBUG   ] spawn_process: at 2019-02-05 19:09:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 19:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 19:09:18 [DEBUG   ] spawn_process: at 2019-02-05 19:09:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 19:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 19:09:18 [DEBUG   ] spawn_process: at 2019-02-05 19:09:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 19:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 19:09:18 [DEBUG   ] spawn_process: at 2019-02-05 19:09:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 19:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 19:09:18 [DEBUG   ] spawn_process: at 2019-02-05 19:09:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 19:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 19:09:18 [DEBUG   ] spawn_process: at 2019-02-05 19:09:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 19:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 19:09:18 [DEBUG   ] spawn_process: at 2019-02-05 19:09:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 19:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 19:09:18 [DEBUG   ] spawn_process: at 2019-02-05 19:09:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 19:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 19:09:18 [DEBUG   ] spawn_process: at 2019-02-05 19:09:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 19:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 19:09:18 [DEBUG   ] spawn_process: at 2019-02-05 19:09:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 19:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 19:09:18 [DEBUG   ] spawn_process: at 2019-02-05 19:09:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 19:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 19:09:18 [DEBUG   ] spawn_process: at 2019-02-05 19:09:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 19:09:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 19:09:18 [DEBUG   ] spawn_process: at 2019-02-05 19:09:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 19:09:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 19:09:55 [DEBUG   ] Got command RPT from MCS: ref #1412311
2019-02-05 19:09:55 [DEBUG   ] summary = ERROR
2019-02-05 19:09:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412311  13 58519 68995445 A  ERRORERROR'
2019-02-05 19:09:55 [DEBUG   ] Got command RPT from MCS: ref #1412312
2019-02-05 19:09:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 19:09:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412312  77 58519 68995649 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 19:09:55 [DEBUG   ] Got command RPT from MCS: ref #1412313
2019-02-05 19:09:55 [DEBUG   ] summary = ERROR
2019-02-05 19:09:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412313  13 58519 68995853 A  ERRORERROR'
2019-02-05 19:09:56 [DEBUG   ] Got command BAM from MCS: ref #1412310
2019-02-05 19:09:56 [INFO    ] Finished processing BAM request
2019-02-05 19:09:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:09:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412310   8 58519 68996025 A  ERROR'
2019-02-05 19:09:56 [DEBUG   ] Got command RPT from MCS: ref #1412314
2019-02-05 19:09:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 19:09:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412314  77 58519 68996049 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 19:09:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 19:09:56 [DEBUG   ] Got command RPT from MCS: ref #1412315
2019-02-05 19:09:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 19:09:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412315  12 58519 68996253 A  ERRORB¢ff'
2019-02-05 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-02-05 19:09:56 [DEBUG   ] spawn_process: at 2019-02-05 19:09:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-02-05 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-02-05 19:09:56 [DEBUG   ] spawn_process: at 2019-02-05 19:09:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-02-05 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-02-05 19:09:56 [DEBUG   ] spawn_process: at 2019-02-05 19:09:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-02-05 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-02-05 19:09:56 [DEBUG   ] spawn_process: at 2019-02-05 19:09:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-02-05 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-02-05 19:09:56 [DEBUG   ] spawn_process: at 2019-02-05 19:09:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-02-05 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-02-05 19:09:56 [DEBUG   ] spawn_process: at 2019-02-05 19:09:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-02-05 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-02-05 19:09:56 [DEBUG   ] spawn_process: at 2019-02-05 19:09:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-02-05 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-02-05 19:09:56 [DEBUG   ] spawn_process: at 2019-02-05 19:09:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-02-05 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-02-05 19:09:56 [DEBUG   ] spawn_process: at 2019-02-05 19:09:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-02-05 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-02-05 19:09:56 [DEBUG   ] spawn_process: at 2019-02-05 19:09:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-02-05 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-02-05 19:09:56 [DEBUG   ] spawn_process: at 2019-02-05 19:09:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-02-05 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-02-05 19:09:56 [DEBUG   ] spawn_process: at 2019-02-05 19:09:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-02-05 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-02-05 19:09:56 [DEBUG   ] spawn_process: at 2019-02-05 19:09:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-02-05 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-02-05 19:09:56 [DEBUG   ] spawn_process: at 2019-02-05 19:09:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-02-05 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-02-05 19:09:56 [DEBUG   ] spawn_process: at 2019-02-05 19:09:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-02-05 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-02-05 19:09:56 [DEBUG   ] spawn_process: at 2019-02-05 19:09:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-02-05 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-02-05 19:09:56 [DEBUG   ] spawn_process: at 2019-02-05 19:09:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-02-05 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-02-05 19:09:56 [DEBUG   ] spawn_process: at 2019-02-05 19:09:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-02-05 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-02-05 19:09:56 [DEBUG   ] spawn_process: at 2019-02-05 19:09:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-02-05 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-02-05 19:09:56 [DEBUG   ] spawn_process: at 2019-02-05 19:09:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-02-05 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-02-05 19:09:56 [DEBUG   ] spawn_process: at 2019-02-05 19:09:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-02-05 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-02-05 19:09:56 [DEBUG   ] spawn_process: at 2019-02-05 19:09:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-02-05 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-02-05 19:09:56 [DEBUG   ] spawn_process: at 2019-02-05 19:09:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-02-05 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-02-05 19:09:56 [DEBUG   ] spawn_process: at 2019-02-05 19:09:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-02-05 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-02-05 19:09:56 [DEBUG   ] spawn_process: at 2019-02-05 19:09:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-02-05 19:09:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-02-05 19:09:56 [DEBUG   ] spawn_process: at 2019-02-05 19:09:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-02-05 19:09:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 19:09:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-02-05 19:09:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:09:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-02-05 19:09:58 [WARNING ] (13, 1, 'bot')
2019-02-05 19:09:58 [WARNING ] (13, 1, 'bot')
2019-02-05 19:09:58 [WARNING ] (13, 1, 'bot')
2019-02-05 19:09:58 [WARNING ] (13, 1, 'bot')
2019-02-05 19:09:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:09:58 [DEBUG   ] Finished updating board flags in 0.995 seconds
2019-02-05 19:10:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 19:10:35 [DEBUG   ] Got command BAM from MCS: ref #1412316
2019-02-05 19:10:35 [INFO    ] Finished processing BAM request
2019-02-05 19:10:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:10:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412316   8 58519 69035025 A  ERROR'
2019-02-05 19:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-02-05 19:10:35 [DEBUG   ] spawn_process: at 2019-02-05 19:10:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-02-05 19:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-02-05 19:10:35 [DEBUG   ] spawn_process: at 2019-02-05 19:10:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-02-05 19:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-02-05 19:10:35 [DEBUG   ] spawn_process: at 2019-02-05 19:10:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-02-05 19:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-02-05 19:10:35 [DEBUG   ] spawn_process: at 2019-02-05 19:10:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-02-05 19:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-02-05 19:10:35 [DEBUG   ] spawn_process: at 2019-02-05 19:10:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-02-05 19:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-02-05 19:10:35 [DEBUG   ] spawn_process: at 2019-02-05 19:10:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-02-05 19:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-02-05 19:10:35 [DEBUG   ] spawn_process: at 2019-02-05 19:10:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-02-05 19:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-02-05 19:10:35 [DEBUG   ] spawn_process: at 2019-02-05 19:10:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-02-05 19:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-02-05 19:10:35 [DEBUG   ] spawn_process: at 2019-02-05 19:10:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-02-05 19:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-02-05 19:10:35 [DEBUG   ] spawn_process: at 2019-02-05 19:10:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-02-05 19:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-02-05 19:10:35 [DEBUG   ] spawn_process: at 2019-02-05 19:10:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-02-05 19:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-02-05 19:10:35 [DEBUG   ] spawn_process: at 2019-02-05 19:10:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-02-05 19:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-02-05 19:10:35 [DEBUG   ] spawn_process: at 2019-02-05 19:10:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-02-05 19:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-02-05 19:10:35 [DEBUG   ] spawn_process: at 2019-02-05 19:10:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-02-05 19:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-02-05 19:10:35 [DEBUG   ] spawn_process: at 2019-02-05 19:10:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-02-05 19:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-02-05 19:10:35 [DEBUG   ] spawn_process: at 2019-02-05 19:10:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-02-05 19:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-02-05 19:10:35 [DEBUG   ] spawn_process: at 2019-02-05 19:10:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-02-05 19:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-02-05 19:10:35 [DEBUG   ] spawn_process: at 2019-02-05 19:10:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-02-05 19:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-02-05 19:10:35 [DEBUG   ] spawn_process: at 2019-02-05 19:10:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-02-05 19:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-02-05 19:10:35 [DEBUG   ] spawn_process: at 2019-02-05 19:10:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-02-05 19:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-02-05 19:10:35 [DEBUG   ] spawn_process: at 2019-02-05 19:10:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-02-05 19:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-02-05 19:10:35 [DEBUG   ] spawn_process: at 2019-02-05 19:10:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-02-05 19:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-02-05 19:10:35 [DEBUG   ] spawn_process: at 2019-02-05 19:10:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-02-05 19:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-02-05 19:10:35 [DEBUG   ] spawn_process: at 2019-02-05 19:10:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-02-05 19:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-02-05 19:10:35 [DEBUG   ] spawn_process: at 2019-02-05 19:10:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-02-05 19:10:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-02-05 19:10:35 [DEBUG   ] spawn_process: at 2019-02-05 19:10:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-02-05 19:10:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 19:10:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 19:10:57 [DEBUG   ] Got command BAM from MCS: ref #1412317
2019-02-05 19:10:57 [INFO    ] Finished processing BAM request
2019-02-05 19:10:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:10:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412317   8 58519 69057041 A  ERROR'
2019-02-05 19:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 19:10:57 [DEBUG   ] spawn_process: at 2019-02-05 19:10:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 19:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 19:10:57 [DEBUG   ] spawn_process: at 2019-02-05 19:10:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 19:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 19:10:57 [DEBUG   ] spawn_process: at 2019-02-05 19:10:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 19:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 19:10:57 [DEBUG   ] spawn_process: at 2019-02-05 19:10:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 19:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 19:10:57 [DEBUG   ] spawn_process: at 2019-02-05 19:10:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 19:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 19:10:57 [DEBUG   ] spawn_process: at 2019-02-05 19:10:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 19:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 19:10:57 [DEBUG   ] spawn_process: at 2019-02-05 19:10:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 19:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 19:10:57 [DEBUG   ] spawn_process: at 2019-02-05 19:10:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 19:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 19:10:57 [DEBUG   ] spawn_process: at 2019-02-05 19:10:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 19:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 19:10:57 [DEBUG   ] spawn_process: at 2019-02-05 19:10:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 19:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 19:10:57 [DEBUG   ] spawn_process: at 2019-02-05 19:10:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 19:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 19:10:57 [DEBUG   ] spawn_process: at 2019-02-05 19:10:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 19:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 19:10:57 [DEBUG   ] spawn_process: at 2019-02-05 19:10:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 19:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 19:10:57 [DEBUG   ] spawn_process: at 2019-02-05 19:10:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 19:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 19:10:57 [DEBUG   ] spawn_process: at 2019-02-05 19:10:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 19:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 19:10:57 [DEBUG   ] spawn_process: at 2019-02-05 19:10:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 19:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 19:10:57 [DEBUG   ] spawn_process: at 2019-02-05 19:10:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 19:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 19:10:57 [DEBUG   ] spawn_process: at 2019-02-05 19:10:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 19:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 19:10:57 [DEBUG   ] spawn_process: at 2019-02-05 19:10:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 19:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 19:10:57 [DEBUG   ] spawn_process: at 2019-02-05 19:10:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 19:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 19:10:57 [DEBUG   ] spawn_process: at 2019-02-05 19:10:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 19:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 19:10:57 [DEBUG   ] spawn_process: at 2019-02-05 19:10:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 19:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 19:10:57 [DEBUG   ] spawn_process: at 2019-02-05 19:10:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 19:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 19:10:57 [DEBUG   ] spawn_process: at 2019-02-05 19:10:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 19:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 19:10:57 [DEBUG   ] spawn_process: at 2019-02-05 19:10:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 19:10:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 19:10:57 [DEBUG   ] spawn_process: at 2019-02-05 19:10:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 19:10:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 19:10:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-02-05 19:10:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-02-05 19:10:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:10:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 19:10:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 19:10:58 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-02-05 19:10:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-05 19:10:58 [WARNING ] (13, 1, 'bot')
2019-02-05 19:10:58 [WARNING ] (13, 1, 'bot')
2019-02-05 19:10:58 [WARNING ] (13, 1, 'bot')
2019-02-05 19:10:58 [WARNING ] (13, 1, 'bot')
2019-02-05 19:10:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:10:58 [DEBUG   ] Finished updating board flags in 1.251 seconds
2019-02-05 19:11:12 [DEBUG   ] Got command RPT from MCS: ref #1412318
2019-02-05 19:11:12 [DEBUG   ] summary = ERROR
2019-02-05 19:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412318  13 58519 69072005 A  ERRORERROR'
2019-02-05 19:11:12 [DEBUG   ] Got command RPT from MCS: ref #1412319
2019-02-05 19:11:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 19:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412319  77 58519 69072006 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 19:11:15 [DEBUG   ] Got command BAM from MCS: ref #1412339
2019-02-05 19:11:15 [INFO    ] Finished processing BAM request
2019-02-05 19:11:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:11:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412339   8 58519 69075033 A  ERROR'
2019-02-05 19:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-02-05 19:11:15 [DEBUG   ] spawn_process: at 2019-02-05 19:11:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-02-05 19:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-02-05 19:11:15 [DEBUG   ] spawn_process: at 2019-02-05 19:11:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-02-05 19:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-02-05 19:11:15 [DEBUG   ] spawn_process: at 2019-02-05 19:11:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-02-05 19:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-02-05 19:11:15 [DEBUG   ] spawn_process: at 2019-02-05 19:11:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-02-05 19:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-02-05 19:11:15 [DEBUG   ] spawn_process: at 2019-02-05 19:11:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-02-05 19:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-02-05 19:11:15 [DEBUG   ] spawn_process: at 2019-02-05 19:11:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-02-05 19:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-02-05 19:11:15 [DEBUG   ] spawn_process: at 2019-02-05 19:11:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-02-05 19:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-02-05 19:11:15 [DEBUG   ] spawn_process: at 2019-02-05 19:11:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-02-05 19:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-02-05 19:11:15 [DEBUG   ] spawn_process: at 2019-02-05 19:11:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-02-05 19:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-02-05 19:11:15 [DEBUG   ] spawn_process: at 2019-02-05 19:11:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-02-05 19:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-02-05 19:11:15 [DEBUG   ] spawn_process: at 2019-02-05 19:11:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-02-05 19:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-02-05 19:11:15 [DEBUG   ] spawn_process: at 2019-02-05 19:11:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-02-05 19:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-02-05 19:11:15 [DEBUG   ] spawn_process: at 2019-02-05 19:11:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-02-05 19:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-02-05 19:11:15 [DEBUG   ] spawn_process: at 2019-02-05 19:11:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-02-05 19:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-02-05 19:11:15 [DEBUG   ] spawn_process: at 2019-02-05 19:11:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-02-05 19:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-02-05 19:11:15 [DEBUG   ] spawn_process: at 2019-02-05 19:11:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-02-05 19:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-02-05 19:11:15 [DEBUG   ] spawn_process: at 2019-02-05 19:11:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-02-05 19:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-02-05 19:11:15 [DEBUG   ] spawn_process: at 2019-02-05 19:11:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-02-05 19:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-02-05 19:11:15 [DEBUG   ] spawn_process: at 2019-02-05 19:11:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-02-05 19:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-02-05 19:11:15 [DEBUG   ] spawn_process: at 2019-02-05 19:11:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-02-05 19:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-02-05 19:11:15 [DEBUG   ] spawn_process: at 2019-02-05 19:11:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-02-05 19:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-02-05 19:11:15 [DEBUG   ] spawn_process: at 2019-02-05 19:11:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-02-05 19:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-02-05 19:11:15 [DEBUG   ] spawn_process: at 2019-02-05 19:11:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-02-05 19:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-02-05 19:11:15 [DEBUG   ] spawn_process: at 2019-02-05 19:11:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-02-05 19:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-02-05 19:11:15 [DEBUG   ] spawn_process: at 2019-02-05 19:11:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-02-05 19:11:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-02-05 19:11:15 [DEBUG   ] spawn_process: at 2019-02-05 19:11:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-02-05 19:11:16 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-05 19:11:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 19:11:55 [DEBUG   ] Got command BAM from MCS: ref #1412340
2019-02-05 19:11:55 [INFO    ] Finished processing BAM request
2019-02-05 19:11:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:11:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412340   8 58519 69115029 A  ERROR'
2019-02-05 19:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-02-05 19:11:55 [DEBUG   ] spawn_process: at 2019-02-05 19:11:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-02-05 19:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-02-05 19:11:55 [DEBUG   ] spawn_process: at 2019-02-05 19:11:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-02-05 19:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-02-05 19:11:55 [DEBUG   ] spawn_process: at 2019-02-05 19:11:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-02-05 19:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-02-05 19:11:55 [DEBUG   ] spawn_process: at 2019-02-05 19:11:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-02-05 19:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-02-05 19:11:55 [DEBUG   ] spawn_process: at 2019-02-05 19:11:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-02-05 19:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-02-05 19:11:55 [DEBUG   ] spawn_process: at 2019-02-05 19:11:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-02-05 19:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-02-05 19:11:55 [DEBUG   ] spawn_process: at 2019-02-05 19:11:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-02-05 19:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-02-05 19:11:55 [DEBUG   ] spawn_process: at 2019-02-05 19:11:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-02-05 19:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-02-05 19:11:55 [DEBUG   ] spawn_process: at 2019-02-05 19:11:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-02-05 19:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-02-05 19:11:55 [DEBUG   ] spawn_process: at 2019-02-05 19:11:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-02-05 19:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-02-05 19:11:55 [DEBUG   ] spawn_process: at 2019-02-05 19:11:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-02-05 19:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-02-05 19:11:55 [DEBUG   ] spawn_process: at 2019-02-05 19:11:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-02-05 19:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-02-05 19:11:55 [DEBUG   ] spawn_process: at 2019-02-05 19:11:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-02-05 19:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-02-05 19:11:55 [DEBUG   ] spawn_process: at 2019-02-05 19:11:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-02-05 19:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-02-05 19:11:55 [DEBUG   ] spawn_process: at 2019-02-05 19:11:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-02-05 19:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-02-05 19:11:55 [DEBUG   ] spawn_process: at 2019-02-05 19:11:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-02-05 19:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-02-05 19:11:55 [DEBUG   ] spawn_process: at 2019-02-05 19:11:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-02-05 19:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-02-05 19:11:55 [DEBUG   ] spawn_process: at 2019-02-05 19:11:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-02-05 19:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-02-05 19:11:55 [DEBUG   ] spawn_process: at 2019-02-05 19:11:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-02-05 19:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-02-05 19:11:55 [DEBUG   ] spawn_process: at 2019-02-05 19:11:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-02-05 19:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-02-05 19:11:55 [DEBUG   ] spawn_process: at 2019-02-05 19:11:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-02-05 19:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-02-05 19:11:55 [DEBUG   ] spawn_process: at 2019-02-05 19:11:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-02-05 19:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-02-05 19:11:55 [DEBUG   ] spawn_process: at 2019-02-05 19:11:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-02-05 19:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-02-05 19:11:55 [DEBUG   ] spawn_process: at 2019-02-05 19:11:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-02-05 19:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-02-05 19:11:55 [DEBUG   ] spawn_process: at 2019-02-05 19:11:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-02-05 19:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-02-05 19:11:55 [DEBUG   ] spawn_process: at 2019-02-05 19:11:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-02-05 19:11:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 19:11:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-02-05 19:11:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:11:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2019-02-05 19:11:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-02-05 19:11:59 [WARNING ] (13, 1, 'bot')
2019-02-05 19:11:59 [WARNING ] (13, 1, 'bot')
2019-02-05 19:11:59 [WARNING ] (13, 1, 'bot')
2019-02-05 19:11:59 [WARNING ] (13, 1, 'bot')
2019-02-05 19:11:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:11:59 [DEBUG   ] Finished updating board flags in 1.804 seconds
2019-02-05 19:12:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 19:12:36 [DEBUG   ] Got command BAM from MCS: ref #1412341
2019-02-05 19:12:36 [INFO    ] Finished processing BAM request
2019-02-05 19:12:36 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:12:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412341   8 58519 69156029 A  ERROR'
2019-02-05 19:12:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 19:12:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 19:12:36 [DEBUG   ] spawn_process: at 2019-02-05 19:12:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 19:12:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 19:12:36 [DEBUG   ] spawn_process: at 2019-02-05 19:12:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 19:12:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 19:12:36 [DEBUG   ] spawn_process: at 2019-02-05 19:12:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 19:12:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 19:12:36 [DEBUG   ] spawn_process: at 2019-02-05 19:12:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 19:12:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 19:12:36 [DEBUG   ] spawn_process: at 2019-02-05 19:12:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 19:12:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 19:12:36 [DEBUG   ] spawn_process: at 2019-02-05 19:12:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 19:12:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 19:12:36 [DEBUG   ] spawn_process: at 2019-02-05 19:12:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 19:12:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 19:12:36 [DEBUG   ] spawn_process: at 2019-02-05 19:12:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 19:12:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 19:12:36 [DEBUG   ] spawn_process: at 2019-02-05 19:12:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 19:12:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 19:12:36 [DEBUG   ] spawn_process: at 2019-02-05 19:12:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 19:12:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 19:12:36 [DEBUG   ] spawn_process: at 2019-02-05 19:12:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 19:12:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 19:12:36 [DEBUG   ] spawn_process: at 2019-02-05 19:12:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 19:12:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 19:12:36 [DEBUG   ] spawn_process: at 2019-02-05 19:12:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 19:12:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 19:12:36 [DEBUG   ] spawn_process: at 2019-02-05 19:12:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 19:12:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 19:12:36 [DEBUG   ] spawn_process: at 2019-02-05 19:12:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 19:12:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 19:12:36 [DEBUG   ] spawn_process: at 2019-02-05 19:12:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 19:12:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 19:12:36 [DEBUG   ] spawn_process: at 2019-02-05 19:12:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 19:12:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 19:12:36 [DEBUG   ] spawn_process: at 2019-02-05 19:12:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 19:12:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 19:12:36 [DEBUG   ] spawn_process: at 2019-02-05 19:12:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 19:12:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 19:12:36 [DEBUG   ] spawn_process: at 2019-02-05 19:12:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 19:12:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 19:12:36 [DEBUG   ] spawn_process: at 2019-02-05 19:12:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 19:12:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 19:12:36 [DEBUG   ] spawn_process: at 2019-02-05 19:12:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 19:12:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 19:12:36 [DEBUG   ] spawn_process: at 2019-02-05 19:12:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 19:12:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 19:12:36 [DEBUG   ] spawn_process: at 2019-02-05 19:12:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 19:12:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 19:12:36 [DEBUG   ] spawn_process: at 2019-02-05 19:12:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 19:12:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 19:12:36 [DEBUG   ] spawn_process: at 2019-02-05 19:12:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 19:12:37 [DEBUG   ] Got command BAM from MCS: ref #1412342
2019-02-05 19:12:37 [INFO    ] Finished processing BAM request
2019-02-05 19:12:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:12:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412342   8 58519 69157033 A  ERROR'
2019-02-05 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 19:12:37 [DEBUG   ] spawn_process: at 2019-02-05 19:12:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 19:12:37 [DEBUG   ] spawn_process: at 2019-02-05 19:12:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 19:12:37 [DEBUG   ] spawn_process: at 2019-02-05 19:12:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 19:12:37 [DEBUG   ] spawn_process: at 2019-02-05 19:12:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 19:12:37 [DEBUG   ] spawn_process: at 2019-02-05 19:12:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 19:12:37 [DEBUG   ] spawn_process: at 2019-02-05 19:12:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 19:12:37 [DEBUG   ] spawn_process: at 2019-02-05 19:12:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 19:12:37 [DEBUG   ] spawn_process: at 2019-02-05 19:12:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 19:12:37 [DEBUG   ] spawn_process: at 2019-02-05 19:12:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 19:12:37 [DEBUG   ] spawn_process: at 2019-02-05 19:12:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 19:12:37 [DEBUG   ] spawn_process: at 2019-02-05 19:12:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 19:12:37 [DEBUG   ] spawn_process: at 2019-02-05 19:12:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 19:12:37 [DEBUG   ] spawn_process: at 2019-02-05 19:12:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 19:12:37 [DEBUG   ] spawn_process: at 2019-02-05 19:12:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 19:12:37 [DEBUG   ] spawn_process: at 2019-02-05 19:12:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 19:12:37 [DEBUG   ] spawn_process: at 2019-02-05 19:12:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 19:12:37 [DEBUG   ] spawn_process: at 2019-02-05 19:12:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 19:12:37 [DEBUG   ] spawn_process: at 2019-02-05 19:12:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 19:12:37 [DEBUG   ] spawn_process: at 2019-02-05 19:12:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 19:12:37 [DEBUG   ] spawn_process: at 2019-02-05 19:12:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 19:12:37 [DEBUG   ] spawn_process: at 2019-02-05 19:12:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 19:12:37 [DEBUG   ] spawn_process: at 2019-02-05 19:12:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 19:12:37 [DEBUG   ] spawn_process: at 2019-02-05 19:12:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 19:12:37 [DEBUG   ] spawn_process: at 2019-02-05 19:12:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 19:12:37 [DEBUG   ] spawn_process: at 2019-02-05 19:12:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 19:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 19:12:37 [DEBUG   ] spawn_process: at 2019-02-05 19:12:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 19:12:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 19:12:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-02-05 19:12:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:12:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-02-05 19:12:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-02-05 19:12:58 [WARNING ] (13, 1, 'bot')
2019-02-05 19:12:58 [WARNING ] (13, 1, 'bot')
2019-02-05 19:12:58 [WARNING ] (13, 1, 'bot')
2019-02-05 19:12:58 [WARNING ] (13, 1, 'bot')
2019-02-05 19:12:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:12:58 [DEBUG   ] Finished updating board flags in 1.197 seconds
2019-02-05 19:13:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 19:13:18 [DEBUG   ] Got command BAM from MCS: ref #1412343
2019-02-05 19:13:18 [INFO    ] Finished processing BAM request
2019-02-05 19:13:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:13:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412343   8 58519 69198033 A  ERROR'
2019-02-05 19:13:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-02-05 19:13:18 [DEBUG   ] spawn_process: at 2019-02-05 19:13:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-02-05 19:13:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-02-05 19:13:18 [DEBUG   ] spawn_process: at 2019-02-05 19:13:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-02-05 19:13:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-02-05 19:13:18 [DEBUG   ] spawn_process: at 2019-02-05 19:13:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-02-05 19:13:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-02-05 19:13:18 [DEBUG   ] spawn_process: at 2019-02-05 19:13:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-02-05 19:13:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-02-05 19:13:18 [DEBUG   ] spawn_process: at 2019-02-05 19:13:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-02-05 19:13:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-02-05 19:13:18 [DEBUG   ] spawn_process: at 2019-02-05 19:13:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-02-05 19:13:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-02-05 19:13:18 [DEBUG   ] spawn_process: at 2019-02-05 19:13:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-02-05 19:13:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-02-05 19:13:18 [DEBUG   ] spawn_process: at 2019-02-05 19:13:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-02-05 19:13:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-02-05 19:13:18 [DEBUG   ] spawn_process: at 2019-02-05 19:13:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-02-05 19:13:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-02-05 19:13:18 [DEBUG   ] spawn_process: at 2019-02-05 19:13:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-02-05 19:13:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-02-05 19:13:18 [DEBUG   ] spawn_process: at 2019-02-05 19:13:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-02-05 19:13:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-02-05 19:13:18 [DEBUG   ] spawn_process: at 2019-02-05 19:13:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-02-05 19:13:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-02-05 19:13:18 [DEBUG   ] spawn_process: at 2019-02-05 19:13:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-02-05 19:13:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-02-05 19:13:18 [DEBUG   ] spawn_process: at 2019-02-05 19:13:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-02-05 19:13:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-02-05 19:13:18 [DEBUG   ] spawn_process: at 2019-02-05 19:13:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-02-05 19:13:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-02-05 19:13:18 [DEBUG   ] spawn_process: at 2019-02-05 19:13:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-02-05 19:13:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-02-05 19:13:18 [DEBUG   ] spawn_process: at 2019-02-05 19:13:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-02-05 19:13:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-02-05 19:13:18 [DEBUG   ] spawn_process: at 2019-02-05 19:13:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-02-05 19:13:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-02-05 19:13:18 [DEBUG   ] spawn_process: at 2019-02-05 19:13:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-02-05 19:13:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-02-05 19:13:18 [DEBUG   ] spawn_process: at 2019-02-05 19:13:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-02-05 19:13:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-02-05 19:13:18 [DEBUG   ] spawn_process: at 2019-02-05 19:13:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-02-05 19:13:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-02-05 19:13:18 [DEBUG   ] spawn_process: at 2019-02-05 19:13:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-02-05 19:13:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-02-05 19:13:18 [DEBUG   ] spawn_process: at 2019-02-05 19:13:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-02-05 19:13:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-02-05 19:13:18 [DEBUG   ] spawn_process: at 2019-02-05 19:13:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-02-05 19:13:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-02-05 19:13:18 [DEBUG   ] spawn_process: at 2019-02-05 19:13:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-02-05 19:13:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-02-05 19:13:18 [DEBUG   ] spawn_process: at 2019-02-05 19:13:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-02-05 19:13:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 19:13:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 19:13:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:13:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-02-05 19:13:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-02-05 19:13:58 [WARNING ] (13, 1, 'bot')
2019-02-05 19:13:58 [WARNING ] (13, 1, 'bot')
2019-02-05 19:13:58 [WARNING ] (13, 1, 'bot')
2019-02-05 19:13:58 [WARNING ] (13, 1, 'bot')
2019-02-05 19:13:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:13:58 [DEBUG   ] Finished updating board flags in 1.016 seconds
2019-02-05 19:14:01 [DEBUG   ] Got command BAM from MCS: ref #1412344
2019-02-05 19:14:01 [INFO    ] Finished processing BAM request
2019-02-05 19:14:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:14:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412344   8 58519 69241029 A  ERROR'
2019-02-05 19:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 19:14:01 [DEBUG   ] spawn_process: at 2019-02-05 19:14:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 19:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 19:14:01 [DEBUG   ] spawn_process: at 2019-02-05 19:14:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 19:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 19:14:01 [DEBUG   ] spawn_process: at 2019-02-05 19:14:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 19:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 19:14:01 [DEBUG   ] spawn_process: at 2019-02-05 19:14:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 19:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 19:14:01 [DEBUG   ] spawn_process: at 2019-02-05 19:14:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 19:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 19:14:01 [DEBUG   ] spawn_process: at 2019-02-05 19:14:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 19:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 19:14:01 [DEBUG   ] spawn_process: at 2019-02-05 19:14:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 19:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 19:14:01 [DEBUG   ] spawn_process: at 2019-02-05 19:14:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 19:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 19:14:01 [DEBUG   ] spawn_process: at 2019-02-05 19:14:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 19:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 19:14:01 [DEBUG   ] spawn_process: at 2019-02-05 19:14:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 19:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 19:14:01 [DEBUG   ] spawn_process: at 2019-02-05 19:14:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 19:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 19:14:01 [DEBUG   ] spawn_process: at 2019-02-05 19:14:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 19:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 19:14:01 [DEBUG   ] spawn_process: at 2019-02-05 19:14:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 19:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 19:14:01 [DEBUG   ] spawn_process: at 2019-02-05 19:14:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 19:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 19:14:01 [DEBUG   ] spawn_process: at 2019-02-05 19:14:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 19:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 19:14:01 [DEBUG   ] spawn_process: at 2019-02-05 19:14:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 19:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 19:14:01 [DEBUG   ] spawn_process: at 2019-02-05 19:14:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 19:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 19:14:01 [DEBUG   ] spawn_process: at 2019-02-05 19:14:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 19:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 19:14:01 [DEBUG   ] spawn_process: at 2019-02-05 19:14:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 19:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 19:14:01 [DEBUG   ] spawn_process: at 2019-02-05 19:14:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 19:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 19:14:01 [DEBUG   ] spawn_process: at 2019-02-05 19:14:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 19:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 19:14:01 [DEBUG   ] spawn_process: at 2019-02-05 19:14:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 19:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 19:14:01 [DEBUG   ] spawn_process: at 2019-02-05 19:14:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 19:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 19:14:01 [DEBUG   ] spawn_process: at 2019-02-05 19:14:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 19:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 19:14:01 [DEBUG   ] spawn_process: at 2019-02-05 19:14:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 19:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 19:14:01 [DEBUG   ] spawn_process: at 2019-02-05 19:14:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 19:14:15 [DEBUG   ] Got command BAM from MCS: ref #1412349
2019-02-05 19:14:15 [INFO    ] Finished processing BAM request
2019-02-05 19:14:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:14:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412349   8 58519 69255025 A  ERROR'
2019-02-05 19:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 19:14:15 [DEBUG   ] spawn_process: at 2019-02-05 19:14:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 19:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 19:14:15 [DEBUG   ] spawn_process: at 2019-02-05 19:14:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 19:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 19:14:15 [DEBUG   ] spawn_process: at 2019-02-05 19:14:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 19:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 19:14:15 [DEBUG   ] spawn_process: at 2019-02-05 19:14:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 19:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 19:14:15 [DEBUG   ] spawn_process: at 2019-02-05 19:14:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 19:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 19:14:15 [DEBUG   ] spawn_process: at 2019-02-05 19:14:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 19:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 19:14:15 [DEBUG   ] spawn_process: at 2019-02-05 19:14:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 19:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 19:14:15 [DEBUG   ] spawn_process: at 2019-02-05 19:14:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 19:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 19:14:15 [DEBUG   ] spawn_process: at 2019-02-05 19:14:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 19:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 19:14:15 [DEBUG   ] spawn_process: at 2019-02-05 19:14:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 19:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 19:14:15 [DEBUG   ] spawn_process: at 2019-02-05 19:14:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 19:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 19:14:15 [DEBUG   ] spawn_process: at 2019-02-05 19:14:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 19:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 19:14:15 [DEBUG   ] spawn_process: at 2019-02-05 19:14:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 19:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 19:14:15 [DEBUG   ] spawn_process: at 2019-02-05 19:14:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 19:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 19:14:15 [DEBUG   ] spawn_process: at 2019-02-05 19:14:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 19:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 19:14:15 [DEBUG   ] spawn_process: at 2019-02-05 19:14:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 19:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 19:14:15 [DEBUG   ] spawn_process: at 2019-02-05 19:14:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 19:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 19:14:15 [DEBUG   ] spawn_process: at 2019-02-05 19:14:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 19:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 19:14:15 [DEBUG   ] spawn_process: at 2019-02-05 19:14:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 19:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 19:14:15 [DEBUG   ] spawn_process: at 2019-02-05 19:14:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 19:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 19:14:15 [DEBUG   ] spawn_process: at 2019-02-05 19:14:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 19:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 19:14:15 [DEBUG   ] spawn_process: at 2019-02-05 19:14:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 19:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 19:14:15 [DEBUG   ] spawn_process: at 2019-02-05 19:14:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 19:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 19:14:15 [DEBUG   ] spawn_process: at 2019-02-05 19:14:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 19:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 19:14:15 [DEBUG   ] spawn_process: at 2019-02-05 19:14:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 19:14:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 19:14:15 [DEBUG   ] spawn_process: at 2019-02-05 19:14:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 19:14:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 19:14:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 19:14:45 [DEBUG   ] Got command BAM from MCS: ref #1412352
2019-02-05 19:14:45 [INFO    ] Finished processing BAM request
2019-02-05 19:14:45 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:14:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412352   8 58519 69285033 A  ERROR'
2019-02-05 19:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 19:14:45 [DEBUG   ] spawn_process: at 2019-02-05 19:14:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 19:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 19:14:45 [DEBUG   ] spawn_process: at 2019-02-05 19:14:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 19:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 19:14:45 [DEBUG   ] spawn_process: at 2019-02-05 19:14:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 19:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 19:14:45 [DEBUG   ] spawn_process: at 2019-02-05 19:14:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 19:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 19:14:45 [DEBUG   ] spawn_process: at 2019-02-05 19:14:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 19:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 19:14:45 [DEBUG   ] spawn_process: at 2019-02-05 19:14:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 19:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 19:14:45 [DEBUG   ] spawn_process: at 2019-02-05 19:14:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 19:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 19:14:45 [DEBUG   ] spawn_process: at 2019-02-05 19:14:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 19:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 19:14:45 [DEBUG   ] spawn_process: at 2019-02-05 19:14:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 19:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 19:14:45 [DEBUG   ] spawn_process: at 2019-02-05 19:14:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 19:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 19:14:45 [DEBUG   ] spawn_process: at 2019-02-05 19:14:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 19:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 19:14:45 [DEBUG   ] spawn_process: at 2019-02-05 19:14:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 19:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 19:14:45 [DEBUG   ] spawn_process: at 2019-02-05 19:14:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 19:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 19:14:45 [DEBUG   ] spawn_process: at 2019-02-05 19:14:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 19:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 19:14:45 [DEBUG   ] spawn_process: at 2019-02-05 19:14:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 19:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 19:14:45 [DEBUG   ] spawn_process: at 2019-02-05 19:14:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 19:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 19:14:45 [DEBUG   ] spawn_process: at 2019-02-05 19:14:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 19:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 19:14:45 [DEBUG   ] spawn_process: at 2019-02-05 19:14:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 19:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 19:14:45 [DEBUG   ] spawn_process: at 2019-02-05 19:14:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 19:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 19:14:45 [DEBUG   ] spawn_process: at 2019-02-05 19:14:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 19:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 19:14:45 [DEBUG   ] spawn_process: at 2019-02-05 19:14:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 19:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 19:14:45 [DEBUG   ] spawn_process: at 2019-02-05 19:14:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 19:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 19:14:45 [DEBUG   ] spawn_process: at 2019-02-05 19:14:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 19:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 19:14:45 [DEBUG   ] spawn_process: at 2019-02-05 19:14:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 19:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 19:14:45 [DEBUG   ] spawn_process: at 2019-02-05 19:14:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 19:14:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 19:14:45 [DEBUG   ] spawn_process: at 2019-02-05 19:14:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 19:14:55 [DEBUG   ] Got command RPT from MCS: ref #1412353
2019-02-05 19:14:55 [DEBUG   ] summary = ERROR
2019-02-05 19:14:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412353  13 58519 69295529 A  ERRORERROR'
2019-02-05 19:14:55 [DEBUG   ] Got command RPT from MCS: ref #1412354
2019-02-05 19:14:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 19:14:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412354  77 58519 69295733 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 19:14:55 [DEBUG   ] Got command RPT from MCS: ref #1412355
2019-02-05 19:14:55 [DEBUG   ] summary = ERROR
2019-02-05 19:14:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412355  13 58519 69295937 A  ERRORERROR'
2019-02-05 19:14:56 [DEBUG   ] Got command RPT from MCS: ref #1412357
2019-02-05 19:14:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 19:14:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412357  77 58519 69296129 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 19:14:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 19:14:56 [DEBUG   ] Got command RPT from MCS: ref #1412358
2019-02-05 19:14:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 19:14:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412358  12 58519 69296333 A  ERRORB£ff'
2019-02-05 19:14:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2019-02-05 19:14:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:14:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2019-02-05 19:14:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-02-05 19:14:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-05 19:14:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-02-05 19:14:58 [WARNING ] (13, 1, 'bot')
2019-02-05 19:14:58 [WARNING ] (13, 1, 'bot')
2019-02-05 19:14:58 [WARNING ] (13, 1, 'bot')
2019-02-05 19:14:58 [WARNING ] (13, 1, 'bot')
2019-02-05 19:14:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:14:58 [DEBUG   ] Finished updating board flags in 1.028 seconds
2019-02-05 19:15:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 19:15:30 [DEBUG   ] Got command BAM from MCS: ref #1412363
2019-02-05 19:15:30 [INFO    ] Finished processing BAM request
2019-02-05 19:15:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:15:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412363   8 58519 69330033 A  ERROR'
2019-02-05 19:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 19:15:30 [DEBUG   ] spawn_process: at 2019-02-05 19:15:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 19:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 19:15:30 [DEBUG   ] spawn_process: at 2019-02-05 19:15:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 19:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 19:15:30 [DEBUG   ] spawn_process: at 2019-02-05 19:15:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 19:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 19:15:30 [DEBUG   ] spawn_process: at 2019-02-05 19:15:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 19:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 19:15:30 [DEBUG   ] spawn_process: at 2019-02-05 19:15:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 19:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 19:15:30 [DEBUG   ] spawn_process: at 2019-02-05 19:15:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 19:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 19:15:30 [DEBUG   ] spawn_process: at 2019-02-05 19:15:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 19:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 19:15:30 [DEBUG   ] spawn_process: at 2019-02-05 19:15:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 19:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 19:15:30 [DEBUG   ] spawn_process: at 2019-02-05 19:15:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 19:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 19:15:30 [DEBUG   ] spawn_process: at 2019-02-05 19:15:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 19:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 19:15:30 [DEBUG   ] spawn_process: at 2019-02-05 19:15:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 19:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 19:15:30 [DEBUG   ] spawn_process: at 2019-02-05 19:15:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 19:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 19:15:30 [DEBUG   ] spawn_process: at 2019-02-05 19:15:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 19:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 19:15:30 [DEBUG   ] spawn_process: at 2019-02-05 19:15:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 19:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 19:15:30 [DEBUG   ] spawn_process: at 2019-02-05 19:15:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 19:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 19:15:30 [DEBUG   ] spawn_process: at 2019-02-05 19:15:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 19:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 19:15:30 [DEBUG   ] spawn_process: at 2019-02-05 19:15:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 19:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 19:15:30 [DEBUG   ] spawn_process: at 2019-02-05 19:15:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 19:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 19:15:30 [DEBUG   ] spawn_process: at 2019-02-05 19:15:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 19:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 19:15:30 [DEBUG   ] spawn_process: at 2019-02-05 19:15:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 19:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 19:15:30 [DEBUG   ] spawn_process: at 2019-02-05 19:15:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 19:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 19:15:30 [DEBUG   ] spawn_process: at 2019-02-05 19:15:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 19:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 19:15:30 [DEBUG   ] spawn_process: at 2019-02-05 19:15:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 19:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 19:15:30 [DEBUG   ] spawn_process: at 2019-02-05 19:15:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 19:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 19:15:30 [DEBUG   ] spawn_process: at 2019-02-05 19:15:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 19:15:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 19:15:30 [DEBUG   ] spawn_process: at 2019-02-05 19:15:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 19:15:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 19:15:51 [DEBUG   ] Got command BAM from MCS: ref #1412364
2019-02-05 19:15:51 [INFO    ] Finished processing BAM request
2019-02-05 19:15:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:15:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412364   8 58519 69351025 A  ERROR'
2019-02-05 19:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-02-05 19:15:51 [DEBUG   ] spawn_process: at 2019-02-05 19:15:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-02-05 19:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-02-05 19:15:51 [DEBUG   ] spawn_process: at 2019-02-05 19:15:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-02-05 19:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-02-05 19:15:51 [DEBUG   ] spawn_process: at 2019-02-05 19:15:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-02-05 19:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-02-05 19:15:51 [DEBUG   ] spawn_process: at 2019-02-05 19:15:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-02-05 19:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-02-05 19:15:51 [DEBUG   ] spawn_process: at 2019-02-05 19:15:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-02-05 19:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-02-05 19:15:51 [DEBUG   ] spawn_process: at 2019-02-05 19:15:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-02-05 19:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-02-05 19:15:51 [DEBUG   ] spawn_process: at 2019-02-05 19:15:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-02-05 19:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-02-05 19:15:51 [DEBUG   ] spawn_process: at 2019-02-05 19:15:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-02-05 19:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-02-05 19:15:51 [DEBUG   ] spawn_process: at 2019-02-05 19:15:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-02-05 19:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-02-05 19:15:51 [DEBUG   ] spawn_process: at 2019-02-05 19:15:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-02-05 19:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-02-05 19:15:51 [DEBUG   ] spawn_process: at 2019-02-05 19:15:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-02-05 19:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-02-05 19:15:51 [DEBUG   ] spawn_process: at 2019-02-05 19:15:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-02-05 19:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-02-05 19:15:51 [DEBUG   ] spawn_process: at 2019-02-05 19:15:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-02-05 19:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-02-05 19:15:51 [DEBUG   ] spawn_process: at 2019-02-05 19:15:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-02-05 19:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-02-05 19:15:51 [DEBUG   ] spawn_process: at 2019-02-05 19:15:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-02-05 19:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-02-05 19:15:51 [DEBUG   ] spawn_process: at 2019-02-05 19:15:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-02-05 19:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-02-05 19:15:51 [DEBUG   ] spawn_process: at 2019-02-05 19:15:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-02-05 19:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-02-05 19:15:51 [DEBUG   ] spawn_process: at 2019-02-05 19:15:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-02-05 19:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-02-05 19:15:51 [DEBUG   ] spawn_process: at 2019-02-05 19:15:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-02-05 19:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-02-05 19:15:51 [DEBUG   ] spawn_process: at 2019-02-05 19:15:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-02-05 19:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-02-05 19:15:51 [DEBUG   ] spawn_process: at 2019-02-05 19:15:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-02-05 19:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-02-05 19:15:51 [DEBUG   ] spawn_process: at 2019-02-05 19:15:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-02-05 19:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-02-05 19:15:51 [DEBUG   ] spawn_process: at 2019-02-05 19:15:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-02-05 19:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-02-05 19:15:51 [DEBUG   ] spawn_process: at 2019-02-05 19:15:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-02-05 19:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-02-05 19:15:51 [DEBUG   ] spawn_process: at 2019-02-05 19:15:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-02-05 19:15:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-02-05 19:15:51 [DEBUG   ] spawn_process: at 2019-02-05 19:15:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-02-05 19:15:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 19:15:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-02-05 19:15:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:15:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-02-05 19:15:58 [WARNING ] (13, 1, 'bot')
2019-02-05 19:15:58 [WARNING ] (13, 1, 'bot')
2019-02-05 19:15:58 [WARNING ] (13, 1, 'bot')
2019-02-05 19:15:58 [WARNING ] (13, 1, 'bot')
2019-02-05 19:15:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:15:58 [DEBUG   ] Finished updating board flags in 0.963 seconds
2019-02-05 19:16:12 [DEBUG   ] Got command RPT from MCS: ref #1412365
2019-02-05 19:16:12 [DEBUG   ] summary = ERROR
2019-02-05 19:16:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412365  13 58519 69372009 A  ERRORERROR'
2019-02-05 19:16:12 [DEBUG   ] Got command RPT from MCS: ref #1412366
2019-02-05 19:16:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 19:16:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412366  77 58519 69372010 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 19:16:16 [DEBUG   ] Got command BAM from MCS: ref #1412382
2019-02-05 19:16:16 [INFO    ] Finished processing BAM request
2019-02-05 19:16:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:16:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412382   8 58519 69376033 A  ERROR'
2019-02-05 19:16:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 19:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-02-05 19:16:16 [DEBUG   ] spawn_process: at 2019-02-05 19:16:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-02-05 19:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-02-05 19:16:16 [DEBUG   ] spawn_process: at 2019-02-05 19:16:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-02-05 19:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-02-05 19:16:16 [DEBUG   ] spawn_process: at 2019-02-05 19:16:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-02-05 19:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-02-05 19:16:16 [DEBUG   ] spawn_process: at 2019-02-05 19:16:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-02-05 19:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-02-05 19:16:16 [DEBUG   ] spawn_process: at 2019-02-05 19:16:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-02-05 19:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-02-05 19:16:16 [DEBUG   ] spawn_process: at 2019-02-05 19:16:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-02-05 19:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-02-05 19:16:16 [DEBUG   ] spawn_process: at 2019-02-05 19:16:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-02-05 19:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-02-05 19:16:16 [DEBUG   ] spawn_process: at 2019-02-05 19:16:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-02-05 19:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-02-05 19:16:16 [DEBUG   ] spawn_process: at 2019-02-05 19:16:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-02-05 19:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-02-05 19:16:16 [DEBUG   ] spawn_process: at 2019-02-05 19:16:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-02-05 19:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-02-05 19:16:16 [DEBUG   ] spawn_process: at 2019-02-05 19:16:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-02-05 19:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-02-05 19:16:16 [DEBUG   ] spawn_process: at 2019-02-05 19:16:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-02-05 19:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-02-05 19:16:16 [DEBUG   ] spawn_process: at 2019-02-05 19:16:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-02-05 19:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-02-05 19:16:16 [DEBUG   ] spawn_process: at 2019-02-05 19:16:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-02-05 19:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-02-05 19:16:16 [DEBUG   ] spawn_process: at 2019-02-05 19:16:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-02-05 19:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-02-05 19:16:16 [DEBUG   ] spawn_process: at 2019-02-05 19:16:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-02-05 19:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-02-05 19:16:16 [DEBUG   ] spawn_process: at 2019-02-05 19:16:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-02-05 19:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-02-05 19:16:16 [DEBUG   ] spawn_process: at 2019-02-05 19:16:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-02-05 19:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-02-05 19:16:16 [DEBUG   ] spawn_process: at 2019-02-05 19:16:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-02-05 19:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-02-05 19:16:16 [DEBUG   ] spawn_process: at 2019-02-05 19:16:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-02-05 19:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-02-05 19:16:16 [DEBUG   ] spawn_process: at 2019-02-05 19:16:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-02-05 19:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-02-05 19:16:16 [DEBUG   ] spawn_process: at 2019-02-05 19:16:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-02-05 19:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-02-05 19:16:16 [DEBUG   ] spawn_process: at 2019-02-05 19:16:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-02-05 19:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-02-05 19:16:16 [DEBUG   ] spawn_process: at 2019-02-05 19:16:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-02-05 19:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-02-05 19:16:16 [DEBUG   ] spawn_process: at 2019-02-05 19:16:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-02-05 19:16:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-02-05 19:16:16 [DEBUG   ] spawn_process: at 2019-02-05 19:16:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-02-05 19:16:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 19:16:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 19:16:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-02-05 19:16:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-02-05 19:16:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:16:59 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-02-05 19:16:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-05 19:16:59 [WARNING ] (13, 1, 'bot')
2019-02-05 19:16:59 [WARNING ] (13, 1, 'bot')
2019-02-05 19:16:59 [WARNING ] (13, 1, 'bot')
2019-02-05 19:16:59 [WARNING ] (13, 1, 'bot')
2019-02-05 19:16:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:16:59 [DEBUG   ] Finished updating board flags in 1.375 seconds
2019-02-05 19:17:03 [DEBUG   ] Got command BAM from MCS: ref #1412383
2019-02-05 19:17:03 [INFO    ] Finished processing BAM request
2019-02-05 19:17:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:17:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412383   8 58519 69423029 A  ERROR'
2019-02-05 19:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-02-05 19:17:03 [DEBUG   ] spawn_process: at 2019-02-05 19:17:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-02-05 19:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-02-05 19:17:03 [DEBUG   ] spawn_process: at 2019-02-05 19:17:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-02-05 19:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-02-05 19:17:03 [DEBUG   ] spawn_process: at 2019-02-05 19:17:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-02-05 19:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-02-05 19:17:03 [DEBUG   ] spawn_process: at 2019-02-05 19:17:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-02-05 19:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-02-05 19:17:03 [DEBUG   ] spawn_process: at 2019-02-05 19:17:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-02-05 19:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-02-05 19:17:03 [DEBUG   ] spawn_process: at 2019-02-05 19:17:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-02-05 19:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-02-05 19:17:03 [DEBUG   ] spawn_process: at 2019-02-05 19:17:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-02-05 19:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-02-05 19:17:03 [DEBUG   ] spawn_process: at 2019-02-05 19:17:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-02-05 19:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-02-05 19:17:03 [DEBUG   ] spawn_process: at 2019-02-05 19:17:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-02-05 19:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-02-05 19:17:03 [DEBUG   ] spawn_process: at 2019-02-05 19:17:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-02-05 19:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-02-05 19:17:03 [DEBUG   ] spawn_process: at 2019-02-05 19:17:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-02-05 19:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-02-05 19:17:03 [DEBUG   ] spawn_process: at 2019-02-05 19:17:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-02-05 19:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-02-05 19:17:03 [DEBUG   ] spawn_process: at 2019-02-05 19:17:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-02-05 19:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-02-05 19:17:03 [DEBUG   ] spawn_process: at 2019-02-05 19:17:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-02-05 19:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-02-05 19:17:03 [DEBUG   ] spawn_process: at 2019-02-05 19:17:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-02-05 19:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-02-05 19:17:03 [DEBUG   ] spawn_process: at 2019-02-05 19:17:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-02-05 19:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-02-05 19:17:03 [DEBUG   ] spawn_process: at 2019-02-05 19:17:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-02-05 19:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-02-05 19:17:03 [DEBUG   ] spawn_process: at 2019-02-05 19:17:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-02-05 19:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-02-05 19:17:03 [DEBUG   ] spawn_process: at 2019-02-05 19:17:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-02-05 19:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-02-05 19:17:03 [DEBUG   ] spawn_process: at 2019-02-05 19:17:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-02-05 19:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-02-05 19:17:03 [DEBUG   ] spawn_process: at 2019-02-05 19:17:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-02-05 19:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-02-05 19:17:03 [DEBUG   ] spawn_process: at 2019-02-05 19:17:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-02-05 19:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-02-05 19:17:03 [DEBUG   ] spawn_process: at 2019-02-05 19:17:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-02-05 19:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-02-05 19:17:03 [DEBUG   ] spawn_process: at 2019-02-05 19:17:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-02-05 19:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-02-05 19:17:03 [DEBUG   ] spawn_process: at 2019-02-05 19:17:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-02-05 19:17:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-02-05 19:17:03 [DEBUG   ] spawn_process: at 2019-02-05 19:17:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-02-05 19:17:16 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-05 19:17:25 [DEBUG   ] Got command BAM from MCS: ref #1412388
2019-02-05 19:17:25 [INFO    ] Finished processing BAM request
2019-02-05 19:17:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:17:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412388   8 58519 69445025 A  ERROR'
2019-02-05 19:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 19:17:25 [DEBUG   ] spawn_process: at 2019-02-05 19:17:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 19:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 19:17:25 [DEBUG   ] spawn_process: at 2019-02-05 19:17:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 19:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 19:17:25 [DEBUG   ] spawn_process: at 2019-02-05 19:17:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 19:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 19:17:25 [DEBUG   ] spawn_process: at 2019-02-05 19:17:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 19:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 19:17:25 [DEBUG   ] spawn_process: at 2019-02-05 19:17:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 19:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 19:17:25 [DEBUG   ] spawn_process: at 2019-02-05 19:17:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 19:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 19:17:25 [DEBUG   ] spawn_process: at 2019-02-05 19:17:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 19:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 19:17:25 [DEBUG   ] spawn_process: at 2019-02-05 19:17:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 19:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 19:17:25 [DEBUG   ] spawn_process: at 2019-02-05 19:17:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 19:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 19:17:25 [DEBUG   ] spawn_process: at 2019-02-05 19:17:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 19:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 19:17:25 [DEBUG   ] spawn_process: at 2019-02-05 19:17:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 19:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 19:17:25 [DEBUG   ] spawn_process: at 2019-02-05 19:17:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 19:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 19:17:25 [DEBUG   ] spawn_process: at 2019-02-05 19:17:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 19:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 19:17:25 [DEBUG   ] spawn_process: at 2019-02-05 19:17:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 19:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 19:17:25 [DEBUG   ] spawn_process: at 2019-02-05 19:17:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 19:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 19:17:25 [DEBUG   ] spawn_process: at 2019-02-05 19:17:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 19:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 19:17:25 [DEBUG   ] spawn_process: at 2019-02-05 19:17:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 19:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 19:17:25 [DEBUG   ] spawn_process: at 2019-02-05 19:17:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 19:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 19:17:25 [DEBUG   ] spawn_process: at 2019-02-05 19:17:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 19:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 19:17:25 [DEBUG   ] spawn_process: at 2019-02-05 19:17:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 19:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 19:17:25 [DEBUG   ] spawn_process: at 2019-02-05 19:17:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 19:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 19:17:25 [DEBUG   ] spawn_process: at 2019-02-05 19:17:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 19:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 19:17:25 [DEBUG   ] spawn_process: at 2019-02-05 19:17:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 19:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 19:17:25 [DEBUG   ] spawn_process: at 2019-02-05 19:17:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 19:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 19:17:25 [DEBUG   ] spawn_process: at 2019-02-05 19:17:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 19:17:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 19:17:25 [DEBUG   ] spawn_process: at 2019-02-05 19:17:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 19:17:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 19:17:51 [DEBUG   ] Got command BAM from MCS: ref #1412389
2019-02-05 19:17:51 [INFO    ] Finished processing BAM request
2019-02-05 19:17:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:17:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412389   8 58519 69471025 A  ERROR'
2019-02-05 19:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-02-05 19:17:51 [DEBUG   ] spawn_process: at 2019-02-05 19:17:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-02-05 19:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-02-05 19:17:51 [DEBUG   ] spawn_process: at 2019-02-05 19:17:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-02-05 19:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-02-05 19:17:51 [DEBUG   ] spawn_process: at 2019-02-05 19:17:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-02-05 19:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-02-05 19:17:51 [DEBUG   ] spawn_process: at 2019-02-05 19:17:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-02-05 19:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-02-05 19:17:51 [DEBUG   ] spawn_process: at 2019-02-05 19:17:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-02-05 19:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-02-05 19:17:51 [DEBUG   ] spawn_process: at 2019-02-05 19:17:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-02-05 19:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-02-05 19:17:51 [DEBUG   ] spawn_process: at 2019-02-05 19:17:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-02-05 19:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-02-05 19:17:51 [DEBUG   ] spawn_process: at 2019-02-05 19:17:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-02-05 19:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-02-05 19:17:51 [DEBUG   ] spawn_process: at 2019-02-05 19:17:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-02-05 19:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-02-05 19:17:51 [DEBUG   ] spawn_process: at 2019-02-05 19:17:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-02-05 19:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-02-05 19:17:51 [DEBUG   ] spawn_process: at 2019-02-05 19:17:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-02-05 19:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-02-05 19:17:51 [DEBUG   ] spawn_process: at 2019-02-05 19:17:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-02-05 19:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-02-05 19:17:51 [DEBUG   ] spawn_process: at 2019-02-05 19:17:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-02-05 19:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-02-05 19:17:51 [DEBUG   ] spawn_process: at 2019-02-05 19:17:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-02-05 19:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-02-05 19:17:51 [DEBUG   ] spawn_process: at 2019-02-05 19:17:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-02-05 19:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-02-05 19:17:51 [DEBUG   ] spawn_process: at 2019-02-05 19:17:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-02-05 19:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-02-05 19:17:51 [DEBUG   ] spawn_process: at 2019-02-05 19:17:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-02-05 19:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-02-05 19:17:51 [DEBUG   ] spawn_process: at 2019-02-05 19:17:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-02-05 19:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-02-05 19:17:51 [DEBUG   ] spawn_process: at 2019-02-05 19:17:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-02-05 19:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-02-05 19:17:51 [DEBUG   ] spawn_process: at 2019-02-05 19:17:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-02-05 19:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-02-05 19:17:51 [DEBUG   ] spawn_process: at 2019-02-05 19:17:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-02-05 19:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-02-05 19:17:51 [DEBUG   ] spawn_process: at 2019-02-05 19:17:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-02-05 19:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-02-05 19:17:51 [DEBUG   ] spawn_process: at 2019-02-05 19:17:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-02-05 19:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-02-05 19:17:51 [DEBUG   ] spawn_process: at 2019-02-05 19:17:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-02-05 19:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-02-05 19:17:51 [DEBUG   ] spawn_process: at 2019-02-05 19:17:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-02-05 19:17:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-02-05 19:17:51 [DEBUG   ] spawn_process: at 2019-02-05 19:17:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-02-05 19:17:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 19:17:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 4
2019-02-05 19:17:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:17:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-02-05 19:17:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2019-02-05 19:17:59 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-02-05 19:17:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-02-05 19:17:59 [WARNING ] (13, 1, 'bot')
2019-02-05 19:17:59 [WARNING ] (13, 1, 'bot')
2019-02-05 19:17:59 [WARNING ] (13, 1, 'bot')
2019-02-05 19:17:59 [WARNING ] (13, 1, 'bot')
2019-02-05 19:17:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:17:59 [DEBUG   ] Finished updating board flags in 1.183 seconds
2019-02-05 19:18:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 19:18:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 19:18:40 [DEBUG   ] Got command BAM from MCS: ref #1412390
2019-02-05 19:18:40 [INFO    ] Finished processing BAM request
2019-02-05 19:18:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:18:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412390   8 58519 69520025 A  ERROR'
2019-02-05 19:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 19:18:40 [DEBUG   ] spawn_process: at 2019-02-05 19:18:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 19:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 19:18:40 [DEBUG   ] spawn_process: at 2019-02-05 19:18:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 19:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 19:18:40 [DEBUG   ] spawn_process: at 2019-02-05 19:18:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 19:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 19:18:40 [DEBUG   ] spawn_process: at 2019-02-05 19:18:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 19:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 19:18:40 [DEBUG   ] spawn_process: at 2019-02-05 19:18:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 19:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 19:18:40 [DEBUG   ] spawn_process: at 2019-02-05 19:18:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 19:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 19:18:40 [DEBUG   ] spawn_process: at 2019-02-05 19:18:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 19:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 19:18:40 [DEBUG   ] spawn_process: at 2019-02-05 19:18:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 19:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 19:18:40 [DEBUG   ] spawn_process: at 2019-02-05 19:18:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 19:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 19:18:40 [DEBUG   ] spawn_process: at 2019-02-05 19:18:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 19:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 19:18:40 [DEBUG   ] spawn_process: at 2019-02-05 19:18:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 19:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 19:18:40 [DEBUG   ] spawn_process: at 2019-02-05 19:18:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 19:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 19:18:40 [DEBUG   ] spawn_process: at 2019-02-05 19:18:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 19:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 19:18:40 [DEBUG   ] spawn_process: at 2019-02-05 19:18:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 19:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 19:18:40 [DEBUG   ] spawn_process: at 2019-02-05 19:18:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 19:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 19:18:40 [DEBUG   ] spawn_process: at 2019-02-05 19:18:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 19:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 19:18:40 [DEBUG   ] spawn_process: at 2019-02-05 19:18:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 19:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 19:18:40 [DEBUG   ] spawn_process: at 2019-02-05 19:18:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 19:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 19:18:40 [DEBUG   ] spawn_process: at 2019-02-05 19:18:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 19:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 19:18:40 [DEBUG   ] spawn_process: at 2019-02-05 19:18:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 19:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 19:18:40 [DEBUG   ] spawn_process: at 2019-02-05 19:18:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 19:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 19:18:40 [DEBUG   ] spawn_process: at 2019-02-05 19:18:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 19:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 19:18:40 [DEBUG   ] spawn_process: at 2019-02-05 19:18:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 19:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 19:18:40 [DEBUG   ] spawn_process: at 2019-02-05 19:18:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 19:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 19:18:40 [DEBUG   ] spawn_process: at 2019-02-05 19:18:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 19:18:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 19:18:40 [DEBUG   ] spawn_process: at 2019-02-05 19:18:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 19:18:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 19:18:58 [DEBUG   ] Got command BAM from MCS: ref #1412391
2019-02-05 19:18:58 [INFO    ] Finished processing BAM request
2019-02-05 19:18:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:18:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412391   8 58519 69538029 A  ERROR'
2019-02-05 19:18:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-02-05 19:18:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-02-05 19:18:58 [DEBUG   ] spawn_process: at 2019-02-05 19:18:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-02-05 19:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-02-05 19:18:58 [DEBUG   ] spawn_process: at 2019-02-05 19:18:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-02-05 19:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-02-05 19:18:58 [DEBUG   ] spawn_process: at 2019-02-05 19:18:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-02-05 19:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-02-05 19:18:58 [DEBUG   ] spawn_process: at 2019-02-05 19:18:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-02-05 19:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-02-05 19:18:58 [DEBUG   ] spawn_process: at 2019-02-05 19:18:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-02-05 19:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-02-05 19:18:58 [DEBUG   ] spawn_process: at 2019-02-05 19:18:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-02-05 19:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-02-05 19:18:58 [DEBUG   ] spawn_process: at 2019-02-05 19:18:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-02-05 19:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-02-05 19:18:58 [DEBUG   ] spawn_process: at 2019-02-05 19:18:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-02-05 19:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-02-05 19:18:58 [DEBUG   ] spawn_process: at 2019-02-05 19:18:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-02-05 19:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-02-05 19:18:58 [DEBUG   ] spawn_process: at 2019-02-05 19:18:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-02-05 19:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-02-05 19:18:58 [DEBUG   ] spawn_process: at 2019-02-05 19:18:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-02-05 19:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-02-05 19:18:58 [DEBUG   ] spawn_process: at 2019-02-05 19:18:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-02-05 19:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-02-05 19:18:58 [DEBUG   ] spawn_process: at 2019-02-05 19:18:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-02-05 19:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-02-05 19:18:58 [DEBUG   ] spawn_process: at 2019-02-05 19:18:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-02-05 19:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-02-05 19:18:58 [DEBUG   ] spawn_process: at 2019-02-05 19:18:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-02-05 19:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-02-05 19:18:58 [DEBUG   ] spawn_process: at 2019-02-05 19:18:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-02-05 19:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-02-05 19:18:58 [DEBUG   ] spawn_process: at 2019-02-05 19:18:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-02-05 19:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-02-05 19:18:58 [DEBUG   ] spawn_process: at 2019-02-05 19:18:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-02-05 19:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-02-05 19:18:58 [DEBUG   ] spawn_process: at 2019-02-05 19:18:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-02-05 19:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-02-05 19:18:58 [DEBUG   ] spawn_process: at 2019-02-05 19:18:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-02-05 19:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-02-05 19:18:58 [DEBUG   ] spawn_process: at 2019-02-05 19:18:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-02-05 19:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-02-05 19:18:58 [DEBUG   ] spawn_process: at 2019-02-05 19:18:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-02-05 19:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-02-05 19:18:58 [DEBUG   ] spawn_process: at 2019-02-05 19:18:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-02-05 19:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-02-05 19:18:58 [DEBUG   ] spawn_process: at 2019-02-05 19:18:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-02-05 19:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-02-05 19:18:58 [DEBUG   ] spawn_process: at 2019-02-05 19:18:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-02-05 19:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-02-05 19:18:58 [DEBUG   ] spawn_process: at 2019-02-05 19:18:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-02-05 19:18:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2019-02-05 19:18:59 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2019-02-05 19:18:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-02-05 19:18:59 [WARNING ] (13, 1, 'bot')
2019-02-05 19:18:59 [WARNING ] (13, 1, 'bot')
2019-02-05 19:18:59 [WARNING ] (13, 1, 'bot')
2019-02-05 19:18:59 [WARNING ] (13, 1, 'bot')
2019-02-05 19:18:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:18:59 [DEBUG   ] Finished updating board flags in 1.006 seconds
2019-02-05 19:19:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 19:19:31 [DEBUG   ] Got command BAM from MCS: ref #1412392
2019-02-05 19:19:31 [INFO    ] Finished processing BAM request
2019-02-05 19:19:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:19:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412392   8 58519 69571034 A  ERROR'
2019-02-05 19:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-02-05 19:19:31 [DEBUG   ] spawn_process: at 2019-02-05 19:19:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-02-05 19:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-02-05 19:19:31 [DEBUG   ] spawn_process: at 2019-02-05 19:19:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-02-05 19:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-02-05 19:19:31 [DEBUG   ] spawn_process: at 2019-02-05 19:19:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-02-05 19:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-02-05 19:19:31 [DEBUG   ] spawn_process: at 2019-02-05 19:19:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-02-05 19:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-02-05 19:19:31 [DEBUG   ] spawn_process: at 2019-02-05 19:19:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-02-05 19:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-02-05 19:19:31 [DEBUG   ] spawn_process: at 2019-02-05 19:19:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-02-05 19:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-02-05 19:19:31 [DEBUG   ] spawn_process: at 2019-02-05 19:19:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-02-05 19:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-02-05 19:19:31 [DEBUG   ] spawn_process: at 2019-02-05 19:19:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-02-05 19:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-02-05 19:19:31 [DEBUG   ] spawn_process: at 2019-02-05 19:19:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-02-05 19:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-02-05 19:19:31 [DEBUG   ] spawn_process: at 2019-02-05 19:19:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-02-05 19:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-02-05 19:19:31 [DEBUG   ] spawn_process: at 2019-02-05 19:19:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-02-05 19:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-02-05 19:19:31 [DEBUG   ] spawn_process: at 2019-02-05 19:19:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-02-05 19:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-02-05 19:19:31 [DEBUG   ] spawn_process: at 2019-02-05 19:19:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-02-05 19:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-02-05 19:19:31 [DEBUG   ] spawn_process: at 2019-02-05 19:19:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-02-05 19:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-02-05 19:19:31 [DEBUG   ] spawn_process: at 2019-02-05 19:19:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-02-05 19:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-02-05 19:19:31 [DEBUG   ] spawn_process: at 2019-02-05 19:19:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-02-05 19:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-02-05 19:19:31 [DEBUG   ] spawn_process: at 2019-02-05 19:19:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-02-05 19:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-02-05 19:19:31 [DEBUG   ] spawn_process: at 2019-02-05 19:19:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-02-05 19:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-02-05 19:19:31 [DEBUG   ] spawn_process: at 2019-02-05 19:19:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-02-05 19:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-02-05 19:19:31 [DEBUG   ] spawn_process: at 2019-02-05 19:19:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-02-05 19:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-02-05 19:19:31 [DEBUG   ] spawn_process: at 2019-02-05 19:19:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-02-05 19:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-02-05 19:19:31 [DEBUG   ] spawn_process: at 2019-02-05 19:19:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-02-05 19:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-02-05 19:19:31 [DEBUG   ] spawn_process: at 2019-02-05 19:19:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-02-05 19:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-02-05 19:19:31 [DEBUG   ] spawn_process: at 2019-02-05 19:19:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-02-05 19:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-02-05 19:19:31 [DEBUG   ] spawn_process: at 2019-02-05 19:19:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-02-05 19:19:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-02-05 19:19:31 [DEBUG   ] spawn_process: at 2019-02-05 19:19:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-02-05 19:19:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 19:19:55 [DEBUG   ] Got command RPT from MCS: ref #1412393
2019-02-05 19:19:55 [DEBUG   ] summary = ERROR
2019-02-05 19:19:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412393  13 58519 69595621 A  ERRORERROR'
2019-02-05 19:19:55 [DEBUG   ] Got command RPT from MCS: ref #1412394
2019-02-05 19:19:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 19:19:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412394  77 58519 69595813 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 19:19:56 [DEBUG   ] Got command RPT from MCS: ref #1412395
2019-02-05 19:19:56 [DEBUG   ] summary = ERROR
2019-02-05 19:19:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412395  13 58519 69596017 A  ERRORERROR'
2019-02-05 19:19:56 [DEBUG   ] Got command RPT from MCS: ref #1412396
2019-02-05 19:19:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 19:19:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412396  77 58519 69596221 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 19:19:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 19:19:56 [DEBUG   ] Got command RPT from MCS: ref #1412397
2019-02-05 19:19:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 19:19:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412397  12 58519 69596425 A  ERRORB¥ff'
2019-02-05 19:19:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-02-05 19:19:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:19:59 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-02-05 19:19:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-02-05 19:19:59 [WARNING ] (13, 1, 'bot')
2019-02-05 19:19:59 [WARNING ] (13, 1, 'bot')
2019-02-05 19:19:59 [WARNING ] (13, 1, 'bot')
2019-02-05 19:19:59 [WARNING ] (13, 1, 'bot')
2019-02-05 19:19:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:19:59 [DEBUG   ] Finished updating board flags in 1.013 seconds
2019-02-05 19:20:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 19:20:23 [DEBUG   ] Got command BAM from MCS: ref #1412402
2019-02-05 19:20:23 [INFO    ] Finished processing BAM request
2019-02-05 19:20:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:20:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412402   8 58519 69623025 A  ERROR'
2019-02-05 19:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-02-05 19:20:23 [DEBUG   ] spawn_process: at 2019-02-05 19:20:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-02-05 19:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-02-05 19:20:23 [DEBUG   ] spawn_process: at 2019-02-05 19:20:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-02-05 19:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-02-05 19:20:23 [DEBUG   ] spawn_process: at 2019-02-05 19:20:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-02-05 19:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-02-05 19:20:23 [DEBUG   ] spawn_process: at 2019-02-05 19:20:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-02-05 19:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-02-05 19:20:23 [DEBUG   ] spawn_process: at 2019-02-05 19:20:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-02-05 19:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-02-05 19:20:23 [DEBUG   ] spawn_process: at 2019-02-05 19:20:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-02-05 19:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-02-05 19:20:23 [DEBUG   ] spawn_process: at 2019-02-05 19:20:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-02-05 19:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-02-05 19:20:23 [DEBUG   ] spawn_process: at 2019-02-05 19:20:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-02-05 19:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-02-05 19:20:23 [DEBUG   ] spawn_process: at 2019-02-05 19:20:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-02-05 19:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-02-05 19:20:23 [DEBUG   ] spawn_process: at 2019-02-05 19:20:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-02-05 19:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-02-05 19:20:23 [DEBUG   ] spawn_process: at 2019-02-05 19:20:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-02-05 19:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-02-05 19:20:23 [DEBUG   ] spawn_process: at 2019-02-05 19:20:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-02-05 19:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-02-05 19:20:23 [DEBUG   ] spawn_process: at 2019-02-05 19:20:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-02-05 19:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-02-05 19:20:23 [DEBUG   ] spawn_process: at 2019-02-05 19:20:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-02-05 19:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-02-05 19:20:23 [DEBUG   ] spawn_process: at 2019-02-05 19:20:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-02-05 19:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-02-05 19:20:23 [DEBUG   ] spawn_process: at 2019-02-05 19:20:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-02-05 19:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-02-05 19:20:23 [DEBUG   ] spawn_process: at 2019-02-05 19:20:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-02-05 19:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-02-05 19:20:23 [DEBUG   ] spawn_process: at 2019-02-05 19:20:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-02-05 19:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-02-05 19:20:23 [DEBUG   ] spawn_process: at 2019-02-05 19:20:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-02-05 19:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-02-05 19:20:23 [DEBUG   ] spawn_process: at 2019-02-05 19:20:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-02-05 19:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-02-05 19:20:23 [DEBUG   ] spawn_process: at 2019-02-05 19:20:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-02-05 19:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-02-05 19:20:23 [DEBUG   ] spawn_process: at 2019-02-05 19:20:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-02-05 19:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-02-05 19:20:23 [DEBUG   ] spawn_process: at 2019-02-05 19:20:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-02-05 19:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-02-05 19:20:23 [DEBUG   ] spawn_process: at 2019-02-05 19:20:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-02-05 19:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-02-05 19:20:23 [DEBUG   ] spawn_process: at 2019-02-05 19:20:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-02-05 19:20:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-02-05 19:20:23 [DEBUG   ] spawn_process: at 2019-02-05 19:20:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-02-05 19:20:29 [DEBUG   ] Got command BAM from MCS: ref #1412403
2019-02-05 19:20:29 [INFO    ] Finished processing BAM request
2019-02-05 19:20:29 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:20:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412403   8 58519 69629029 A  ERROR'
2019-02-05 19:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 19:20:29 [DEBUG   ] spawn_process: at 2019-02-05 19:20:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 19:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 19:20:29 [DEBUG   ] spawn_process: at 2019-02-05 19:20:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 19:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 19:20:29 [DEBUG   ] spawn_process: at 2019-02-05 19:20:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 19:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 19:20:29 [DEBUG   ] spawn_process: at 2019-02-05 19:20:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 19:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 19:20:29 [DEBUG   ] spawn_process: at 2019-02-05 19:20:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 19:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 19:20:29 [DEBUG   ] spawn_process: at 2019-02-05 19:20:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 19:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 19:20:29 [DEBUG   ] spawn_process: at 2019-02-05 19:20:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 19:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 19:20:29 [DEBUG   ] spawn_process: at 2019-02-05 19:20:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 19:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 19:20:29 [DEBUG   ] spawn_process: at 2019-02-05 19:20:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 19:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 19:20:29 [DEBUG   ] spawn_process: at 2019-02-05 19:20:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 19:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 19:20:29 [DEBUG   ] spawn_process: at 2019-02-05 19:20:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 19:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 19:20:29 [DEBUG   ] spawn_process: at 2019-02-05 19:20:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 19:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 19:20:29 [DEBUG   ] spawn_process: at 2019-02-05 19:20:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 19:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 19:20:29 [DEBUG   ] spawn_process: at 2019-02-05 19:20:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 19:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 19:20:29 [DEBUG   ] spawn_process: at 2019-02-05 19:20:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 19:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 19:20:29 [DEBUG   ] spawn_process: at 2019-02-05 19:20:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 19:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 19:20:29 [DEBUG   ] spawn_process: at 2019-02-05 19:20:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 19:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 19:20:29 [DEBUG   ] spawn_process: at 2019-02-05 19:20:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 19:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 19:20:29 [DEBUG   ] spawn_process: at 2019-02-05 19:20:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 19:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 19:20:29 [DEBUG   ] spawn_process: at 2019-02-05 19:20:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 19:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 19:20:29 [DEBUG   ] spawn_process: at 2019-02-05 19:20:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 19:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 19:20:29 [DEBUG   ] spawn_process: at 2019-02-05 19:20:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 19:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 19:20:29 [DEBUG   ] spawn_process: at 2019-02-05 19:20:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 19:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 19:20:29 [DEBUG   ] spawn_process: at 2019-02-05 19:20:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 19:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 19:20:29 [DEBUG   ] spawn_process: at 2019-02-05 19:20:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 19:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 19:20:29 [DEBUG   ] spawn_process: at 2019-02-05 19:20:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 19:20:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 19:20:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 19:20:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-02-05 19:20:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:20:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2019-02-05 19:20:59 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2019-02-05 19:20:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-02-05 19:20:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-02-05 19:20:59 [WARNING ] (13, 1, 'bot')
2019-02-05 19:20:59 [WARNING ] (13, 1, 'bot')
2019-02-05 19:20:59 [WARNING ] (13, 1, 'bot')
2019-02-05 19:20:59 [WARNING ] (13, 1, 'bot')
2019-02-05 19:20:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:20:59 [DEBUG   ] Finished updating board flags in 1.030 seconds
2019-02-05 19:21:12 [DEBUG   ] Got command RPT from MCS: ref #1412404
2019-02-05 19:21:12 [DEBUG   ] summary = ERROR
2019-02-05 19:21:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412404  13 58519 69672009 A  ERRORERROR'
2019-02-05 19:21:12 [DEBUG   ] Got command RPT from MCS: ref #1412405
2019-02-05 19:21:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 19:21:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412405  77 58519 69672010 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 19:21:16 [DEBUG   ] Got command BAM from MCS: ref #1412421
2019-02-05 19:21:16 [INFO    ] Finished processing BAM request
2019-02-05 19:21:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:21:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412421   8 58519 69676033 A  ERROR'
2019-02-05 19:21:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 19:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-02-05 19:21:16 [DEBUG   ] spawn_process: at 2019-02-05 19:21:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-02-05 19:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-02-05 19:21:16 [DEBUG   ] spawn_process: at 2019-02-05 19:21:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-02-05 19:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-02-05 19:21:16 [DEBUG   ] spawn_process: at 2019-02-05 19:21:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-02-05 19:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-02-05 19:21:16 [DEBUG   ] spawn_process: at 2019-02-05 19:21:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-02-05 19:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-02-05 19:21:16 [DEBUG   ] spawn_process: at 2019-02-05 19:21:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-02-05 19:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-02-05 19:21:16 [DEBUG   ] spawn_process: at 2019-02-05 19:21:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-02-05 19:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-02-05 19:21:16 [DEBUG   ] spawn_process: at 2019-02-05 19:21:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-02-05 19:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-02-05 19:21:16 [DEBUG   ] spawn_process: at 2019-02-05 19:21:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-02-05 19:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-02-05 19:21:16 [DEBUG   ] spawn_process: at 2019-02-05 19:21:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-02-05 19:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-02-05 19:21:16 [DEBUG   ] spawn_process: at 2019-02-05 19:21:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-02-05 19:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-02-05 19:21:16 [DEBUG   ] spawn_process: at 2019-02-05 19:21:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-02-05 19:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-02-05 19:21:16 [DEBUG   ] spawn_process: at 2019-02-05 19:21:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-02-05 19:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-02-05 19:21:16 [DEBUG   ] spawn_process: at 2019-02-05 19:21:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-02-05 19:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-02-05 19:21:16 [DEBUG   ] spawn_process: at 2019-02-05 19:21:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-02-05 19:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-02-05 19:21:16 [DEBUG   ] spawn_process: at 2019-02-05 19:21:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-02-05 19:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-02-05 19:21:16 [DEBUG   ] spawn_process: at 2019-02-05 19:21:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-02-05 19:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-02-05 19:21:16 [DEBUG   ] spawn_process: at 2019-02-05 19:21:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-02-05 19:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-02-05 19:21:16 [DEBUG   ] spawn_process: at 2019-02-05 19:21:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-02-05 19:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-02-05 19:21:16 [DEBUG   ] spawn_process: at 2019-02-05 19:21:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-02-05 19:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-02-05 19:21:16 [DEBUG   ] spawn_process: at 2019-02-05 19:21:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-02-05 19:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-02-05 19:21:16 [DEBUG   ] spawn_process: at 2019-02-05 19:21:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-02-05 19:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-02-05 19:21:16 [DEBUG   ] spawn_process: at 2019-02-05 19:21:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-02-05 19:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-02-05 19:21:16 [DEBUG   ] spawn_process: at 2019-02-05 19:21:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-02-05 19:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-02-05 19:21:16 [DEBUG   ] spawn_process: at 2019-02-05 19:21:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-02-05 19:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-02-05 19:21:16 [DEBUG   ] spawn_process: at 2019-02-05 19:21:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-02-05 19:21:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-02-05 19:21:16 [DEBUG   ] spawn_process: at 2019-02-05 19:21:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-02-05 19:21:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 19:21:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 19:21:59 [DEBUG   ] Got command BAM from MCS: ref #1412422
2019-02-05 19:21:59 [INFO    ] Finished processing BAM request
2019-02-05 19:21:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:21:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412422   8 58519 69719029 A  ERROR'
2019-02-05 19:21:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:21:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-02-05 19:21:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-02-05 19:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-02-05 19:21:59 [DEBUG   ] spawn_process: at 2019-02-05 19:21:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-02-05 19:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-02-05 19:21:59 [DEBUG   ] spawn_process: at 2019-02-05 19:21:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-02-05 19:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-02-05 19:21:59 [DEBUG   ] spawn_process: at 2019-02-05 19:21:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-02-05 19:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-02-05 19:21:59 [DEBUG   ] spawn_process: at 2019-02-05 19:21:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-02-05 19:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-02-05 19:21:59 [DEBUG   ] spawn_process: at 2019-02-05 19:21:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-02-05 19:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-02-05 19:21:59 [DEBUG   ] spawn_process: at 2019-02-05 19:21:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-02-05 19:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-02-05 19:21:59 [DEBUG   ] spawn_process: at 2019-02-05 19:21:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-02-05 19:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-02-05 19:21:59 [DEBUG   ] spawn_process: at 2019-02-05 19:21:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-02-05 19:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-02-05 19:21:59 [DEBUG   ] spawn_process: at 2019-02-05 19:21:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-02-05 19:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-02-05 19:21:59 [DEBUG   ] spawn_process: at 2019-02-05 19:21:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-02-05 19:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-02-05 19:21:59 [DEBUG   ] spawn_process: at 2019-02-05 19:21:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-02-05 19:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-02-05 19:21:59 [DEBUG   ] spawn_process: at 2019-02-05 19:21:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-02-05 19:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-02-05 19:21:59 [DEBUG   ] spawn_process: at 2019-02-05 19:21:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-02-05 19:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-02-05 19:21:59 [DEBUG   ] spawn_process: at 2019-02-05 19:21:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-02-05 19:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-02-05 19:21:59 [DEBUG   ] spawn_process: at 2019-02-05 19:21:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-02-05 19:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-02-05 19:21:59 [DEBUG   ] spawn_process: at 2019-02-05 19:21:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-02-05 19:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-02-05 19:21:59 [DEBUG   ] spawn_process: at 2019-02-05 19:21:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-02-05 19:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-02-05 19:21:59 [DEBUG   ] spawn_process: at 2019-02-05 19:21:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-02-05 19:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-02-05 19:21:59 [DEBUG   ] spawn_process: at 2019-02-05 19:21:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-02-05 19:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-02-05 19:21:59 [DEBUG   ] spawn_process: at 2019-02-05 19:21:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-02-05 19:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-02-05 19:21:59 [DEBUG   ] spawn_process: at 2019-02-05 19:21:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-02-05 19:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-02-05 19:21:59 [DEBUG   ] spawn_process: at 2019-02-05 19:21:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-02-05 19:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-02-05 19:21:59 [DEBUG   ] spawn_process: at 2019-02-05 19:21:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-02-05 19:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-02-05 19:21:59 [DEBUG   ] spawn_process: at 2019-02-05 19:21:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-02-05 19:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-02-05 19:21:59 [DEBUG   ] spawn_process: at 2019-02-05 19:21:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-02-05 19:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-02-05 19:21:59 [DEBUG   ] spawn_process: at 2019-02-05 19:21:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-02-05 19:22:00 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2019-02-05 19:22:00 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2019-02-05 19:22:00 [WARNING ] (13, 1, 'bot')
2019-02-05 19:22:00 [WARNING ] (13, 1, 'bot')
2019-02-05 19:22:00 [WARNING ] (13, 1, 'bot')
2019-02-05 19:22:00 [WARNING ] (13, 1, 'bot')
2019-02-05 19:22:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:22:00 [DEBUG   ] Finished updating board flags in 1.957 seconds
2019-02-05 19:22:11 [DEBUG   ] Got command BAM from MCS: ref #1412423
2019-02-05 19:22:11 [INFO    ] Finished processing BAM request
2019-02-05 19:22:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:22:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412423   8 58519 69731025 A  ERROR'
2019-02-05 19:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-02-05 19:22:11 [DEBUG   ] spawn_process: at 2019-02-05 19:22:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-02-05 19:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-02-05 19:22:11 [DEBUG   ] spawn_process: at 2019-02-05 19:22:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-02-05 19:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-02-05 19:22:11 [DEBUG   ] spawn_process: at 2019-02-05 19:22:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-02-05 19:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-02-05 19:22:11 [DEBUG   ] spawn_process: at 2019-02-05 19:22:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-02-05 19:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-02-05 19:22:11 [DEBUG   ] spawn_process: at 2019-02-05 19:22:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-02-05 19:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-02-05 19:22:11 [DEBUG   ] spawn_process: at 2019-02-05 19:22:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-02-05 19:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-02-05 19:22:11 [DEBUG   ] spawn_process: at 2019-02-05 19:22:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-02-05 19:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-02-05 19:22:11 [DEBUG   ] spawn_process: at 2019-02-05 19:22:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-02-05 19:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-02-05 19:22:11 [DEBUG   ] spawn_process: at 2019-02-05 19:22:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-02-05 19:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-02-05 19:22:11 [DEBUG   ] spawn_process: at 2019-02-05 19:22:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-02-05 19:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-02-05 19:22:11 [DEBUG   ] spawn_process: at 2019-02-05 19:22:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-02-05 19:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-02-05 19:22:11 [DEBUG   ] spawn_process: at 2019-02-05 19:22:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-02-05 19:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-02-05 19:22:11 [DEBUG   ] spawn_process: at 2019-02-05 19:22:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-02-05 19:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-02-05 19:22:11 [DEBUG   ] spawn_process: at 2019-02-05 19:22:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-02-05 19:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-02-05 19:22:11 [DEBUG   ] spawn_process: at 2019-02-05 19:22:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-02-05 19:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-02-05 19:22:11 [DEBUG   ] spawn_process: at 2019-02-05 19:22:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-02-05 19:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-02-05 19:22:11 [DEBUG   ] spawn_process: at 2019-02-05 19:22:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-02-05 19:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-02-05 19:22:11 [DEBUG   ] spawn_process: at 2019-02-05 19:22:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-02-05 19:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-02-05 19:22:11 [DEBUG   ] spawn_process: at 2019-02-05 19:22:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-02-05 19:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-02-05 19:22:11 [DEBUG   ] spawn_process: at 2019-02-05 19:22:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-02-05 19:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-02-05 19:22:11 [DEBUG   ] spawn_process: at 2019-02-05 19:22:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-02-05 19:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-02-05 19:22:11 [DEBUG   ] spawn_process: at 2019-02-05 19:22:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-02-05 19:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-02-05 19:22:11 [DEBUG   ] spawn_process: at 2019-02-05 19:22:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-02-05 19:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-02-05 19:22:11 [DEBUG   ] spawn_process: at 2019-02-05 19:22:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-02-05 19:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-02-05 19:22:11 [DEBUG   ] spawn_process: at 2019-02-05 19:22:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-02-05 19:22:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-02-05 19:22:11 [DEBUG   ] spawn_process: at 2019-02-05 19:22:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-02-05 19:22:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 19:22:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 19:22:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 19:22:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:22:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2019-02-05 19:22:59 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-02-05 19:22:59 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2019-02-05 19:22:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-05 19:22:59 [WARNING ] (13, 1, 'bot')
2019-02-05 19:22:59 [WARNING ] (13, 1, 'bot')
2019-02-05 19:22:59 [WARNING ] (13, 1, 'bot')
2019-02-05 19:22:59 [WARNING ] (13, 1, 'bot')
2019-02-05 19:22:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:22:59 [DEBUG   ] Finished updating board flags in 1.286 seconds
2019-02-05 19:23:07 [DEBUG   ] Got command BAM from MCS: ref #1412424
2019-02-05 19:23:07 [INFO    ] Finished processing BAM request
2019-02-05 19:23:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:23:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412424   8 58519 69787029 A  ERROR'
2019-02-05 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 19:23:07 [DEBUG   ] spawn_process: at 2019-02-05 19:23:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 19:23:07 [DEBUG   ] spawn_process: at 2019-02-05 19:23:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 19:23:07 [DEBUG   ] spawn_process: at 2019-02-05 19:23:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 19:23:07 [DEBUG   ] spawn_process: at 2019-02-05 19:23:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 19:23:07 [DEBUG   ] spawn_process: at 2019-02-05 19:23:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 19:23:07 [DEBUG   ] spawn_process: at 2019-02-05 19:23:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 19:23:07 [DEBUG   ] spawn_process: at 2019-02-05 19:23:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 19:23:07 [DEBUG   ] spawn_process: at 2019-02-05 19:23:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 19:23:07 [DEBUG   ] spawn_process: at 2019-02-05 19:23:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 19:23:07 [DEBUG   ] spawn_process: at 2019-02-05 19:23:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 19:23:07 [DEBUG   ] spawn_process: at 2019-02-05 19:23:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 19:23:07 [DEBUG   ] spawn_process: at 2019-02-05 19:23:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 19:23:07 [DEBUG   ] spawn_process: at 2019-02-05 19:23:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 19:23:07 [DEBUG   ] spawn_process: at 2019-02-05 19:23:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 19:23:07 [DEBUG   ] spawn_process: at 2019-02-05 19:23:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 19:23:07 [DEBUG   ] spawn_process: at 2019-02-05 19:23:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 19:23:07 [DEBUG   ] spawn_process: at 2019-02-05 19:23:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 19:23:07 [DEBUG   ] spawn_process: at 2019-02-05 19:23:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 19:23:07 [DEBUG   ] spawn_process: at 2019-02-05 19:23:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 19:23:07 [DEBUG   ] spawn_process: at 2019-02-05 19:23:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 19:23:07 [DEBUG   ] spawn_process: at 2019-02-05 19:23:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 19:23:07 [DEBUG   ] spawn_process: at 2019-02-05 19:23:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 19:23:07 [DEBUG   ] spawn_process: at 2019-02-05 19:23:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 19:23:07 [DEBUG   ] spawn_process: at 2019-02-05 19:23:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 19:23:07 [DEBUG   ] spawn_process: at 2019-02-05 19:23:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 19:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 19:23:07 [DEBUG   ] spawn_process: at 2019-02-05 19:23:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 19:23:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 19:23:27 [DEBUG   ] Got command BAM from MCS: ref #1412429
2019-02-05 19:23:27 [INFO    ] Finished processing BAM request
2019-02-05 19:23:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:23:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412429   8 58519 69807033 A  ERROR'
2019-02-05 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 19:23:27 [DEBUG   ] spawn_process: at 2019-02-05 19:23:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 19:23:27 [DEBUG   ] spawn_process: at 2019-02-05 19:23:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 19:23:27 [DEBUG   ] spawn_process: at 2019-02-05 19:23:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 19:23:27 [DEBUG   ] spawn_process: at 2019-02-05 19:23:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 19:23:27 [DEBUG   ] spawn_process: at 2019-02-05 19:23:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 19:23:27 [DEBUG   ] spawn_process: at 2019-02-05 19:23:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 19:23:27 [DEBUG   ] spawn_process: at 2019-02-05 19:23:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 19:23:27 [DEBUG   ] spawn_process: at 2019-02-05 19:23:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 19:23:27 [DEBUG   ] spawn_process: at 2019-02-05 19:23:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 19:23:27 [DEBUG   ] spawn_process: at 2019-02-05 19:23:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 19:23:27 [DEBUG   ] spawn_process: at 2019-02-05 19:23:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 19:23:27 [DEBUG   ] spawn_process: at 2019-02-05 19:23:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 19:23:27 [DEBUG   ] spawn_process: at 2019-02-05 19:23:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 19:23:27 [DEBUG   ] spawn_process: at 2019-02-05 19:23:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 19:23:27 [DEBUG   ] spawn_process: at 2019-02-05 19:23:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 19:23:27 [DEBUG   ] spawn_process: at 2019-02-05 19:23:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 19:23:27 [DEBUG   ] spawn_process: at 2019-02-05 19:23:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 19:23:27 [DEBUG   ] spawn_process: at 2019-02-05 19:23:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 19:23:27 [DEBUG   ] spawn_process: at 2019-02-05 19:23:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 19:23:27 [DEBUG   ] spawn_process: at 2019-02-05 19:23:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 19:23:27 [DEBUG   ] spawn_process: at 2019-02-05 19:23:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 19:23:27 [DEBUG   ] spawn_process: at 2019-02-05 19:23:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 19:23:27 [DEBUG   ] spawn_process: at 2019-02-05 19:23:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 19:23:27 [DEBUG   ] spawn_process: at 2019-02-05 19:23:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 19:23:27 [DEBUG   ] spawn_process: at 2019-02-05 19:23:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 19:23:27 [DEBUG   ] spawn_process: at 2019-02-05 19:23:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 19:23:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 19:23:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 19:23:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 19:23:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2019-02-05 19:23:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:23:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2019-02-05 19:23:59 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-02-05 19:23:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-02-05 19:23:59 [WARNING ] (13, 1, 'bot')
2019-02-05 19:23:59 [WARNING ] (13, 1, 'bot')
2019-02-05 19:23:59 [WARNING ] (13, 1, 'bot')
2019-02-05 19:23:59 [WARNING ] (13, 1, 'bot')
2019-02-05 19:23:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:23:59 [DEBUG   ] Finished updating board flags in 1.225 seconds
2019-02-05 19:24:05 [DEBUG   ] Got command BAM from MCS: ref #1412430
2019-02-05 19:24:05 [INFO    ] Finished processing BAM request
2019-02-05 19:24:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:24:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412430   8 58519 69845025 A  ERROR'
2019-02-05 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-02-05 19:24:05 [DEBUG   ] spawn_process: at 2019-02-05 19:24:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-02-05 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-02-05 19:24:05 [DEBUG   ] spawn_process: at 2019-02-05 19:24:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-02-05 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-02-05 19:24:05 [DEBUG   ] spawn_process: at 2019-02-05 19:24:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-02-05 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-02-05 19:24:05 [DEBUG   ] spawn_process: at 2019-02-05 19:24:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-02-05 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-02-05 19:24:05 [DEBUG   ] spawn_process: at 2019-02-05 19:24:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-02-05 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-02-05 19:24:05 [DEBUG   ] spawn_process: at 2019-02-05 19:24:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-02-05 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-02-05 19:24:05 [DEBUG   ] spawn_process: at 2019-02-05 19:24:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-02-05 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-02-05 19:24:05 [DEBUG   ] spawn_process: at 2019-02-05 19:24:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-02-05 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-02-05 19:24:05 [DEBUG   ] spawn_process: at 2019-02-05 19:24:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-02-05 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-02-05 19:24:05 [DEBUG   ] spawn_process: at 2019-02-05 19:24:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-02-05 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-02-05 19:24:05 [DEBUG   ] spawn_process: at 2019-02-05 19:24:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-02-05 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-02-05 19:24:05 [DEBUG   ] spawn_process: at 2019-02-05 19:24:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-02-05 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-02-05 19:24:05 [DEBUG   ] spawn_process: at 2019-02-05 19:24:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-02-05 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-02-05 19:24:05 [DEBUG   ] spawn_process: at 2019-02-05 19:24:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-02-05 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-02-05 19:24:05 [DEBUG   ] spawn_process: at 2019-02-05 19:24:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-02-05 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-02-05 19:24:05 [DEBUG   ] spawn_process: at 2019-02-05 19:24:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-02-05 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-02-05 19:24:05 [DEBUG   ] spawn_process: at 2019-02-05 19:24:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-02-05 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-02-05 19:24:05 [DEBUG   ] spawn_process: at 2019-02-05 19:24:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-02-05 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-02-05 19:24:05 [DEBUG   ] spawn_process: at 2019-02-05 19:24:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-02-05 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-02-05 19:24:05 [DEBUG   ] spawn_process: at 2019-02-05 19:24:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-02-05 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-02-05 19:24:05 [DEBUG   ] spawn_process: at 2019-02-05 19:24:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-02-05 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-02-05 19:24:05 [DEBUG   ] spawn_process: at 2019-02-05 19:24:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-02-05 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-02-05 19:24:05 [DEBUG   ] spawn_process: at 2019-02-05 19:24:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-02-05 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-02-05 19:24:05 [DEBUG   ] spawn_process: at 2019-02-05 19:24:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-02-05 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-02-05 19:24:05 [DEBUG   ] spawn_process: at 2019-02-05 19:24:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-02-05 19:24:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-02-05 19:24:05 [DEBUG   ] spawn_process: at 2019-02-05 19:24:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-02-05 19:24:16 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-05 19:24:36 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 19:24:54 [DEBUG   ] Got command BAM from MCS: ref #1412433
2019-02-05 19:24:54 [INFO    ] Finished processing BAM request
2019-02-05 19:24:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:24:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412433   8 58519 69894033 A  ERROR'
2019-02-05 19:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-02-05 19:24:54 [DEBUG   ] spawn_process: at 2019-02-05 19:24:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-02-05 19:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-02-05 19:24:54 [DEBUG   ] spawn_process: at 2019-02-05 19:24:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-02-05 19:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-02-05 19:24:54 [DEBUG   ] spawn_process: at 2019-02-05 19:24:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-02-05 19:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-02-05 19:24:54 [DEBUG   ] spawn_process: at 2019-02-05 19:24:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-02-05 19:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-02-05 19:24:54 [DEBUG   ] spawn_process: at 2019-02-05 19:24:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-02-05 19:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-02-05 19:24:54 [DEBUG   ] spawn_process: at 2019-02-05 19:24:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-02-05 19:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-02-05 19:24:54 [DEBUG   ] spawn_process: at 2019-02-05 19:24:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-02-05 19:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-02-05 19:24:54 [DEBUG   ] spawn_process: at 2019-02-05 19:24:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-02-05 19:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-02-05 19:24:54 [DEBUG   ] spawn_process: at 2019-02-05 19:24:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-02-05 19:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-02-05 19:24:54 [DEBUG   ] spawn_process: at 2019-02-05 19:24:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-02-05 19:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-02-05 19:24:54 [DEBUG   ] spawn_process: at 2019-02-05 19:24:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-02-05 19:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-02-05 19:24:54 [DEBUG   ] spawn_process: at 2019-02-05 19:24:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-02-05 19:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-02-05 19:24:54 [DEBUG   ] spawn_process: at 2019-02-05 19:24:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-02-05 19:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-02-05 19:24:54 [DEBUG   ] spawn_process: at 2019-02-05 19:24:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-02-05 19:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-02-05 19:24:54 [DEBUG   ] spawn_process: at 2019-02-05 19:24:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-02-05 19:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-02-05 19:24:54 [DEBUG   ] spawn_process: at 2019-02-05 19:24:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-02-05 19:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-02-05 19:24:54 [DEBUG   ] spawn_process: at 2019-02-05 19:24:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-02-05 19:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-02-05 19:24:54 [DEBUG   ] spawn_process: at 2019-02-05 19:24:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-02-05 19:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-02-05 19:24:54 [DEBUG   ] spawn_process: at 2019-02-05 19:24:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-02-05 19:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-02-05 19:24:54 [DEBUG   ] spawn_process: at 2019-02-05 19:24:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-02-05 19:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-02-05 19:24:54 [DEBUG   ] spawn_process: at 2019-02-05 19:24:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-02-05 19:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-02-05 19:24:54 [DEBUG   ] spawn_process: at 2019-02-05 19:24:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-02-05 19:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-02-05 19:24:54 [DEBUG   ] spawn_process: at 2019-02-05 19:24:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-02-05 19:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-02-05 19:24:54 [DEBUG   ] spawn_process: at 2019-02-05 19:24:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-02-05 19:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-02-05 19:24:54 [DEBUG   ] spawn_process: at 2019-02-05 19:24:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-02-05 19:24:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-02-05 19:24:54 [DEBUG   ] spawn_process: at 2019-02-05 19:24:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-02-05 19:24:55 [DEBUG   ] Got command RPT from MCS: ref #1412434
2019-02-05 19:24:55 [DEBUG   ] summary = ERROR
2019-02-05 19:24:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412434  13 58519 69895701 A  ERRORERROR'
2019-02-05 19:24:55 [DEBUG   ] Got command RPT from MCS: ref #1412435
2019-02-05 19:24:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 19:24:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412435  77 58519 69895905 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 19:24:56 [DEBUG   ] Got command RPT from MCS: ref #1412436
2019-02-05 19:24:56 [DEBUG   ] summary = ERROR
2019-02-05 19:24:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412436  13 58519 69896109 A  ERRORERROR'
2019-02-05 19:24:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 19:24:56 [DEBUG   ] Got command RPT from MCS: ref #1412438
2019-02-05 19:24:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 19:24:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412438  77 58519 69896301 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 19:24:56 [DEBUG   ] Got command RPT from MCS: ref #1412440
2019-02-05 19:24:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 19:24:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412440  12 58519 69896505 A  ERRORB¤ff'
2019-02-05 19:24:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:24:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-02-05 19:24:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2019-02-05 19:24:59 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-02-05 19:24:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-02-05 19:24:59 [WARNING ] (13, 1, 'bot')
2019-02-05 19:24:59 [WARNING ] (13, 1, 'bot')
2019-02-05 19:24:59 [WARNING ] (13, 1, 'bot')
2019-02-05 19:24:59 [WARNING ] (13, 1, 'bot')
2019-02-05 19:24:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:24:59 [DEBUG   ] Finished updating board flags in 1.145 seconds
2019-02-05 19:25:05 [DEBUG   ] Got command BAM from MCS: ref #1412444
2019-02-05 19:25:05 [INFO    ] Finished processing BAM request
2019-02-05 19:25:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:25:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412444   8 58519 69905025 A  ERROR'
2019-02-05 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-02-05 19:25:05 [DEBUG   ] spawn_process: at 2019-02-05 19:25:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-02-05 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-02-05 19:25:05 [DEBUG   ] spawn_process: at 2019-02-05 19:25:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-02-05 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-02-05 19:25:05 [DEBUG   ] spawn_process: at 2019-02-05 19:25:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-02-05 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-02-05 19:25:05 [DEBUG   ] spawn_process: at 2019-02-05 19:25:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-02-05 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-02-05 19:25:05 [DEBUG   ] spawn_process: at 2019-02-05 19:25:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-02-05 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-02-05 19:25:05 [DEBUG   ] spawn_process: at 2019-02-05 19:25:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-02-05 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-02-05 19:25:05 [DEBUG   ] spawn_process: at 2019-02-05 19:25:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-02-05 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-02-05 19:25:05 [DEBUG   ] spawn_process: at 2019-02-05 19:25:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-02-05 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-02-05 19:25:05 [DEBUG   ] spawn_process: at 2019-02-05 19:25:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-02-05 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-02-05 19:25:05 [DEBUG   ] spawn_process: at 2019-02-05 19:25:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-02-05 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-02-05 19:25:05 [DEBUG   ] spawn_process: at 2019-02-05 19:25:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-02-05 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-02-05 19:25:05 [DEBUG   ] spawn_process: at 2019-02-05 19:25:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-02-05 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-02-05 19:25:05 [DEBUG   ] spawn_process: at 2019-02-05 19:25:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-02-05 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-02-05 19:25:05 [DEBUG   ] spawn_process: at 2019-02-05 19:25:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-02-05 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-02-05 19:25:05 [DEBUG   ] spawn_process: at 2019-02-05 19:25:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-02-05 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-02-05 19:25:05 [DEBUG   ] spawn_process: at 2019-02-05 19:25:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-02-05 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-02-05 19:25:05 [DEBUG   ] spawn_process: at 2019-02-05 19:25:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-02-05 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-02-05 19:25:05 [DEBUG   ] spawn_process: at 2019-02-05 19:25:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-02-05 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-02-05 19:25:05 [DEBUG   ] spawn_process: at 2019-02-05 19:25:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-02-05 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-02-05 19:25:05 [DEBUG   ] spawn_process: at 2019-02-05 19:25:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-02-05 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-02-05 19:25:05 [DEBUG   ] spawn_process: at 2019-02-05 19:25:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-02-05 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-02-05 19:25:05 [DEBUG   ] spawn_process: at 2019-02-05 19:25:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-02-05 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-02-05 19:25:05 [DEBUG   ] spawn_process: at 2019-02-05 19:25:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-02-05 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-02-05 19:25:05 [DEBUG   ] spawn_process: at 2019-02-05 19:25:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-02-05 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-02-05 19:25:05 [DEBUG   ] spawn_process: at 2019-02-05 19:25:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-02-05 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-02-05 19:25:05 [DEBUG   ] spawn_process: at 2019-02-05 19:25:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-02-05 19:25:16 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 19:25:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-05 19:25:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-05 19:25:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:25:59 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-02-05 19:25:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-02-05 19:25:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-02-05 19:25:59 [WARNING ] (13, 1, 'bot')
2019-02-05 19:25:59 [WARNING ] (13, 1, 'bot')
2019-02-05 19:25:59 [WARNING ] (13, 1, 'bot')
2019-02-05 19:25:59 [WARNING ] (13, 1, 'bot')
2019-02-05 19:25:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:25:59 [DEBUG   ] Finished updating board flags in 1.027 seconds
2019-02-05 19:26:07 [DEBUG   ] Got command BAM from MCS: ref #1412445
2019-02-05 19:26:07 [INFO    ] Finished processing BAM request
2019-02-05 19:26:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:26:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412445   8 58519 69967033 A  ERROR'
2019-02-05 19:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 19:26:07 [DEBUG   ] spawn_process: at 2019-02-05 19:26:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 19:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 19:26:07 [DEBUG   ] spawn_process: at 2019-02-05 19:26:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 19:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 19:26:07 [DEBUG   ] spawn_process: at 2019-02-05 19:26:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 19:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 19:26:07 [DEBUG   ] spawn_process: at 2019-02-05 19:26:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 19:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 19:26:07 [DEBUG   ] spawn_process: at 2019-02-05 19:26:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 19:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 19:26:07 [DEBUG   ] spawn_process: at 2019-02-05 19:26:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 19:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 19:26:07 [DEBUG   ] spawn_process: at 2019-02-05 19:26:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 19:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 19:26:07 [DEBUG   ] spawn_process: at 2019-02-05 19:26:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 19:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 19:26:07 [DEBUG   ] spawn_process: at 2019-02-05 19:26:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 19:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 19:26:07 [DEBUG   ] spawn_process: at 2019-02-05 19:26:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 19:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 19:26:07 [DEBUG   ] spawn_process: at 2019-02-05 19:26:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 19:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 19:26:07 [DEBUG   ] spawn_process: at 2019-02-05 19:26:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 19:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 19:26:07 [DEBUG   ] spawn_process: at 2019-02-05 19:26:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 19:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 19:26:07 [DEBUG   ] spawn_process: at 2019-02-05 19:26:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 19:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 19:26:07 [DEBUG   ] spawn_process: at 2019-02-05 19:26:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 19:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 19:26:07 [DEBUG   ] spawn_process: at 2019-02-05 19:26:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 19:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 19:26:07 [DEBUG   ] spawn_process: at 2019-02-05 19:26:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 19:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 19:26:07 [DEBUG   ] spawn_process: at 2019-02-05 19:26:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 19:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 19:26:07 [DEBUG   ] spawn_process: at 2019-02-05 19:26:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 19:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 19:26:07 [DEBUG   ] spawn_process: at 2019-02-05 19:26:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 19:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 19:26:07 [DEBUG   ] spawn_process: at 2019-02-05 19:26:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 19:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 19:26:07 [DEBUG   ] spawn_process: at 2019-02-05 19:26:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 19:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 19:26:07 [DEBUG   ] spawn_process: at 2019-02-05 19:26:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 19:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 19:26:07 [DEBUG   ] spawn_process: at 2019-02-05 19:26:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 19:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 19:26:07 [DEBUG   ] spawn_process: at 2019-02-05 19:26:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 19:26:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 19:26:07 [DEBUG   ] spawn_process: at 2019-02-05 19:26:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 19:26:12 [DEBUG   ] Got command RPT from MCS: ref #1412446
2019-02-05 19:26:12 [DEBUG   ] summary = ERROR
2019-02-05 19:26:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412446  13 58519 69972013 A  ERRORERROR'
2019-02-05 19:26:12 [DEBUG   ] Got command RPT from MCS: ref #1412447
2019-02-05 19:26:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 19:26:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412447  77 58519 69972014 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 19:26:16 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 19:26:19 [DEBUG   ] Got command BAM from MCS: ref #1412467
2019-02-05 19:26:19 [INFO    ] Finished processing BAM request
2019-02-05 19:26:19 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:26:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412467   8 58519 69979029 A  ERROR'
2019-02-05 19:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-02-05 19:26:19 [DEBUG   ] spawn_process: at 2019-02-05 19:26:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-02-05 19:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-02-05 19:26:19 [DEBUG   ] spawn_process: at 2019-02-05 19:26:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-02-05 19:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-02-05 19:26:19 [DEBUG   ] spawn_process: at 2019-02-05 19:26:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-02-05 19:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-02-05 19:26:19 [DEBUG   ] spawn_process: at 2019-02-05 19:26:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-02-05 19:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-02-05 19:26:19 [DEBUG   ] spawn_process: at 2019-02-05 19:26:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-02-05 19:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-02-05 19:26:19 [DEBUG   ] spawn_process: at 2019-02-05 19:26:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-02-05 19:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-02-05 19:26:19 [DEBUG   ] spawn_process: at 2019-02-05 19:26:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-02-05 19:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-02-05 19:26:19 [DEBUG   ] spawn_process: at 2019-02-05 19:26:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-02-05 19:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-02-05 19:26:19 [DEBUG   ] spawn_process: at 2019-02-05 19:26:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-02-05 19:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-02-05 19:26:19 [DEBUG   ] spawn_process: at 2019-02-05 19:26:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-02-05 19:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-02-05 19:26:19 [DEBUG   ] spawn_process: at 2019-02-05 19:26:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-02-05 19:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-02-05 19:26:19 [DEBUG   ] spawn_process: at 2019-02-05 19:26:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-02-05 19:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-02-05 19:26:19 [DEBUG   ] spawn_process: at 2019-02-05 19:26:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-02-05 19:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-02-05 19:26:19 [DEBUG   ] spawn_process: at 2019-02-05 19:26:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-02-05 19:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-02-05 19:26:19 [DEBUG   ] spawn_process: at 2019-02-05 19:26:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-02-05 19:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-02-05 19:26:19 [DEBUG   ] spawn_process: at 2019-02-05 19:26:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-02-05 19:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-02-05 19:26:19 [DEBUG   ] spawn_process: at 2019-02-05 19:26:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-02-05 19:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-02-05 19:26:19 [DEBUG   ] spawn_process: at 2019-02-05 19:26:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-02-05 19:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-02-05 19:26:19 [DEBUG   ] spawn_process: at 2019-02-05 19:26:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-02-05 19:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-02-05 19:26:19 [DEBUG   ] spawn_process: at 2019-02-05 19:26:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-02-05 19:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-02-05 19:26:19 [DEBUG   ] spawn_process: at 2019-02-05 19:26:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-02-05 19:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-02-05 19:26:19 [DEBUG   ] spawn_process: at 2019-02-05 19:26:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-02-05 19:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-02-05 19:26:19 [DEBUG   ] spawn_process: at 2019-02-05 19:26:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-02-05 19:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-02-05 19:26:19 [DEBUG   ] spawn_process: at 2019-02-05 19:26:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-02-05 19:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-02-05 19:26:19 [DEBUG   ] spawn_process: at 2019-02-05 19:26:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-02-05 19:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-02-05 19:26:19 [DEBUG   ] spawn_process: at 2019-02-05 19:26:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-02-05 19:26:36 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 19:26:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 19:26:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:26:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-02-05 19:26:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 19:26:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2019-02-05 19:26:59 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-02-05 19:26:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-02-05 19:26:59 [WARNING ] (13, 1, 'bot')
2019-02-05 19:26:59 [WARNING ] (13, 1, 'bot')
2019-02-05 19:26:59 [WARNING ] (13, 1, 'bot')
2019-02-05 19:26:59 [WARNING ] (13, 1, 'bot')
2019-02-05 19:26:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:26:59 [DEBUG   ] Finished updating board flags in 0.976 seconds
2019-02-05 19:27:10 [DEBUG   ] Got command BAM from MCS: ref #1412468
2019-02-05 19:27:10 [INFO    ] Finished processing BAM request
2019-02-05 19:27:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:27:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412468   8 58519 70030025 A  ERROR'
2019-02-05 19:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 19:27:10 [DEBUG   ] spawn_process: at 2019-02-05 19:27:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 19:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 19:27:10 [DEBUG   ] spawn_process: at 2019-02-05 19:27:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 19:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 19:27:10 [DEBUG   ] spawn_process: at 2019-02-05 19:27:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 19:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 19:27:10 [DEBUG   ] spawn_process: at 2019-02-05 19:27:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 19:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 19:27:10 [DEBUG   ] spawn_process: at 2019-02-05 19:27:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 19:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 19:27:10 [DEBUG   ] spawn_process: at 2019-02-05 19:27:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 19:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 19:27:10 [DEBUG   ] spawn_process: at 2019-02-05 19:27:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 19:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 19:27:10 [DEBUG   ] spawn_process: at 2019-02-05 19:27:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 19:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 19:27:10 [DEBUG   ] spawn_process: at 2019-02-05 19:27:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 19:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 19:27:10 [DEBUG   ] spawn_process: at 2019-02-05 19:27:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 19:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 19:27:10 [DEBUG   ] spawn_process: at 2019-02-05 19:27:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 19:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 19:27:10 [DEBUG   ] spawn_process: at 2019-02-05 19:27:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 19:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 19:27:10 [DEBUG   ] spawn_process: at 2019-02-05 19:27:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 19:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 19:27:10 [DEBUG   ] spawn_process: at 2019-02-05 19:27:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 19:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 19:27:10 [DEBUG   ] spawn_process: at 2019-02-05 19:27:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 19:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 19:27:10 [DEBUG   ] spawn_process: at 2019-02-05 19:27:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 19:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 19:27:10 [DEBUG   ] spawn_process: at 2019-02-05 19:27:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 19:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 19:27:10 [DEBUG   ] spawn_process: at 2019-02-05 19:27:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 19:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 19:27:10 [DEBUG   ] spawn_process: at 2019-02-05 19:27:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 19:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 19:27:10 [DEBUG   ] spawn_process: at 2019-02-05 19:27:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 19:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 19:27:10 [DEBUG   ] spawn_process: at 2019-02-05 19:27:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 19:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 19:27:10 [DEBUG   ] spawn_process: at 2019-02-05 19:27:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 19:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 19:27:10 [DEBUG   ] spawn_process: at 2019-02-05 19:27:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 19:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 19:27:10 [DEBUG   ] spawn_process: at 2019-02-05 19:27:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 19:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 19:27:10 [DEBUG   ] spawn_process: at 2019-02-05 19:27:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 19:27:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 19:27:10 [DEBUG   ] spawn_process: at 2019-02-05 19:27:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 19:27:16 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 19:27:36 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 19:27:43 [DEBUG   ] Got command BAM from MCS: ref #1412469
2019-02-05 19:27:43 [INFO    ] Finished processing BAM request
2019-02-05 19:27:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:27:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412469   8 58519 70063025 A  ERROR'
2019-02-05 19:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-02-05 19:27:43 [DEBUG   ] spawn_process: at 2019-02-05 19:27:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-02-05 19:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-02-05 19:27:43 [DEBUG   ] spawn_process: at 2019-02-05 19:27:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-02-05 19:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-02-05 19:27:43 [DEBUG   ] spawn_process: at 2019-02-05 19:27:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-02-05 19:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-02-05 19:27:43 [DEBUG   ] spawn_process: at 2019-02-05 19:27:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-02-05 19:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-02-05 19:27:43 [DEBUG   ] spawn_process: at 2019-02-05 19:27:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-02-05 19:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-02-05 19:27:43 [DEBUG   ] spawn_process: at 2019-02-05 19:27:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-02-05 19:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-02-05 19:27:43 [DEBUG   ] spawn_process: at 2019-02-05 19:27:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-02-05 19:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-02-05 19:27:43 [DEBUG   ] spawn_process: at 2019-02-05 19:27:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-02-05 19:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-02-05 19:27:43 [DEBUG   ] spawn_process: at 2019-02-05 19:27:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-02-05 19:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-02-05 19:27:43 [DEBUG   ] spawn_process: at 2019-02-05 19:27:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-02-05 19:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-02-05 19:27:43 [DEBUG   ] spawn_process: at 2019-02-05 19:27:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-02-05 19:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-02-05 19:27:43 [DEBUG   ] spawn_process: at 2019-02-05 19:27:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-02-05 19:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-02-05 19:27:43 [DEBUG   ] spawn_process: at 2019-02-05 19:27:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-02-05 19:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-02-05 19:27:43 [DEBUG   ] spawn_process: at 2019-02-05 19:27:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-02-05 19:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-02-05 19:27:43 [DEBUG   ] spawn_process: at 2019-02-05 19:27:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-02-05 19:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-02-05 19:27:43 [DEBUG   ] spawn_process: at 2019-02-05 19:27:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-02-05 19:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-02-05 19:27:43 [DEBUG   ] spawn_process: at 2019-02-05 19:27:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-02-05 19:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-02-05 19:27:43 [DEBUG   ] spawn_process: at 2019-02-05 19:27:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-02-05 19:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-02-05 19:27:43 [DEBUG   ] spawn_process: at 2019-02-05 19:27:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-02-05 19:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-02-05 19:27:43 [DEBUG   ] spawn_process: at 2019-02-05 19:27:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-02-05 19:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-02-05 19:27:43 [DEBUG   ] spawn_process: at 2019-02-05 19:27:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-02-05 19:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-02-05 19:27:43 [DEBUG   ] spawn_process: at 2019-02-05 19:27:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-02-05 19:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-02-05 19:27:43 [DEBUG   ] spawn_process: at 2019-02-05 19:27:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-02-05 19:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-02-05 19:27:43 [DEBUG   ] spawn_process: at 2019-02-05 19:27:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-02-05 19:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-02-05 19:27:43 [DEBUG   ] spawn_process: at 2019-02-05 19:27:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-02-05 19:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-02-05 19:27:43 [DEBUG   ] spawn_process: at 2019-02-05 19:27:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-02-05 19:27:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 19:27:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-02-05 19:27:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:28:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 19:28:00 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-02-05 19:28:00 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-02-05 19:28:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-05 19:28:00 [WARNING ] (13, 1, 'bot')
2019-02-05 19:28:00 [WARNING ] (13, 1, 'bot')
2019-02-05 19:28:00 [WARNING ] (13, 1, 'bot')
2019-02-05 19:28:00 [WARNING ] (13, 1, 'bot')
2019-02-05 19:28:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:28:00 [DEBUG   ] Finished updating board flags in 1.365 seconds
2019-02-05 19:28:16 [DEBUG   ] Got command BAM from MCS: ref #1412470
2019-02-05 19:28:16 [INFO    ] Finished processing BAM request
2019-02-05 19:28:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:28:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412470   8 58519 70096025 A  ERROR'
2019-02-05 19:28:16 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 19:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-02-05 19:28:16 [DEBUG   ] spawn_process: at 2019-02-05 19:28:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-02-05 19:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-02-05 19:28:16 [DEBUG   ] spawn_process: at 2019-02-05 19:28:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-02-05 19:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-02-05 19:28:16 [DEBUG   ] spawn_process: at 2019-02-05 19:28:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-02-05 19:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-02-05 19:28:16 [DEBUG   ] spawn_process: at 2019-02-05 19:28:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-02-05 19:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-02-05 19:28:16 [DEBUG   ] spawn_process: at 2019-02-05 19:28:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-02-05 19:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-02-05 19:28:16 [DEBUG   ] spawn_process: at 2019-02-05 19:28:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-02-05 19:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-02-05 19:28:16 [DEBUG   ] spawn_process: at 2019-02-05 19:28:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-02-05 19:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-02-05 19:28:16 [DEBUG   ] spawn_process: at 2019-02-05 19:28:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-02-05 19:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-02-05 19:28:16 [DEBUG   ] spawn_process: at 2019-02-05 19:28:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-02-05 19:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-02-05 19:28:16 [DEBUG   ] spawn_process: at 2019-02-05 19:28:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-02-05 19:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-02-05 19:28:16 [DEBUG   ] spawn_process: at 2019-02-05 19:28:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-02-05 19:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-02-05 19:28:16 [DEBUG   ] spawn_process: at 2019-02-05 19:28:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-02-05 19:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-02-05 19:28:16 [DEBUG   ] spawn_process: at 2019-02-05 19:28:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-02-05 19:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-02-05 19:28:16 [DEBUG   ] spawn_process: at 2019-02-05 19:28:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-02-05 19:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-02-05 19:28:16 [DEBUG   ] spawn_process: at 2019-02-05 19:28:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-02-05 19:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-02-05 19:28:16 [DEBUG   ] spawn_process: at 2019-02-05 19:28:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-02-05 19:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-02-05 19:28:16 [DEBUG   ] spawn_process: at 2019-02-05 19:28:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-02-05 19:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-02-05 19:28:16 [DEBUG   ] spawn_process: at 2019-02-05 19:28:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-02-05 19:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-02-05 19:28:16 [DEBUG   ] spawn_process: at 2019-02-05 19:28:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-02-05 19:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-02-05 19:28:16 [DEBUG   ] spawn_process: at 2019-02-05 19:28:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-02-05 19:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-02-05 19:28:16 [DEBUG   ] spawn_process: at 2019-02-05 19:28:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-02-05 19:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-02-05 19:28:16 [DEBUG   ] spawn_process: at 2019-02-05 19:28:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-02-05 19:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-02-05 19:28:16 [DEBUG   ] spawn_process: at 2019-02-05 19:28:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-02-05 19:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-02-05 19:28:16 [DEBUG   ] spawn_process: at 2019-02-05 19:28:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-02-05 19:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-02-05 19:28:16 [DEBUG   ] spawn_process: at 2019-02-05 19:28:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-02-05 19:28:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-02-05 19:28:16 [DEBUG   ] spawn_process: at 2019-02-05 19:28:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-02-05 19:28:36 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 19:28:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 19:28:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 19:28:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2019-02-05 19:28:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:29:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 19:29:00 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-02-05 19:29:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-02-05 19:29:00 [WARNING ] (13, 1, 'bot')
2019-02-05 19:29:00 [WARNING ] (13, 1, 'bot')
2019-02-05 19:29:00 [WARNING ] (13, 1, 'bot')
2019-02-05 19:29:00 [WARNING ] (13, 1, 'bot')
2019-02-05 19:29:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:29:00 [DEBUG   ] Finished updating board flags in 1.193 seconds
2019-02-05 19:29:06 [DEBUG   ] Got command BAM from MCS: ref #1412471
2019-02-05 19:29:06 [INFO    ] Finished processing BAM request
2019-02-05 19:29:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412471   8 58519 70146025 A  ERROR'
2019-02-05 19:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-02-05 19:29:06 [DEBUG   ] spawn_process: at 2019-02-05 19:29:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-02-05 19:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-02-05 19:29:06 [DEBUG   ] spawn_process: at 2019-02-05 19:29:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-02-05 19:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-02-05 19:29:06 [DEBUG   ] spawn_process: at 2019-02-05 19:29:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-02-05 19:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-02-05 19:29:06 [DEBUG   ] spawn_process: at 2019-02-05 19:29:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-02-05 19:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-02-05 19:29:06 [DEBUG   ] spawn_process: at 2019-02-05 19:29:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-02-05 19:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-02-05 19:29:06 [DEBUG   ] spawn_process: at 2019-02-05 19:29:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-02-05 19:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-02-05 19:29:06 [DEBUG   ] spawn_process: at 2019-02-05 19:29:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-02-05 19:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-02-05 19:29:06 [DEBUG   ] spawn_process: at 2019-02-05 19:29:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-02-05 19:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-02-05 19:29:06 [DEBUG   ] spawn_process: at 2019-02-05 19:29:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-02-05 19:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-02-05 19:29:06 [DEBUG   ] spawn_process: at 2019-02-05 19:29:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-02-05 19:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-02-05 19:29:06 [DEBUG   ] spawn_process: at 2019-02-05 19:29:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-02-05 19:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-02-05 19:29:06 [DEBUG   ] spawn_process: at 2019-02-05 19:29:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-02-05 19:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-02-05 19:29:06 [DEBUG   ] spawn_process: at 2019-02-05 19:29:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-02-05 19:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-02-05 19:29:06 [DEBUG   ] spawn_process: at 2019-02-05 19:29:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-02-05 19:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-02-05 19:29:06 [DEBUG   ] spawn_process: at 2019-02-05 19:29:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-02-05 19:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-02-05 19:29:06 [DEBUG   ] spawn_process: at 2019-02-05 19:29:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-02-05 19:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-02-05 19:29:06 [DEBUG   ] spawn_process: at 2019-02-05 19:29:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-02-05 19:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-02-05 19:29:06 [DEBUG   ] spawn_process: at 2019-02-05 19:29:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-02-05 19:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-02-05 19:29:06 [DEBUG   ] spawn_process: at 2019-02-05 19:29:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-02-05 19:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-02-05 19:29:06 [DEBUG   ] spawn_process: at 2019-02-05 19:29:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-02-05 19:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-02-05 19:29:06 [DEBUG   ] spawn_process: at 2019-02-05 19:29:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-02-05 19:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-02-05 19:29:06 [DEBUG   ] spawn_process: at 2019-02-05 19:29:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-02-05 19:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-02-05 19:29:06 [DEBUG   ] spawn_process: at 2019-02-05 19:29:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-02-05 19:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-02-05 19:29:06 [DEBUG   ] spawn_process: at 2019-02-05 19:29:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-02-05 19:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-02-05 19:29:06 [DEBUG   ] spawn_process: at 2019-02-05 19:29:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-02-05 19:29:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-02-05 19:29:06 [DEBUG   ] spawn_process: at 2019-02-05 19:29:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-02-05 19:29:16 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 19:29:22 [DEBUG   ] Got command BAM from MCS: ref #1412476
2019-02-05 19:29:22 [INFO    ] Finished processing BAM request
2019-02-05 19:29:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:29:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412476   8 58519 70162033 A  ERROR'
2019-02-05 19:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-02-05 19:29:22 [DEBUG   ] spawn_process: at 2019-02-05 19:29:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-02-05 19:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-02-05 19:29:22 [DEBUG   ] spawn_process: at 2019-02-05 19:29:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-02-05 19:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-02-05 19:29:22 [DEBUG   ] spawn_process: at 2019-02-05 19:29:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-02-05 19:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-02-05 19:29:22 [DEBUG   ] spawn_process: at 2019-02-05 19:29:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-02-05 19:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-02-05 19:29:22 [DEBUG   ] spawn_process: at 2019-02-05 19:29:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-02-05 19:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-02-05 19:29:22 [DEBUG   ] spawn_process: at 2019-02-05 19:29:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-02-05 19:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-02-05 19:29:22 [DEBUG   ] spawn_process: at 2019-02-05 19:29:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-02-05 19:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-02-05 19:29:22 [DEBUG   ] spawn_process: at 2019-02-05 19:29:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-02-05 19:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-02-05 19:29:22 [DEBUG   ] spawn_process: at 2019-02-05 19:29:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-02-05 19:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-02-05 19:29:22 [DEBUG   ] spawn_process: at 2019-02-05 19:29:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-02-05 19:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-02-05 19:29:22 [DEBUG   ] spawn_process: at 2019-02-05 19:29:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-02-05 19:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-02-05 19:29:22 [DEBUG   ] spawn_process: at 2019-02-05 19:29:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-02-05 19:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-02-05 19:29:22 [DEBUG   ] spawn_process: at 2019-02-05 19:29:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-02-05 19:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-02-05 19:29:22 [DEBUG   ] spawn_process: at 2019-02-05 19:29:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-02-05 19:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-02-05 19:29:22 [DEBUG   ] spawn_process: at 2019-02-05 19:29:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-02-05 19:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-02-05 19:29:22 [DEBUG   ] spawn_process: at 2019-02-05 19:29:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-02-05 19:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-02-05 19:29:22 [DEBUG   ] spawn_process: at 2019-02-05 19:29:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-02-05 19:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-02-05 19:29:22 [DEBUG   ] spawn_process: at 2019-02-05 19:29:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-02-05 19:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-02-05 19:29:22 [DEBUG   ] spawn_process: at 2019-02-05 19:29:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-02-05 19:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-02-05 19:29:22 [DEBUG   ] spawn_process: at 2019-02-05 19:29:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-02-05 19:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-02-05 19:29:22 [DEBUG   ] spawn_process: at 2019-02-05 19:29:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-02-05 19:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-02-05 19:29:22 [DEBUG   ] spawn_process: at 2019-02-05 19:29:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-02-05 19:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-02-05 19:29:22 [DEBUG   ] spawn_process: at 2019-02-05 19:29:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-02-05 19:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-02-05 19:29:22 [DEBUG   ] spawn_process: at 2019-02-05 19:29:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-02-05 19:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-02-05 19:29:22 [DEBUG   ] spawn_process: at 2019-02-05 19:29:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-02-05 19:29:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-02-05 19:29:22 [DEBUG   ] spawn_process: at 2019-02-05 19:29:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-02-05 19:29:36 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 19:29:55 [DEBUG   ] Got command RPT from MCS: ref #1412477
2019-02-05 19:29:55 [DEBUG   ] summary = ERROR
2019-02-05 19:29:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412477  13 58519 70195793 A  ERRORERROR'
2019-02-05 19:29:55 [DEBUG   ] Got command RPT from MCS: ref #1412478
2019-02-05 19:29:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 19:29:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412478  77 58519 70195985 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 19:29:56 [DEBUG   ] Got command RPT from MCS: ref #1412479
2019-02-05 19:29:56 [DEBUG   ] summary = ERROR
2019-02-05 19:29:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412479  13 58519 70196193 A  ERRORERROR'
2019-02-05 19:29:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 19:29:56 [DEBUG   ] Got command RPT from MCS: ref #1412480
2019-02-05 19:29:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 19:29:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412480  77 58519 70196397 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 19:29:56 [DEBUG   ] Got command RPT from MCS: ref #1412481
2019-02-05 19:29:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 19:29:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412481  12 58519 70196589 A  ERRORB¤ff'
2019-02-05 19:29:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-02-05 19:29:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:30:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 19:30:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-02-05 19:30:00 [WARNING ] (13, 1, 'bot')
2019-02-05 19:30:00 [WARNING ] (13, 1, 'bot')
2019-02-05 19:30:00 [WARNING ] (13, 1, 'bot')
2019-02-05 19:30:00 [WARNING ] (13, 1, 'bot')
2019-02-05 19:30:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:30:00 [DEBUG   ] Finished updating board flags in 1.055 seconds
2019-02-05 19:30:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-05 19:30:28 [DEBUG   ] Got command BAM from MCS: ref #1412483
2019-02-05 19:30:28 [INFO    ] Finished processing BAM request
2019-02-05 19:30:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:30:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412483   8 58519 70228029 A  ERROR'
2019-02-05 19:30:28 [DEBUG   ] Got command BAM from MCS: ref #1412482
2019-02-05 19:30:28 [INFO    ] Finished processing BAM request
2019-02-05 19:30:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:30:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412482   8 58519 70228033 A  ERROR'
2019-02-05 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 19:30:28 [DEBUG   ] spawn_process: at 2019-02-05 19:30:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 19:30:28 [DEBUG   ] spawn_process: at 2019-02-05 19:30:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 19:30:28 [DEBUG   ] spawn_process: at 2019-02-05 19:30:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 19:30:28 [DEBUG   ] spawn_process: at 2019-02-05 19:30:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 19:30:28 [DEBUG   ] spawn_process: at 2019-02-05 19:30:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 19:30:28 [DEBUG   ] spawn_process: at 2019-02-05 19:30:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 19:30:28 [DEBUG   ] spawn_process: at 2019-02-05 19:30:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 19:30:28 [DEBUG   ] spawn_process: at 2019-02-05 19:30:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 19:30:28 [DEBUG   ] spawn_process: at 2019-02-05 19:30:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 19:30:28 [DEBUG   ] spawn_process: at 2019-02-05 19:30:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 19:30:28 [DEBUG   ] spawn_process: at 2019-02-05 19:30:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 19:30:28 [DEBUG   ] spawn_process: at 2019-02-05 19:30:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 19:30:28 [DEBUG   ] spawn_process: at 2019-02-05 19:30:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 19:30:28 [DEBUG   ] spawn_process: at 2019-02-05 19:30:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 19:30:28 [DEBUG   ] spawn_process: at 2019-02-05 19:30:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 19:30:28 [DEBUG   ] spawn_process: at 2019-02-05 19:30:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 19:30:28 [DEBUG   ] spawn_process: at 2019-02-05 19:30:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 19:30:28 [DEBUG   ] spawn_process: at 2019-02-05 19:30:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 19:30:28 [DEBUG   ] spawn_process: at 2019-02-05 19:30:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 19:30:28 [DEBUG   ] spawn_process: at 2019-02-05 19:30:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 19:30:28 [DEBUG   ] spawn_process: at 2019-02-05 19:30:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 19:30:28 [DEBUG   ] spawn_process: at 2019-02-05 19:30:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 19:30:28 [DEBUG   ] spawn_process: at 2019-02-05 19:30:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 19:30:28 [DEBUG   ] spawn_process: at 2019-02-05 19:30:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 19:30:28 [DEBUG   ] spawn_process: at 2019-02-05 19:30:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 19:30:28 [DEBUG   ] spawn_process: at 2019-02-05 19:30:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 19:30:36 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 19:30:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 19:31:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:31:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2019-02-05 19:31:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-02-05 19:31:01 [WARNING ] (13, 1, 'bot')
2019-02-05 19:31:01 [WARNING ] (13, 1, 'bot')
2019-02-05 19:31:01 [WARNING ] (13, 1, 'bot')
2019-02-05 19:31:01 [WARNING ] (13, 1, 'bot')
2019-02-05 19:31:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:31:01 [DEBUG   ] Finished updating board flags in 2.000 seconds
2019-02-05 19:31:12 [DEBUG   ] Got command RPT from MCS: ref #1412484
2019-02-05 19:31:12 [DEBUG   ] summary = ERROR
2019-02-05 19:31:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412484  13 58519 70272017 A  ERRORERROR'
2019-02-05 19:31:12 [DEBUG   ] Got command RPT from MCS: ref #1412485
2019-02-05 19:31:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 19:31:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412485  77 58519 70272018 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 19:31:16 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 19:31:34 [DEBUG   ] Got command BAM from MCS: ref #1412501
2019-02-05 19:31:34 [INFO    ] Finished processing BAM request
2019-02-05 19:31:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:31:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412501   8 58519 70294033 A  ERROR'
2019-02-05 19:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-02-05 19:31:34 [DEBUG   ] spawn_process: at 2019-02-05 19:31:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-02-05 19:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-02-05 19:31:34 [DEBUG   ] spawn_process: at 2019-02-05 19:31:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-02-05 19:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-02-05 19:31:34 [DEBUG   ] spawn_process: at 2019-02-05 19:31:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-02-05 19:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-02-05 19:31:34 [DEBUG   ] spawn_process: at 2019-02-05 19:31:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-02-05 19:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-02-05 19:31:34 [DEBUG   ] spawn_process: at 2019-02-05 19:31:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-02-05 19:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-02-05 19:31:34 [DEBUG   ] spawn_process: at 2019-02-05 19:31:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-02-05 19:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-02-05 19:31:34 [DEBUG   ] spawn_process: at 2019-02-05 19:31:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-02-05 19:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-02-05 19:31:34 [DEBUG   ] spawn_process: at 2019-02-05 19:31:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-02-05 19:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-02-05 19:31:34 [DEBUG   ] spawn_process: at 2019-02-05 19:31:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-02-05 19:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-02-05 19:31:34 [DEBUG   ] spawn_process: at 2019-02-05 19:31:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-02-05 19:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-02-05 19:31:34 [DEBUG   ] spawn_process: at 2019-02-05 19:31:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-02-05 19:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-02-05 19:31:34 [DEBUG   ] spawn_process: at 2019-02-05 19:31:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-02-05 19:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-02-05 19:31:34 [DEBUG   ] spawn_process: at 2019-02-05 19:31:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-02-05 19:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-02-05 19:31:34 [DEBUG   ] spawn_process: at 2019-02-05 19:31:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-02-05 19:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-02-05 19:31:34 [DEBUG   ] spawn_process: at 2019-02-05 19:31:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-02-05 19:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-02-05 19:31:34 [DEBUG   ] spawn_process: at 2019-02-05 19:31:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-02-05 19:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-02-05 19:31:34 [DEBUG   ] spawn_process: at 2019-02-05 19:31:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-02-05 19:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-02-05 19:31:34 [DEBUG   ] spawn_process: at 2019-02-05 19:31:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-02-05 19:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-02-05 19:31:34 [DEBUG   ] spawn_process: at 2019-02-05 19:31:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-02-05 19:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-02-05 19:31:34 [DEBUG   ] spawn_process: at 2019-02-05 19:31:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-02-05 19:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-02-05 19:31:34 [DEBUG   ] spawn_process: at 2019-02-05 19:31:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-02-05 19:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-02-05 19:31:34 [DEBUG   ] spawn_process: at 2019-02-05 19:31:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-02-05 19:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-02-05 19:31:34 [DEBUG   ] spawn_process: at 2019-02-05 19:31:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-02-05 19:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-02-05 19:31:34 [DEBUG   ] spawn_process: at 2019-02-05 19:31:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-02-05 19:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-02-05 19:31:34 [DEBUG   ] spawn_process: at 2019-02-05 19:31:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-02-05 19:31:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-02-05 19:31:34 [DEBUG   ] spawn_process: at 2019-02-05 19:31:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-02-05 19:31:36 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 19:31:48 [DEBUG   ] Got command BAM from MCS: ref #1412502
2019-02-05 19:31:48 [INFO    ] Finished processing BAM request
2019-02-05 19:31:48 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:31:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412502   8 58519 70308033 A  ERROR'
2019-02-05 19:31:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 19:31:48 [DEBUG   ] spawn_process: at 2019-02-05 19:31:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 19:31:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 19:31:48 [DEBUG   ] spawn_process: at 2019-02-05 19:31:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 19:31:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 19:31:48 [DEBUG   ] spawn_process: at 2019-02-05 19:31:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 19:31:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 19:31:48 [DEBUG   ] spawn_process: at 2019-02-05 19:31:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 19:31:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 19:31:48 [DEBUG   ] spawn_process: at 2019-02-05 19:31:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 19:31:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 19:31:48 [DEBUG   ] spawn_process: at 2019-02-05 19:31:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 19:31:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 19:31:48 [DEBUG   ] spawn_process: at 2019-02-05 19:31:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 19:31:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 19:31:48 [DEBUG   ] spawn_process: at 2019-02-05 19:31:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 19:31:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 19:31:48 [DEBUG   ] spawn_process: at 2019-02-05 19:31:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 19:31:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 19:31:48 [DEBUG   ] spawn_process: at 2019-02-05 19:31:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 19:31:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 19:31:48 [DEBUG   ] spawn_process: at 2019-02-05 19:31:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 19:31:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 19:31:48 [DEBUG   ] spawn_process: at 2019-02-05 19:31:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 19:31:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 19:31:48 [DEBUG   ] spawn_process: at 2019-02-05 19:31:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 19:31:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 19:31:48 [DEBUG   ] spawn_process: at 2019-02-05 19:31:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 19:31:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 19:31:48 [DEBUG   ] spawn_process: at 2019-02-05 19:31:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 19:31:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 19:31:48 [DEBUG   ] spawn_process: at 2019-02-05 19:31:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 19:31:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 19:31:48 [DEBUG   ] spawn_process: at 2019-02-05 19:31:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 19:31:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 19:31:48 [DEBUG   ] spawn_process: at 2019-02-05 19:31:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 19:31:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 19:31:48 [DEBUG   ] spawn_process: at 2019-02-05 19:31:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 19:31:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 19:31:48 [DEBUG   ] spawn_process: at 2019-02-05 19:31:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 19:31:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 19:31:48 [DEBUG   ] spawn_process: at 2019-02-05 19:31:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 19:31:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 19:31:48 [DEBUG   ] spawn_process: at 2019-02-05 19:31:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 19:31:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 19:31:48 [DEBUG   ] spawn_process: at 2019-02-05 19:31:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 19:31:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 19:31:48 [DEBUG   ] spawn_process: at 2019-02-05 19:31:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 19:31:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 19:31:48 [DEBUG   ] spawn_process: at 2019-02-05 19:31:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 19:31:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 19:31:48 [DEBUG   ] spawn_process: at 2019-02-05 19:31:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 19:31:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 19:32:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-02-05 19:32:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:32:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-02-05 19:32:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 19:32:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2019-02-05 19:32:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-02-05 19:32:00 [WARNING ] (13, 1, 'bot')
2019-02-05 19:32:00 [WARNING ] (13, 1, 'bot')
2019-02-05 19:32:00 [WARNING ] (13, 1, 'bot')
2019-02-05 19:32:00 [WARNING ] (13, 1, 'bot')
2019-02-05 19:32:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:32:00 [DEBUG   ] Finished updating board flags in 1.221 seconds
2019-02-05 19:32:16 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 19:32:36 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 19:32:40 [DEBUG   ] Got command BAM from MCS: ref #1412507
2019-02-05 19:32:40 [INFO    ] Finished processing BAM request
2019-02-05 19:32:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412507   8 58519 70360033 A  ERROR'
2019-02-05 19:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-02-05 19:32:40 [DEBUG   ] spawn_process: at 2019-02-05 19:32:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-02-05 19:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-02-05 19:32:40 [DEBUG   ] spawn_process: at 2019-02-05 19:32:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-02-05 19:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-02-05 19:32:40 [DEBUG   ] spawn_process: at 2019-02-05 19:32:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-02-05 19:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-02-05 19:32:40 [DEBUG   ] spawn_process: at 2019-02-05 19:32:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-02-05 19:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-02-05 19:32:40 [DEBUG   ] spawn_process: at 2019-02-05 19:32:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-02-05 19:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-02-05 19:32:40 [DEBUG   ] spawn_process: at 2019-02-05 19:32:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-02-05 19:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-02-05 19:32:40 [DEBUG   ] spawn_process: at 2019-02-05 19:32:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-02-05 19:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-02-05 19:32:40 [DEBUG   ] spawn_process: at 2019-02-05 19:32:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-02-05 19:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-02-05 19:32:40 [DEBUG   ] spawn_process: at 2019-02-05 19:32:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-02-05 19:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-02-05 19:32:40 [DEBUG   ] spawn_process: at 2019-02-05 19:32:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-02-05 19:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-02-05 19:32:40 [DEBUG   ] spawn_process: at 2019-02-05 19:32:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-02-05 19:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-02-05 19:32:40 [DEBUG   ] spawn_process: at 2019-02-05 19:32:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-02-05 19:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-02-05 19:32:40 [DEBUG   ] spawn_process: at 2019-02-05 19:32:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-02-05 19:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-02-05 19:32:40 [DEBUG   ] spawn_process: at 2019-02-05 19:32:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-02-05 19:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-02-05 19:32:40 [DEBUG   ] spawn_process: at 2019-02-05 19:32:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-02-05 19:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-02-05 19:32:40 [DEBUG   ] spawn_process: at 2019-02-05 19:32:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-02-05 19:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-02-05 19:32:40 [DEBUG   ] spawn_process: at 2019-02-05 19:32:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-02-05 19:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-02-05 19:32:40 [DEBUG   ] spawn_process: at 2019-02-05 19:32:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-02-05 19:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-02-05 19:32:40 [DEBUG   ] spawn_process: at 2019-02-05 19:32:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-02-05 19:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-02-05 19:32:40 [DEBUG   ] spawn_process: at 2019-02-05 19:32:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-02-05 19:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-02-05 19:32:40 [DEBUG   ] spawn_process: at 2019-02-05 19:32:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-02-05 19:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-02-05 19:32:40 [DEBUG   ] spawn_process: at 2019-02-05 19:32:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-02-05 19:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-02-05 19:32:40 [DEBUG   ] spawn_process: at 2019-02-05 19:32:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-02-05 19:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-02-05 19:32:40 [DEBUG   ] spawn_process: at 2019-02-05 19:32:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-02-05 19:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-02-05 19:32:40 [DEBUG   ] spawn_process: at 2019-02-05 19:32:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-02-05 19:32:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-02-05 19:32:40 [DEBUG   ] spawn_process: at 2019-02-05 19:32:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-02-05 19:32:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 19:33:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 19:33:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-02-05 19:33:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:33:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-02-05 19:33:00 [WARNING ] (13, 1, 'bot')
2019-02-05 19:33:00 [WARNING ] (13, 1, 'bot')
2019-02-05 19:33:00 [WARNING ] (13, 1, 'bot')
2019-02-05 19:33:00 [WARNING ] (13, 1, 'bot')
2019-02-05 19:33:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:33:00 [DEBUG   ] Finished updating board flags in 1.183 seconds
2019-02-05 19:33:07 [DEBUG   ] Got command BAM from MCS: ref #1412508
2019-02-05 19:33:07 [INFO    ] Finished processing BAM request
2019-02-05 19:33:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:33:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412508   8 58519 70387025 A  ERROR'
2019-02-05 19:33:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 19:33:07 [DEBUG   ] spawn_process: at 2019-02-05 19:33:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 19:33:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 19:33:07 [DEBUG   ] spawn_process: at 2019-02-05 19:33:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 19:33:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 19:33:07 [DEBUG   ] spawn_process: at 2019-02-05 19:33:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 19:33:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 19:33:07 [DEBUG   ] spawn_process: at 2019-02-05 19:33:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 19:33:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 19:33:07 [DEBUG   ] spawn_process: at 2019-02-05 19:33:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 19:33:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 19:33:07 [DEBUG   ] spawn_process: at 2019-02-05 19:33:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 19:33:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 19:33:07 [DEBUG   ] spawn_process: at 2019-02-05 19:33:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 19:33:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 19:33:07 [DEBUG   ] spawn_process: at 2019-02-05 19:33:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 19:33:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 19:33:07 [DEBUG   ] spawn_process: at 2019-02-05 19:33:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 19:33:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 19:33:07 [DEBUG   ] spawn_process: at 2019-02-05 19:33:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 19:33:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 19:33:07 [DEBUG   ] spawn_process: at 2019-02-05 19:33:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 19:33:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 19:33:07 [DEBUG   ] spawn_process: at 2019-02-05 19:33:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 19:33:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 19:33:07 [DEBUG   ] spawn_process: at 2019-02-05 19:33:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 19:33:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 19:33:07 [DEBUG   ] spawn_process: at 2019-02-05 19:33:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 19:33:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 19:33:07 [DEBUG   ] spawn_process: at 2019-02-05 19:33:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 19:33:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 19:33:07 [DEBUG   ] spawn_process: at 2019-02-05 19:33:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 19:33:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 19:33:07 [DEBUG   ] spawn_process: at 2019-02-05 19:33:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 19:33:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 19:33:07 [DEBUG   ] spawn_process: at 2019-02-05 19:33:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 19:33:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 19:33:07 [DEBUG   ] spawn_process: at 2019-02-05 19:33:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 19:33:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 19:33:07 [DEBUG   ] spawn_process: at 2019-02-05 19:33:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 19:33:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 19:33:07 [DEBUG   ] spawn_process: at 2019-02-05 19:33:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 19:33:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 19:33:07 [DEBUG   ] spawn_process: at 2019-02-05 19:33:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 19:33:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 19:33:07 [DEBUG   ] spawn_process: at 2019-02-05 19:33:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 19:33:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 19:33:07 [DEBUG   ] spawn_process: at 2019-02-05 19:33:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 19:33:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 19:33:07 [DEBUG   ] spawn_process: at 2019-02-05 19:33:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 19:33:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 19:33:07 [DEBUG   ] spawn_process: at 2019-02-05 19:33:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 19:33:16 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 19:33:36 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 19:33:46 [DEBUG   ] Got command BAM from MCS: ref #1412509
2019-02-05 19:33:46 [INFO    ] Finished processing BAM request
2019-02-05 19:33:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:33:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412509   8 58519 70426025 A  ERROR'
2019-02-05 19:33:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 19:33:46 [DEBUG   ] spawn_process: at 2019-02-05 19:33:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 19:33:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 19:33:46 [DEBUG   ] spawn_process: at 2019-02-05 19:33:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 19:33:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 19:33:46 [DEBUG   ] spawn_process: at 2019-02-05 19:33:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 19:33:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 19:33:46 [DEBUG   ] spawn_process: at 2019-02-05 19:33:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 19:33:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 19:33:46 [DEBUG   ] spawn_process: at 2019-02-05 19:33:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 19:33:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 19:33:46 [DEBUG   ] spawn_process: at 2019-02-05 19:33:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 19:33:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 19:33:46 [DEBUG   ] spawn_process: at 2019-02-05 19:33:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 19:33:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 19:33:46 [DEBUG   ] spawn_process: at 2019-02-05 19:33:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 19:33:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 19:33:46 [DEBUG   ] spawn_process: at 2019-02-05 19:33:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 19:33:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 19:33:46 [DEBUG   ] spawn_process: at 2019-02-05 19:33:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 19:33:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 19:33:46 [DEBUG   ] spawn_process: at 2019-02-05 19:33:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 19:33:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 19:33:46 [DEBUG   ] spawn_process: at 2019-02-05 19:33:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 19:33:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 19:33:46 [DEBUG   ] spawn_process: at 2019-02-05 19:33:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 19:33:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 19:33:46 [DEBUG   ] spawn_process: at 2019-02-05 19:33:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 19:33:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 19:33:46 [DEBUG   ] spawn_process: at 2019-02-05 19:33:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 19:33:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 19:33:46 [DEBUG   ] spawn_process: at 2019-02-05 19:33:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 19:33:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 19:33:46 [DEBUG   ] spawn_process: at 2019-02-05 19:33:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 19:33:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 19:33:46 [DEBUG   ] spawn_process: at 2019-02-05 19:33:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 19:33:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 19:33:46 [DEBUG   ] spawn_process: at 2019-02-05 19:33:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 19:33:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 19:33:46 [DEBUG   ] spawn_process: at 2019-02-05 19:33:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 19:33:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 19:33:46 [DEBUG   ] spawn_process: at 2019-02-05 19:33:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 19:33:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 19:33:46 [DEBUG   ] spawn_process: at 2019-02-05 19:33:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 19:33:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 19:33:46 [DEBUG   ] spawn_process: at 2019-02-05 19:33:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 19:33:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 19:33:46 [DEBUG   ] spawn_process: at 2019-02-05 19:33:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 19:33:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 19:33:46 [DEBUG   ] spawn_process: at 2019-02-05 19:33:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 19:33:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 19:33:46 [DEBUG   ] spawn_process: at 2019-02-05 19:33:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 19:33:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 19:34:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 19:34:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:34:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 19:34:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-02-05 19:34:00 [WARNING ] (13, 1, 'bot')
2019-02-05 19:34:00 [WARNING ] (13, 1, 'bot')
2019-02-05 19:34:00 [WARNING ] (13, 1, 'bot')
2019-02-05 19:34:00 [WARNING ] (13, 1, 'bot')
2019-02-05 19:34:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:34:00 [DEBUG   ] Finished updating board flags in 1.015 seconds
2019-02-05 19:34:16 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 19:34:25 [DEBUG   ] Got command BAM from MCS: ref #1412510
2019-02-05 19:34:25 [INFO    ] Finished processing BAM request
2019-02-05 19:34:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:34:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412510   8 58519 70465029 A  ERROR'
2019-02-05 19:34:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-02-05 19:34:25 [DEBUG   ] spawn_process: at 2019-02-05 19:34:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-02-05 19:34:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-02-05 19:34:25 [DEBUG   ] spawn_process: at 2019-02-05 19:34:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-02-05 19:34:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-02-05 19:34:25 [DEBUG   ] spawn_process: at 2019-02-05 19:34:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-02-05 19:34:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-02-05 19:34:25 [DEBUG   ] spawn_process: at 2019-02-05 19:34:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-02-05 19:34:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-02-05 19:34:25 [DEBUG   ] spawn_process: at 2019-02-05 19:34:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-02-05 19:34:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-02-05 19:34:25 [DEBUG   ] spawn_process: at 2019-02-05 19:34:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-02-05 19:34:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-02-05 19:34:25 [DEBUG   ] spawn_process: at 2019-02-05 19:34:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-02-05 19:34:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-02-05 19:34:25 [DEBUG   ] spawn_process: at 2019-02-05 19:34:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-02-05 19:34:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-02-05 19:34:25 [DEBUG   ] spawn_process: at 2019-02-05 19:34:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-02-05 19:34:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-02-05 19:34:25 [DEBUG   ] spawn_process: at 2019-02-05 19:34:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-02-05 19:34:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-02-05 19:34:25 [DEBUG   ] spawn_process: at 2019-02-05 19:34:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-02-05 19:34:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-02-05 19:34:25 [DEBUG   ] spawn_process: at 2019-02-05 19:34:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-02-05 19:34:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-02-05 19:34:25 [DEBUG   ] spawn_process: at 2019-02-05 19:34:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-02-05 19:34:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-02-05 19:34:25 [DEBUG   ] spawn_process: at 2019-02-05 19:34:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-02-05 19:34:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-02-05 19:34:25 [DEBUG   ] spawn_process: at 2019-02-05 19:34:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-02-05 19:34:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-02-05 19:34:25 [DEBUG   ] spawn_process: at 2019-02-05 19:34:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-02-05 19:34:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-02-05 19:34:25 [DEBUG   ] spawn_process: at 2019-02-05 19:34:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-02-05 19:34:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-02-05 19:34:25 [DEBUG   ] spawn_process: at 2019-02-05 19:34:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-02-05 19:34:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-02-05 19:34:25 [DEBUG   ] spawn_process: at 2019-02-05 19:34:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-02-05 19:34:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-02-05 19:34:25 [DEBUG   ] spawn_process: at 2019-02-05 19:34:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-02-05 19:34:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-02-05 19:34:25 [DEBUG   ] spawn_process: at 2019-02-05 19:34:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-02-05 19:34:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-02-05 19:34:25 [DEBUG   ] spawn_process: at 2019-02-05 19:34:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-02-05 19:34:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-02-05 19:34:25 [DEBUG   ] spawn_process: at 2019-02-05 19:34:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-02-05 19:34:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-02-05 19:34:25 [DEBUG   ] spawn_process: at 2019-02-05 19:34:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-02-05 19:34:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-02-05 19:34:25 [DEBUG   ] spawn_process: at 2019-02-05 19:34:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-02-05 19:34:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-02-05 19:34:25 [DEBUG   ] spawn_process: at 2019-02-05 19:34:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-02-05 19:34:36 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 19:34:52 [DEBUG   ] Got command BAM from MCS: ref #1412513
2019-02-05 19:34:52 [INFO    ] Finished processing BAM request
2019-02-05 19:34:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:34:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412513   8 58519 70492029 A  ERROR'
2019-02-05 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-02-05 19:34:52 [DEBUG   ] spawn_process: at 2019-02-05 19:34:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-02-05 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-02-05 19:34:52 [DEBUG   ] spawn_process: at 2019-02-05 19:34:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-02-05 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-02-05 19:34:52 [DEBUG   ] spawn_process: at 2019-02-05 19:34:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-02-05 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-02-05 19:34:52 [DEBUG   ] spawn_process: at 2019-02-05 19:34:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-02-05 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-02-05 19:34:52 [DEBUG   ] spawn_process: at 2019-02-05 19:34:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-02-05 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-02-05 19:34:52 [DEBUG   ] spawn_process: at 2019-02-05 19:34:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-02-05 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-02-05 19:34:52 [DEBUG   ] spawn_process: at 2019-02-05 19:34:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-02-05 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-02-05 19:34:52 [DEBUG   ] spawn_process: at 2019-02-05 19:34:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-02-05 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-02-05 19:34:52 [DEBUG   ] spawn_process: at 2019-02-05 19:34:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-02-05 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-02-05 19:34:52 [DEBUG   ] spawn_process: at 2019-02-05 19:34:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-02-05 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-02-05 19:34:52 [DEBUG   ] spawn_process: at 2019-02-05 19:34:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-02-05 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-02-05 19:34:52 [DEBUG   ] spawn_process: at 2019-02-05 19:34:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-02-05 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-02-05 19:34:52 [DEBUG   ] spawn_process: at 2019-02-05 19:34:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-02-05 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-02-05 19:34:52 [DEBUG   ] spawn_process: at 2019-02-05 19:34:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-02-05 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-02-05 19:34:52 [DEBUG   ] spawn_process: at 2019-02-05 19:34:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-02-05 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-02-05 19:34:52 [DEBUG   ] spawn_process: at 2019-02-05 19:34:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-02-05 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-02-05 19:34:52 [DEBUG   ] spawn_process: at 2019-02-05 19:34:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-02-05 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-02-05 19:34:52 [DEBUG   ] spawn_process: at 2019-02-05 19:34:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-02-05 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-02-05 19:34:52 [DEBUG   ] spawn_process: at 2019-02-05 19:34:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-02-05 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-02-05 19:34:52 [DEBUG   ] spawn_process: at 2019-02-05 19:34:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-02-05 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-02-05 19:34:52 [DEBUG   ] spawn_process: at 2019-02-05 19:34:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-02-05 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-02-05 19:34:52 [DEBUG   ] spawn_process: at 2019-02-05 19:34:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-02-05 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-02-05 19:34:52 [DEBUG   ] spawn_process: at 2019-02-05 19:34:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-02-05 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-02-05 19:34:52 [DEBUG   ] spawn_process: at 2019-02-05 19:34:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-02-05 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-02-05 19:34:52 [DEBUG   ] spawn_process: at 2019-02-05 19:34:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-02-05 19:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-02-05 19:34:52 [DEBUG   ] spawn_process: at 2019-02-05 19:34:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-02-05 19:34:55 [DEBUG   ] Got command RPT from MCS: ref #1412514
2019-02-05 19:34:55 [DEBUG   ] summary = ERROR
2019-02-05 19:34:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412514  13 58519 70495878 A  ERRORERROR'
2019-02-05 19:34:56 [DEBUG   ] Got command RPT from MCS: ref #1412515
2019-02-05 19:34:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 19:34:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412515  77 58519 70496081 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 19:34:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 19:34:56 [DEBUG   ] Got command RPT from MCS: ref #1412516
2019-02-05 19:34:56 [DEBUG   ] summary = ERROR
2019-02-05 19:34:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412516  13 58519 70496273 A  ERRORERROR'
2019-02-05 19:34:56 [DEBUG   ] Got command RPT from MCS: ref #1412518
2019-02-05 19:34:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 19:34:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412518  77 58519 70496478 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 19:34:56 [DEBUG   ] Got command RPT from MCS: ref #1412520
2019-02-05 19:34:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 19:34:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412520  12 58519 70496681 A  ERRORB£ff'
2019-02-05 19:35:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:35:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 19:35:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-02-05 19:35:00 [WARNING ] (13, 1, 'bot')
2019-02-05 19:35:00 [WARNING ] (13, 1, 'bot')
2019-02-05 19:35:00 [WARNING ] (13, 1, 'bot')
2019-02-05 19:35:00 [WARNING ] (13, 1, 'bot')
2019-02-05 19:35:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:35:00 [DEBUG   ] Finished updating board flags in 0.987 seconds
2019-02-05 19:35:16 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 19:35:36 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 19:35:42 [DEBUG   ] Got command BAM from MCS: ref #1412528
2019-02-05 19:35:42 [INFO    ] Finished processing BAM request
2019-02-05 19:35:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:35:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412528   8 58519 70542033 A  ERROR'
2019-02-05 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-02-05 19:35:42 [DEBUG   ] spawn_process: at 2019-02-05 19:35:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-02-05 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-02-05 19:35:42 [DEBUG   ] spawn_process: at 2019-02-05 19:35:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-02-05 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-02-05 19:35:42 [DEBUG   ] spawn_process: at 2019-02-05 19:35:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-02-05 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-02-05 19:35:42 [DEBUG   ] spawn_process: at 2019-02-05 19:35:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-02-05 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-02-05 19:35:42 [DEBUG   ] spawn_process: at 2019-02-05 19:35:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-02-05 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-02-05 19:35:42 [DEBUG   ] spawn_process: at 2019-02-05 19:35:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-02-05 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-02-05 19:35:42 [DEBUG   ] spawn_process: at 2019-02-05 19:35:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-02-05 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-02-05 19:35:42 [DEBUG   ] spawn_process: at 2019-02-05 19:35:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-02-05 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-02-05 19:35:42 [DEBUG   ] spawn_process: at 2019-02-05 19:35:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-02-05 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-02-05 19:35:42 [DEBUG   ] spawn_process: at 2019-02-05 19:35:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-02-05 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-02-05 19:35:42 [DEBUG   ] spawn_process: at 2019-02-05 19:35:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-02-05 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-02-05 19:35:42 [DEBUG   ] spawn_process: at 2019-02-05 19:35:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-02-05 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-02-05 19:35:42 [DEBUG   ] spawn_process: at 2019-02-05 19:35:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-02-05 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-02-05 19:35:42 [DEBUG   ] spawn_process: at 2019-02-05 19:35:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-02-05 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-02-05 19:35:42 [DEBUG   ] spawn_process: at 2019-02-05 19:35:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-02-05 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-02-05 19:35:42 [DEBUG   ] spawn_process: at 2019-02-05 19:35:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-02-05 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-02-05 19:35:42 [DEBUG   ] spawn_process: at 2019-02-05 19:35:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-02-05 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-02-05 19:35:42 [DEBUG   ] spawn_process: at 2019-02-05 19:35:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-02-05 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-02-05 19:35:42 [DEBUG   ] spawn_process: at 2019-02-05 19:35:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-02-05 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-02-05 19:35:42 [DEBUG   ] spawn_process: at 2019-02-05 19:35:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-02-05 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-02-05 19:35:42 [DEBUG   ] spawn_process: at 2019-02-05 19:35:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-02-05 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-02-05 19:35:42 [DEBUG   ] spawn_process: at 2019-02-05 19:35:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-02-05 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-02-05 19:35:42 [DEBUG   ] spawn_process: at 2019-02-05 19:35:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-02-05 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-02-05 19:35:42 [DEBUG   ] spawn_process: at 2019-02-05 19:35:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-02-05 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-02-05 19:35:42 [DEBUG   ] spawn_process: at 2019-02-05 19:35:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-02-05 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-02-05 19:35:42 [DEBUG   ] spawn_process: at 2019-02-05 19:35:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-02-05 19:35:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 19:35:58 [DEBUG   ] Got command BAM from MCS: ref #1412529
2019-02-05 19:35:58 [INFO    ] Finished processing BAM request
2019-02-05 19:35:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412529   8 58519 70558033 A  ERROR'
2019-02-05 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-02-05 19:35:58 [DEBUG   ] spawn_process: at 2019-02-05 19:35:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-02-05 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-02-05 19:35:58 [DEBUG   ] spawn_process: at 2019-02-05 19:35:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-02-05 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-02-05 19:35:58 [DEBUG   ] spawn_process: at 2019-02-05 19:35:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-02-05 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-02-05 19:35:58 [DEBUG   ] spawn_process: at 2019-02-05 19:35:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-02-05 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-02-05 19:35:58 [DEBUG   ] spawn_process: at 2019-02-05 19:35:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-02-05 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-02-05 19:35:58 [DEBUG   ] spawn_process: at 2019-02-05 19:35:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-02-05 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-02-05 19:35:58 [DEBUG   ] spawn_process: at 2019-02-05 19:35:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-02-05 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-02-05 19:35:58 [DEBUG   ] spawn_process: at 2019-02-05 19:35:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-02-05 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-02-05 19:35:58 [DEBUG   ] spawn_process: at 2019-02-05 19:35:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-02-05 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-02-05 19:35:58 [DEBUG   ] spawn_process: at 2019-02-05 19:35:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-02-05 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-02-05 19:35:58 [DEBUG   ] spawn_process: at 2019-02-05 19:35:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-02-05 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-02-05 19:35:58 [DEBUG   ] spawn_process: at 2019-02-05 19:35:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-02-05 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-02-05 19:35:58 [DEBUG   ] spawn_process: at 2019-02-05 19:35:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-02-05 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-02-05 19:35:58 [DEBUG   ] spawn_process: at 2019-02-05 19:35:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-02-05 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-02-05 19:35:58 [DEBUG   ] spawn_process: at 2019-02-05 19:35:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-02-05 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-02-05 19:35:58 [DEBUG   ] spawn_process: at 2019-02-05 19:35:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-02-05 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-02-05 19:35:58 [DEBUG   ] spawn_process: at 2019-02-05 19:35:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-02-05 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-02-05 19:35:58 [DEBUG   ] spawn_process: at 2019-02-05 19:35:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-02-05 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-02-05 19:35:58 [DEBUG   ] spawn_process: at 2019-02-05 19:35:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-02-05 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-02-05 19:35:58 [DEBUG   ] spawn_process: at 2019-02-05 19:35:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-02-05 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-02-05 19:35:58 [DEBUG   ] spawn_process: at 2019-02-05 19:35:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-02-05 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-02-05 19:35:58 [DEBUG   ] spawn_process: at 2019-02-05 19:35:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-02-05 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-02-05 19:35:58 [DEBUG   ] spawn_process: at 2019-02-05 19:35:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-02-05 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-02-05 19:35:58 [DEBUG   ] spawn_process: at 2019-02-05 19:35:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-02-05 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-02-05 19:35:58 [DEBUG   ] spawn_process: at 2019-02-05 19:35:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-02-05 19:35:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-02-05 19:35:58 [DEBUG   ] spawn_process: at 2019-02-05 19:35:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-02-05 19:36:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:36:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-02-05 19:36:01 [WARNING ] (13, 1, 'bot')
2019-02-05 19:36:01 [WARNING ] (13, 1, 'bot')
2019-02-05 19:36:01 [WARNING ] (13, 1, 'bot')
2019-02-05 19:36:01 [WARNING ] (13, 1, 'bot')
2019-02-05 19:36:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:36:01 [DEBUG   ] Finished updating board flags in 1.362 seconds
2019-02-05 19:36:12 [DEBUG   ] Got command RPT from MCS: ref #1412530
2019-02-05 19:36:12 [DEBUG   ] summary = ERROR
2019-02-05 19:36:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412530  13 58519 70572013 A  ERRORERROR'
2019-02-05 19:36:12 [DEBUG   ] Got command RPT from MCS: ref #1412531
2019-02-05 19:36:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 19:36:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412531  77 58519 70572014 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 19:36:16 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 19:36:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-05 19:36:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 19:36:58 [DEBUG   ] Got command BAM from MCS: ref #1412547
2019-02-05 19:36:58 [INFO    ] Finished processing BAM request
2019-02-05 19:36:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:36:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412547   8 58519 70618025 A  ERROR'
2019-02-05 19:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-02-05 19:36:58 [DEBUG   ] spawn_process: at 2019-02-05 19:36:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-02-05 19:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-02-05 19:36:58 [DEBUG   ] spawn_process: at 2019-02-05 19:36:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-02-05 19:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-02-05 19:36:58 [DEBUG   ] spawn_process: at 2019-02-05 19:36:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-02-05 19:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-02-05 19:36:58 [DEBUG   ] spawn_process: at 2019-02-05 19:36:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-02-05 19:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-02-05 19:36:58 [DEBUG   ] spawn_process: at 2019-02-05 19:36:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-02-05 19:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-02-05 19:36:58 [DEBUG   ] spawn_process: at 2019-02-05 19:36:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-02-05 19:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-02-05 19:36:58 [DEBUG   ] spawn_process: at 2019-02-05 19:36:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-02-05 19:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-02-05 19:36:58 [DEBUG   ] spawn_process: at 2019-02-05 19:36:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-02-05 19:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-02-05 19:36:58 [DEBUG   ] spawn_process: at 2019-02-05 19:36:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-02-05 19:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-02-05 19:36:58 [DEBUG   ] spawn_process: at 2019-02-05 19:36:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-02-05 19:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-02-05 19:36:58 [DEBUG   ] spawn_process: at 2019-02-05 19:36:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-02-05 19:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-02-05 19:36:58 [DEBUG   ] spawn_process: at 2019-02-05 19:36:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-02-05 19:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-02-05 19:36:58 [DEBUG   ] spawn_process: at 2019-02-05 19:36:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-02-05 19:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-02-05 19:36:58 [DEBUG   ] spawn_process: at 2019-02-05 19:36:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-02-05 19:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-02-05 19:36:58 [DEBUG   ] spawn_process: at 2019-02-05 19:36:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-02-05 19:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-02-05 19:36:58 [DEBUG   ] spawn_process: at 2019-02-05 19:36:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-02-05 19:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-02-05 19:36:58 [DEBUG   ] spawn_process: at 2019-02-05 19:36:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-02-05 19:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-02-05 19:36:58 [DEBUG   ] spawn_process: at 2019-02-05 19:36:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-02-05 19:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-02-05 19:36:58 [DEBUG   ] spawn_process: at 2019-02-05 19:36:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-02-05 19:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-02-05 19:36:58 [DEBUG   ] spawn_process: at 2019-02-05 19:36:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-02-05 19:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-02-05 19:36:58 [DEBUG   ] spawn_process: at 2019-02-05 19:36:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-02-05 19:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-02-05 19:36:58 [DEBUG   ] spawn_process: at 2019-02-05 19:36:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-02-05 19:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-02-05 19:36:58 [DEBUG   ] spawn_process: at 2019-02-05 19:36:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-02-05 19:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-02-05 19:36:58 [DEBUG   ] spawn_process: at 2019-02-05 19:36:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-02-05 19:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-02-05 19:36:58 [DEBUG   ] spawn_process: at 2019-02-05 19:36:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-02-05 19:36:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-02-05 19:36:58 [DEBUG   ] spawn_process: at 2019-02-05 19:36:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-02-05 19:37:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-02-05 19:37:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:37:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 19:37:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-02-05 19:37:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-05 19:37:01 [WARNING ] (13, 1, 'bot')
2019-02-05 19:37:01 [WARNING ] (13, 1, 'bot')
2019-02-05 19:37:01 [WARNING ] (13, 1, 'bot')
2019-02-05 19:37:01 [WARNING ] (13, 1, 'bot')
2019-02-05 19:37:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:37:01 [DEBUG   ] Finished updating board flags in 1.214 seconds
2019-02-05 19:37:04 [DEBUG   ] Got command BAM from MCS: ref #1412548
2019-02-05 19:37:04 [INFO    ] Finished processing BAM request
2019-02-05 19:37:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:37:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412548   8 58519 70624025 A  ERROR'
2019-02-05 19:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 19:37:04 [DEBUG   ] spawn_process: at 2019-02-05 19:37:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 19:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 19:37:04 [DEBUG   ] spawn_process: at 2019-02-05 19:37:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 19:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 19:37:04 [DEBUG   ] spawn_process: at 2019-02-05 19:37:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 19:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 19:37:04 [DEBUG   ] spawn_process: at 2019-02-05 19:37:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 19:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 19:37:04 [DEBUG   ] spawn_process: at 2019-02-05 19:37:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 19:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 19:37:04 [DEBUG   ] spawn_process: at 2019-02-05 19:37:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 19:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 19:37:04 [DEBUG   ] spawn_process: at 2019-02-05 19:37:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 19:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 19:37:04 [DEBUG   ] spawn_process: at 2019-02-05 19:37:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 19:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 19:37:04 [DEBUG   ] spawn_process: at 2019-02-05 19:37:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 19:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 19:37:04 [DEBUG   ] spawn_process: at 2019-02-05 19:37:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 19:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 19:37:04 [DEBUG   ] spawn_process: at 2019-02-05 19:37:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 19:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 19:37:04 [DEBUG   ] spawn_process: at 2019-02-05 19:37:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 19:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 19:37:04 [DEBUG   ] spawn_process: at 2019-02-05 19:37:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 19:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 19:37:04 [DEBUG   ] spawn_process: at 2019-02-05 19:37:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 19:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 19:37:04 [DEBUG   ] spawn_process: at 2019-02-05 19:37:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 19:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 19:37:04 [DEBUG   ] spawn_process: at 2019-02-05 19:37:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 19:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 19:37:04 [DEBUG   ] spawn_process: at 2019-02-05 19:37:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 19:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 19:37:04 [DEBUG   ] spawn_process: at 2019-02-05 19:37:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 19:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 19:37:04 [DEBUG   ] spawn_process: at 2019-02-05 19:37:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 19:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 19:37:04 [DEBUG   ] spawn_process: at 2019-02-05 19:37:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 19:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 19:37:04 [DEBUG   ] spawn_process: at 2019-02-05 19:37:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 19:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 19:37:04 [DEBUG   ] spawn_process: at 2019-02-05 19:37:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 19:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 19:37:04 [DEBUG   ] spawn_process: at 2019-02-05 19:37:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 19:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 19:37:04 [DEBUG   ] spawn_process: at 2019-02-05 19:37:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 19:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 19:37:04 [DEBUG   ] spawn_process: at 2019-02-05 19:37:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 19:37:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 19:37:04 [DEBUG   ] spawn_process: at 2019-02-05 19:37:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 19:37:16 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 19:37:36 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 19:37:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 19:38:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 19:38:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:38:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-02-05 19:38:01 [WARNING ] (13, 1, 'bot')
2019-02-05 19:38:01 [WARNING ] (13, 1, 'bot')
2019-02-05 19:38:01 [WARNING ] (13, 1, 'bot')
2019-02-05 19:38:01 [WARNING ] (13, 1, 'bot')
2019-02-05 19:38:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:38:01 [DEBUG   ] Finished updating board flags in 1.276 seconds
2019-02-05 19:38:10 [DEBUG   ] Got command BAM from MCS: ref #1412549
2019-02-05 19:38:10 [INFO    ] Finished processing BAM request
2019-02-05 19:38:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:38:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412549   8 58519 70690025 A  ERROR'
2019-02-05 19:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-02-05 19:38:10 [DEBUG   ] spawn_process: at 2019-02-05 19:38:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-02-05 19:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-02-05 19:38:10 [DEBUG   ] spawn_process: at 2019-02-05 19:38:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-02-05 19:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-02-05 19:38:10 [DEBUG   ] spawn_process: at 2019-02-05 19:38:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-02-05 19:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-02-05 19:38:10 [DEBUG   ] spawn_process: at 2019-02-05 19:38:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-02-05 19:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-02-05 19:38:10 [DEBUG   ] spawn_process: at 2019-02-05 19:38:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-02-05 19:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-02-05 19:38:10 [DEBUG   ] spawn_process: at 2019-02-05 19:38:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-02-05 19:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-02-05 19:38:10 [DEBUG   ] spawn_process: at 2019-02-05 19:38:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-02-05 19:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-02-05 19:38:10 [DEBUG   ] spawn_process: at 2019-02-05 19:38:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-02-05 19:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-02-05 19:38:10 [DEBUG   ] spawn_process: at 2019-02-05 19:38:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-02-05 19:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-02-05 19:38:10 [DEBUG   ] spawn_process: at 2019-02-05 19:38:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-02-05 19:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-02-05 19:38:10 [DEBUG   ] spawn_process: at 2019-02-05 19:38:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-02-05 19:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-02-05 19:38:10 [DEBUG   ] spawn_process: at 2019-02-05 19:38:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-02-05 19:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-02-05 19:38:10 [DEBUG   ] spawn_process: at 2019-02-05 19:38:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-02-05 19:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-02-05 19:38:10 [DEBUG   ] spawn_process: at 2019-02-05 19:38:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-02-05 19:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-02-05 19:38:10 [DEBUG   ] spawn_process: at 2019-02-05 19:38:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-02-05 19:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-02-05 19:38:10 [DEBUG   ] spawn_process: at 2019-02-05 19:38:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-02-05 19:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-02-05 19:38:10 [DEBUG   ] spawn_process: at 2019-02-05 19:38:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-02-05 19:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-02-05 19:38:10 [DEBUG   ] spawn_process: at 2019-02-05 19:38:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-02-05 19:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-02-05 19:38:10 [DEBUG   ] spawn_process: at 2019-02-05 19:38:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-02-05 19:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-02-05 19:38:10 [DEBUG   ] spawn_process: at 2019-02-05 19:38:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-02-05 19:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-02-05 19:38:10 [DEBUG   ] spawn_process: at 2019-02-05 19:38:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-02-05 19:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-02-05 19:38:10 [DEBUG   ] spawn_process: at 2019-02-05 19:38:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-02-05 19:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-02-05 19:38:10 [DEBUG   ] spawn_process: at 2019-02-05 19:38:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-02-05 19:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-02-05 19:38:10 [DEBUG   ] spawn_process: at 2019-02-05 19:38:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-02-05 19:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-02-05 19:38:10 [DEBUG   ] spawn_process: at 2019-02-05 19:38:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-02-05 19:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-02-05 19:38:10 [DEBUG   ] spawn_process: at 2019-02-05 19:38:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-02-05 19:38:13 [DEBUG   ] Got command BAM from MCS: ref #1412550
2019-02-05 19:38:13 [INFO    ] Finished processing BAM request
2019-02-05 19:38:13 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:38:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412550   8 58519 70693029 A  ERROR'
2019-02-05 19:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 19:38:13 [DEBUG   ] spawn_process: at 2019-02-05 19:38:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 19:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 19:38:13 [DEBUG   ] spawn_process: at 2019-02-05 19:38:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 19:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 19:38:13 [DEBUG   ] spawn_process: at 2019-02-05 19:38:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 19:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 19:38:13 [DEBUG   ] spawn_process: at 2019-02-05 19:38:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 19:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 19:38:13 [DEBUG   ] spawn_process: at 2019-02-05 19:38:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 19:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 19:38:13 [DEBUG   ] spawn_process: at 2019-02-05 19:38:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 19:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 19:38:13 [DEBUG   ] spawn_process: at 2019-02-05 19:38:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 19:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 19:38:13 [DEBUG   ] spawn_process: at 2019-02-05 19:38:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 19:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 19:38:13 [DEBUG   ] spawn_process: at 2019-02-05 19:38:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 19:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 19:38:13 [DEBUG   ] spawn_process: at 2019-02-05 19:38:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 19:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 19:38:13 [DEBUG   ] spawn_process: at 2019-02-05 19:38:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 19:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 19:38:13 [DEBUG   ] spawn_process: at 2019-02-05 19:38:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 19:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 19:38:13 [DEBUG   ] spawn_process: at 2019-02-05 19:38:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 19:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 19:38:13 [DEBUG   ] spawn_process: at 2019-02-05 19:38:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 19:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 19:38:13 [DEBUG   ] spawn_process: at 2019-02-05 19:38:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 19:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 19:38:13 [DEBUG   ] spawn_process: at 2019-02-05 19:38:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 19:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 19:38:13 [DEBUG   ] spawn_process: at 2019-02-05 19:38:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 19:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 19:38:13 [DEBUG   ] spawn_process: at 2019-02-05 19:38:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 19:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 19:38:13 [DEBUG   ] spawn_process: at 2019-02-05 19:38:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 19:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 19:38:13 [DEBUG   ] spawn_process: at 2019-02-05 19:38:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 19:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 19:38:13 [DEBUG   ] spawn_process: at 2019-02-05 19:38:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 19:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 19:38:13 [DEBUG   ] spawn_process: at 2019-02-05 19:38:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 19:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 19:38:13 [DEBUG   ] spawn_process: at 2019-02-05 19:38:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 19:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 19:38:13 [DEBUG   ] spawn_process: at 2019-02-05 19:38:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 19:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 19:38:13 [DEBUG   ] spawn_process: at 2019-02-05 19:38:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 19:38:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 19:38:13 [DEBUG   ] spawn_process: at 2019-02-05 19:38:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 19:38:16 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-02-05 19:38:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 19:38:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 19:39:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:39:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-02-05 19:39:01 [WARNING ] (13, 1, 'bot')
2019-02-05 19:39:01 [WARNING ] (13, 1, 'bot')
2019-02-05 19:39:01 [WARNING ] (13, 1, 'bot')
2019-02-05 19:39:01 [WARNING ] (13, 1, 'bot')
2019-02-05 19:39:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:39:01 [DEBUG   ] Finished updating board flags in 1.208 seconds
2019-02-05 19:39:15 [DEBUG   ] Got command BAM from MCS: ref #1412555
2019-02-05 19:39:15 [INFO    ] Finished processing BAM request
2019-02-05 19:39:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:39:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412555   8 58519 70755033 A  ERROR'
2019-02-05 19:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-02-05 19:39:15 [DEBUG   ] spawn_process: at 2019-02-05 19:39:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-02-05 19:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-02-05 19:39:15 [DEBUG   ] spawn_process: at 2019-02-05 19:39:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-02-05 19:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-02-05 19:39:15 [DEBUG   ] spawn_process: at 2019-02-05 19:39:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-02-05 19:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-02-05 19:39:15 [DEBUG   ] spawn_process: at 2019-02-05 19:39:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-02-05 19:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-02-05 19:39:15 [DEBUG   ] spawn_process: at 2019-02-05 19:39:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-02-05 19:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-02-05 19:39:15 [DEBUG   ] spawn_process: at 2019-02-05 19:39:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-02-05 19:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-02-05 19:39:15 [DEBUG   ] spawn_process: at 2019-02-05 19:39:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-02-05 19:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-02-05 19:39:15 [DEBUG   ] spawn_process: at 2019-02-05 19:39:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-02-05 19:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-02-05 19:39:15 [DEBUG   ] spawn_process: at 2019-02-05 19:39:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-02-05 19:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-02-05 19:39:15 [DEBUG   ] spawn_process: at 2019-02-05 19:39:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-02-05 19:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-02-05 19:39:15 [DEBUG   ] spawn_process: at 2019-02-05 19:39:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-02-05 19:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-02-05 19:39:15 [DEBUG   ] spawn_process: at 2019-02-05 19:39:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-02-05 19:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-02-05 19:39:15 [DEBUG   ] spawn_process: at 2019-02-05 19:39:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-02-05 19:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-02-05 19:39:15 [DEBUG   ] spawn_process: at 2019-02-05 19:39:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-02-05 19:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-02-05 19:39:15 [DEBUG   ] spawn_process: at 2019-02-05 19:39:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-02-05 19:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-02-05 19:39:15 [DEBUG   ] spawn_process: at 2019-02-05 19:39:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-02-05 19:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-02-05 19:39:15 [DEBUG   ] spawn_process: at 2019-02-05 19:39:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-02-05 19:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-02-05 19:39:15 [DEBUG   ] spawn_process: at 2019-02-05 19:39:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-02-05 19:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-02-05 19:39:15 [DEBUG   ] spawn_process: at 2019-02-05 19:39:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-02-05 19:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-02-05 19:39:15 [DEBUG   ] spawn_process: at 2019-02-05 19:39:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-02-05 19:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-02-05 19:39:15 [DEBUG   ] spawn_process: at 2019-02-05 19:39:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-02-05 19:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-02-05 19:39:15 [DEBUG   ] spawn_process: at 2019-02-05 19:39:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-02-05 19:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-02-05 19:39:15 [DEBUG   ] spawn_process: at 2019-02-05 19:39:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-02-05 19:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-02-05 19:39:15 [DEBUG   ] spawn_process: at 2019-02-05 19:39:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-02-05 19:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-02-05 19:39:15 [DEBUG   ] spawn_process: at 2019-02-05 19:39:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-02-05 19:39:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-02-05 19:39:15 [DEBUG   ] spawn_process: at 2019-02-05 19:39:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-02-05 19:39:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 19:39:27 [DEBUG   ] Got command BAM from MCS: ref #1412556
2019-02-05 19:39:27 [INFO    ] Finished processing BAM request
2019-02-05 19:39:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:39:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412556   8 58519 70767025 A  ERROR'
2019-02-05 19:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-02-05 19:39:27 [DEBUG   ] spawn_process: at 2019-02-05 19:39:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-02-05 19:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-02-05 19:39:27 [DEBUG   ] spawn_process: at 2019-02-05 19:39:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-02-05 19:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-02-05 19:39:27 [DEBUG   ] spawn_process: at 2019-02-05 19:39:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-02-05 19:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-02-05 19:39:27 [DEBUG   ] spawn_process: at 2019-02-05 19:39:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-02-05 19:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-02-05 19:39:27 [DEBUG   ] spawn_process: at 2019-02-05 19:39:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-02-05 19:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-02-05 19:39:27 [DEBUG   ] spawn_process: at 2019-02-05 19:39:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-02-05 19:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-02-05 19:39:27 [DEBUG   ] spawn_process: at 2019-02-05 19:39:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-02-05 19:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-02-05 19:39:27 [DEBUG   ] spawn_process: at 2019-02-05 19:39:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-02-05 19:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-02-05 19:39:27 [DEBUG   ] spawn_process: at 2019-02-05 19:39:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-02-05 19:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-02-05 19:39:27 [DEBUG   ] spawn_process: at 2019-02-05 19:39:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-02-05 19:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-02-05 19:39:27 [DEBUG   ] spawn_process: at 2019-02-05 19:39:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-02-05 19:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-02-05 19:39:27 [DEBUG   ] spawn_process: at 2019-02-05 19:39:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-02-05 19:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-02-05 19:39:27 [DEBUG   ] spawn_process: at 2019-02-05 19:39:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-02-05 19:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-02-05 19:39:27 [DEBUG   ] spawn_process: at 2019-02-05 19:39:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-02-05 19:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-02-05 19:39:27 [DEBUG   ] spawn_process: at 2019-02-05 19:39:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-02-05 19:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-02-05 19:39:27 [DEBUG   ] spawn_process: at 2019-02-05 19:39:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-02-05 19:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-02-05 19:39:27 [DEBUG   ] spawn_process: at 2019-02-05 19:39:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-02-05 19:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-02-05 19:39:27 [DEBUG   ] spawn_process: at 2019-02-05 19:39:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-02-05 19:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-02-05 19:39:27 [DEBUG   ] spawn_process: at 2019-02-05 19:39:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-02-05 19:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-02-05 19:39:27 [DEBUG   ] spawn_process: at 2019-02-05 19:39:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-02-05 19:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-02-05 19:39:27 [DEBUG   ] spawn_process: at 2019-02-05 19:39:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-02-05 19:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-02-05 19:39:27 [DEBUG   ] spawn_process: at 2019-02-05 19:39:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-02-05 19:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-02-05 19:39:27 [DEBUG   ] spawn_process: at 2019-02-05 19:39:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-02-05 19:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-02-05 19:39:27 [DEBUG   ] spawn_process: at 2019-02-05 19:39:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-02-05 19:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-02-05 19:39:27 [DEBUG   ] spawn_process: at 2019-02-05 19:39:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-02-05 19:39:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-02-05 19:39:27 [DEBUG   ] spawn_process: at 2019-02-05 19:39:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-02-05 19:39:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 19:39:55 [DEBUG   ] Got command RPT from MCS: ref #1412557
2019-02-05 19:39:55 [DEBUG   ] summary = ERROR
2019-02-05 19:39:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412557  13 58519 70795957 A  ERRORERROR'
2019-02-05 19:39:56 [DEBUG   ] Got command RPT from MCS: ref #1412558
2019-02-05 19:39:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 19:39:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412558  77 58519 70796161 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 19:39:56 [DEBUG   ] Got command RPT from MCS: ref #1412559
2019-02-05 19:39:56 [DEBUG   ] summary = ERROR
2019-02-05 19:39:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412559  13 58519 70796365 A  ERRORERROR'
2019-02-05 19:39:56 [DEBUG   ] Got command RPT from MCS: ref #1412560
2019-02-05 19:39:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 19:39:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412560  77 58519 70796557 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 19:39:56 [DEBUG   ] Got command RPT from MCS: ref #1412561
2019-02-05 19:39:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 19:39:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412561  12 58519 70796761 A  ERRORB£ff'
2019-02-05 19:39:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 19:40:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2019-02-05 19:40:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:40:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-02-05 19:40:01 [WARNING ] (13, 1, 'bot')
2019-02-05 19:40:01 [WARNING ] (13, 1, 'bot')
2019-02-05 19:40:01 [WARNING ] (13, 1, 'bot')
2019-02-05 19:40:01 [WARNING ] (13, 1, 'bot')
2019-02-05 19:40:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:40:01 [DEBUG   ] Finished updating board flags in 1.110 seconds
2019-02-05 19:40:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 19:40:20 [DEBUG   ] Got command BAM from MCS: ref #1412562
2019-02-05 19:40:20 [INFO    ] Finished processing BAM request
2019-02-05 19:40:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:40:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412562   8 58519 70820033 A  ERROR'
2019-02-05 19:40:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-02-05 19:40:20 [DEBUG   ] spawn_process: at 2019-02-05 19:40:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-02-05 19:40:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-02-05 19:40:20 [DEBUG   ] spawn_process: at 2019-02-05 19:40:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-02-05 19:40:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-02-05 19:40:20 [DEBUG   ] spawn_process: at 2019-02-05 19:40:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-02-05 19:40:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-02-05 19:40:20 [DEBUG   ] spawn_process: at 2019-02-05 19:40:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-02-05 19:40:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-02-05 19:40:20 [DEBUG   ] spawn_process: at 2019-02-05 19:40:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-02-05 19:40:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-02-05 19:40:20 [DEBUG   ] spawn_process: at 2019-02-05 19:40:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-02-05 19:40:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-02-05 19:40:20 [DEBUG   ] spawn_process: at 2019-02-05 19:40:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-02-05 19:40:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-02-05 19:40:20 [DEBUG   ] spawn_process: at 2019-02-05 19:40:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-02-05 19:40:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-02-05 19:40:20 [DEBUG   ] spawn_process: at 2019-02-05 19:40:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-02-05 19:40:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-02-05 19:40:20 [DEBUG   ] spawn_process: at 2019-02-05 19:40:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-02-05 19:40:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-02-05 19:40:20 [DEBUG   ] spawn_process: at 2019-02-05 19:40:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-02-05 19:40:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-02-05 19:40:20 [DEBUG   ] spawn_process: at 2019-02-05 19:40:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-02-05 19:40:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-02-05 19:40:20 [DEBUG   ] spawn_process: at 2019-02-05 19:40:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-02-05 19:40:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-02-05 19:40:20 [DEBUG   ] spawn_process: at 2019-02-05 19:40:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-02-05 19:40:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-02-05 19:40:20 [DEBUG   ] spawn_process: at 2019-02-05 19:40:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-02-05 19:40:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-02-05 19:40:20 [DEBUG   ] spawn_process: at 2019-02-05 19:40:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-02-05 19:40:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-02-05 19:40:20 [DEBUG   ] spawn_process: at 2019-02-05 19:40:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-02-05 19:40:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-02-05 19:40:20 [DEBUG   ] spawn_process: at 2019-02-05 19:40:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-02-05 19:40:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-02-05 19:40:20 [DEBUG   ] spawn_process: at 2019-02-05 19:40:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-02-05 19:40:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-02-05 19:40:20 [DEBUG   ] spawn_process: at 2019-02-05 19:40:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-02-05 19:40:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-02-05 19:40:20 [DEBUG   ] spawn_process: at 2019-02-05 19:40:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-02-05 19:40:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-02-05 19:40:20 [DEBUG   ] spawn_process: at 2019-02-05 19:40:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-02-05 19:40:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-02-05 19:40:20 [DEBUG   ] spawn_process: at 2019-02-05 19:40:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-02-05 19:40:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-02-05 19:40:20 [DEBUG   ] spawn_process: at 2019-02-05 19:40:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-02-05 19:40:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-02-05 19:40:20 [DEBUG   ] spawn_process: at 2019-02-05 19:40:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-02-05 19:40:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-02-05 19:40:20 [DEBUG   ] spawn_process: at 2019-02-05 19:40:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-02-05 19:40:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 19:40:40 [DEBUG   ] Got command BAM from MCS: ref #1412563
2019-02-05 19:40:40 [INFO    ] Finished processing BAM request
2019-02-05 19:40:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:40:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412563   8 58519 70840025 A  ERROR'
2019-02-05 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-02-05 19:40:40 [DEBUG   ] spawn_process: at 2019-02-05 19:40:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-02-05 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-02-05 19:40:40 [DEBUG   ] spawn_process: at 2019-02-05 19:40:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-02-05 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-02-05 19:40:40 [DEBUG   ] spawn_process: at 2019-02-05 19:40:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-02-05 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-02-05 19:40:40 [DEBUG   ] spawn_process: at 2019-02-05 19:40:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-02-05 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-02-05 19:40:40 [DEBUG   ] spawn_process: at 2019-02-05 19:40:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-02-05 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-02-05 19:40:40 [DEBUG   ] spawn_process: at 2019-02-05 19:40:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-02-05 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-02-05 19:40:40 [DEBUG   ] spawn_process: at 2019-02-05 19:40:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-02-05 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-02-05 19:40:40 [DEBUG   ] spawn_process: at 2019-02-05 19:40:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-02-05 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-02-05 19:40:40 [DEBUG   ] spawn_process: at 2019-02-05 19:40:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-02-05 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-02-05 19:40:40 [DEBUG   ] spawn_process: at 2019-02-05 19:40:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-02-05 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-02-05 19:40:40 [DEBUG   ] spawn_process: at 2019-02-05 19:40:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-02-05 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-02-05 19:40:40 [DEBUG   ] spawn_process: at 2019-02-05 19:40:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-02-05 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-02-05 19:40:40 [DEBUG   ] spawn_process: at 2019-02-05 19:40:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-02-05 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-02-05 19:40:40 [DEBUG   ] spawn_process: at 2019-02-05 19:40:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-02-05 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-02-05 19:40:40 [DEBUG   ] spawn_process: at 2019-02-05 19:40:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-02-05 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-02-05 19:40:40 [DEBUG   ] spawn_process: at 2019-02-05 19:40:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-02-05 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-02-05 19:40:40 [DEBUG   ] spawn_process: at 2019-02-05 19:40:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-02-05 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-02-05 19:40:40 [DEBUG   ] spawn_process: at 2019-02-05 19:40:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-02-05 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-02-05 19:40:40 [DEBUG   ] spawn_process: at 2019-02-05 19:40:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-02-05 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-02-05 19:40:40 [DEBUG   ] spawn_process: at 2019-02-05 19:40:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-02-05 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-02-05 19:40:40 [DEBUG   ] spawn_process: at 2019-02-05 19:40:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-02-05 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-02-05 19:40:40 [DEBUG   ] spawn_process: at 2019-02-05 19:40:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-02-05 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-02-05 19:40:40 [DEBUG   ] spawn_process: at 2019-02-05 19:40:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-02-05 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-02-05 19:40:40 [DEBUG   ] spawn_process: at 2019-02-05 19:40:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-02-05 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-02-05 19:40:40 [DEBUG   ] spawn_process: at 2019-02-05 19:40:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-02-05 19:40:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-02-05 19:40:40 [DEBUG   ] spawn_process: at 2019-02-05 19:40:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-02-05 19:40:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 19:41:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-02-05 19:41:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:41:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-02-05 19:41:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-02-05 19:41:01 [WARNING ] (13, 1, 'bot')
2019-02-05 19:41:01 [WARNING ] (13, 1, 'bot')
2019-02-05 19:41:01 [WARNING ] (13, 1, 'bot')
2019-02-05 19:41:01 [WARNING ] (13, 1, 'bot')
2019-02-05 19:41:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:41:01 [DEBUG   ] Finished updating board flags in 0.997 seconds
2019-02-05 19:41:12 [DEBUG   ] Got command RPT from MCS: ref #1412564
2019-02-05 19:41:12 [DEBUG   ] summary = ERROR
2019-02-05 19:41:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412564  13 58519 70872017 A  ERRORERROR'
2019-02-05 19:41:12 [DEBUG   ] Got command RPT from MCS: ref #1412565
2019-02-05 19:41:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 19:41:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412565  77 58519 70872018 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 19:41:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 19:41:25 [DEBUG   ] Got command BAM from MCS: ref #1412585
2019-02-05 19:41:25 [INFO    ] Finished processing BAM request
2019-02-05 19:41:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:41:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412585   8 58519 70885033 A  ERROR'
2019-02-05 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 19:41:25 [DEBUG   ] spawn_process: at 2019-02-05 19:41:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 19:41:25 [DEBUG   ] spawn_process: at 2019-02-05 19:41:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 19:41:25 [DEBUG   ] spawn_process: at 2019-02-05 19:41:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 19:41:25 [DEBUG   ] spawn_process: at 2019-02-05 19:41:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 19:41:25 [DEBUG   ] spawn_process: at 2019-02-05 19:41:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 19:41:25 [DEBUG   ] spawn_process: at 2019-02-05 19:41:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 19:41:25 [DEBUG   ] spawn_process: at 2019-02-05 19:41:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 19:41:25 [DEBUG   ] spawn_process: at 2019-02-05 19:41:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 19:41:25 [DEBUG   ] spawn_process: at 2019-02-05 19:41:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 19:41:25 [DEBUG   ] spawn_process: at 2019-02-05 19:41:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 19:41:25 [DEBUG   ] spawn_process: at 2019-02-05 19:41:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 19:41:25 [DEBUG   ] spawn_process: at 2019-02-05 19:41:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 19:41:25 [DEBUG   ] spawn_process: at 2019-02-05 19:41:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 19:41:25 [DEBUG   ] spawn_process: at 2019-02-05 19:41:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 19:41:25 [DEBUG   ] spawn_process: at 2019-02-05 19:41:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 19:41:25 [DEBUG   ] spawn_process: at 2019-02-05 19:41:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 19:41:25 [DEBUG   ] spawn_process: at 2019-02-05 19:41:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 19:41:25 [DEBUG   ] spawn_process: at 2019-02-05 19:41:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 19:41:25 [DEBUG   ] spawn_process: at 2019-02-05 19:41:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 19:41:25 [DEBUG   ] spawn_process: at 2019-02-05 19:41:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 19:41:25 [DEBUG   ] spawn_process: at 2019-02-05 19:41:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 19:41:25 [DEBUG   ] spawn_process: at 2019-02-05 19:41:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 19:41:25 [DEBUG   ] spawn_process: at 2019-02-05 19:41:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 19:41:25 [DEBUG   ] spawn_process: at 2019-02-05 19:41:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 19:41:25 [DEBUG   ] spawn_process: at 2019-02-05 19:41:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 19:41:25 [DEBUG   ] spawn_process: at 2019-02-05 19:41:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 19:41:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 19:41:53 [DEBUG   ] Got command BAM from MCS: ref #1412586
2019-02-05 19:41:53 [INFO    ] Finished processing BAM request
2019-02-05 19:41:53 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:41:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412586   8 58519 70913025 A  ERROR'
2019-02-05 19:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 19:41:53 [DEBUG   ] spawn_process: at 2019-02-05 19:41:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 19:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 19:41:53 [DEBUG   ] spawn_process: at 2019-02-05 19:41:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 19:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 19:41:53 [DEBUG   ] spawn_process: at 2019-02-05 19:41:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 19:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 19:41:53 [DEBUG   ] spawn_process: at 2019-02-05 19:41:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 19:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 19:41:53 [DEBUG   ] spawn_process: at 2019-02-05 19:41:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 19:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 19:41:53 [DEBUG   ] spawn_process: at 2019-02-05 19:41:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 19:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 19:41:53 [DEBUG   ] spawn_process: at 2019-02-05 19:41:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 19:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 19:41:53 [DEBUG   ] spawn_process: at 2019-02-05 19:41:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 19:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 19:41:53 [DEBUG   ] spawn_process: at 2019-02-05 19:41:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 19:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 19:41:53 [DEBUG   ] spawn_process: at 2019-02-05 19:41:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 19:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 19:41:53 [DEBUG   ] spawn_process: at 2019-02-05 19:41:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 19:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 19:41:53 [DEBUG   ] spawn_process: at 2019-02-05 19:41:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 19:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 19:41:53 [DEBUG   ] spawn_process: at 2019-02-05 19:41:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 19:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 19:41:53 [DEBUG   ] spawn_process: at 2019-02-05 19:41:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 19:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 19:41:53 [DEBUG   ] spawn_process: at 2019-02-05 19:41:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 19:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 19:41:53 [DEBUG   ] spawn_process: at 2019-02-05 19:41:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 19:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 19:41:53 [DEBUG   ] spawn_process: at 2019-02-05 19:41:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 19:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 19:41:53 [DEBUG   ] spawn_process: at 2019-02-05 19:41:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 19:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 19:41:53 [DEBUG   ] spawn_process: at 2019-02-05 19:41:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 19:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 19:41:53 [DEBUG   ] spawn_process: at 2019-02-05 19:41:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 19:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 19:41:53 [DEBUG   ] spawn_process: at 2019-02-05 19:41:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 19:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 19:41:53 [DEBUG   ] spawn_process: at 2019-02-05 19:41:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 19:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 19:41:53 [DEBUG   ] spawn_process: at 2019-02-05 19:41:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 19:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 19:41:53 [DEBUG   ] spawn_process: at 2019-02-05 19:41:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 19:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 19:41:53 [DEBUG   ] spawn_process: at 2019-02-05 19:41:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 19:41:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 19:41:53 [DEBUG   ] spawn_process: at 2019-02-05 19:41:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 19:41:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 19:42:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-02-05 19:42:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2019-02-05 19:42:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:42:02 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-02-05 19:42:02 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-02-05 19:42:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-05 19:42:02 [WARNING ] (13, 1, 'bot')
2019-02-05 19:42:02 [WARNING ] (13, 1, 'bot')
2019-02-05 19:42:02 [WARNING ] (13, 1, 'bot')
2019-02-05 19:42:02 [WARNING ] (13, 1, 'bot')
2019-02-05 19:42:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:42:02 [DEBUG   ] Finished updating board flags in 1.838 seconds
2019-02-05 19:42:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 19:42:30 [DEBUG   ] Got command BAM from MCS: ref #1412587
2019-02-05 19:42:30 [INFO    ] Finished processing BAM request
2019-02-05 19:42:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:42:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412587   8 58519 70950033 A  ERROR'
2019-02-05 19:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-02-05 19:42:30 [DEBUG   ] spawn_process: at 2019-02-05 19:42:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-02-05 19:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-02-05 19:42:30 [DEBUG   ] spawn_process: at 2019-02-05 19:42:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-02-05 19:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-02-05 19:42:30 [DEBUG   ] spawn_process: at 2019-02-05 19:42:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-02-05 19:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-02-05 19:42:30 [DEBUG   ] spawn_process: at 2019-02-05 19:42:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-02-05 19:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-02-05 19:42:30 [DEBUG   ] spawn_process: at 2019-02-05 19:42:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-02-05 19:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-02-05 19:42:30 [DEBUG   ] spawn_process: at 2019-02-05 19:42:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-02-05 19:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-02-05 19:42:30 [DEBUG   ] spawn_process: at 2019-02-05 19:42:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-02-05 19:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-02-05 19:42:30 [DEBUG   ] spawn_process: at 2019-02-05 19:42:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-02-05 19:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-02-05 19:42:30 [DEBUG   ] spawn_process: at 2019-02-05 19:42:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-02-05 19:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-02-05 19:42:30 [DEBUG   ] spawn_process: at 2019-02-05 19:42:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-02-05 19:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-02-05 19:42:30 [DEBUG   ] spawn_process: at 2019-02-05 19:42:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-02-05 19:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-02-05 19:42:30 [DEBUG   ] spawn_process: at 2019-02-05 19:42:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-02-05 19:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-02-05 19:42:30 [DEBUG   ] spawn_process: at 2019-02-05 19:42:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-02-05 19:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-02-05 19:42:30 [DEBUG   ] spawn_process: at 2019-02-05 19:42:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-02-05 19:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-02-05 19:42:30 [DEBUG   ] spawn_process: at 2019-02-05 19:42:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-02-05 19:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-02-05 19:42:30 [DEBUG   ] spawn_process: at 2019-02-05 19:42:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-02-05 19:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-02-05 19:42:30 [DEBUG   ] spawn_process: at 2019-02-05 19:42:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-02-05 19:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-02-05 19:42:30 [DEBUG   ] spawn_process: at 2019-02-05 19:42:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-02-05 19:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-02-05 19:42:30 [DEBUG   ] spawn_process: at 2019-02-05 19:42:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-02-05 19:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-02-05 19:42:30 [DEBUG   ] spawn_process: at 2019-02-05 19:42:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-02-05 19:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-02-05 19:42:30 [DEBUG   ] spawn_process: at 2019-02-05 19:42:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-02-05 19:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-02-05 19:42:30 [DEBUG   ] spawn_process: at 2019-02-05 19:42:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-02-05 19:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-02-05 19:42:30 [DEBUG   ] spawn_process: at 2019-02-05 19:42:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-02-05 19:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-02-05 19:42:30 [DEBUG   ] spawn_process: at 2019-02-05 19:42:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-02-05 19:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-02-05 19:42:30 [DEBUG   ] spawn_process: at 2019-02-05 19:42:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-02-05 19:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-02-05 19:42:30 [DEBUG   ] spawn_process: at 2019-02-05 19:42:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-02-05 19:42:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 19:42:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 19:43:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:43:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-02-05 19:43:01 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-02-05 19:43:01 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2019-02-05 19:43:01 [WARNING ] (13, 1, 'bot')
2019-02-05 19:43:01 [WARNING ] (13, 1, 'bot')
2019-02-05 19:43:01 [WARNING ] (13, 1, 'bot')
2019-02-05 19:43:01 [WARNING ] (13, 1, 'bot')
2019-02-05 19:43:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:43:01 [DEBUG   ] Finished updating board flags in 1.206 seconds
2019-02-05 19:43:05 [DEBUG   ] Got command BAM from MCS: ref #1412588
2019-02-05 19:43:05 [INFO    ] Finished processing BAM request
2019-02-05 19:43:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:43:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412588   8 58519 70985029 A  ERROR'
2019-02-05 19:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-02-05 19:43:05 [DEBUG   ] spawn_process: at 2019-02-05 19:43:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-02-05 19:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-02-05 19:43:05 [DEBUG   ] spawn_process: at 2019-02-05 19:43:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-02-05 19:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-02-05 19:43:05 [DEBUG   ] spawn_process: at 2019-02-05 19:43:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-02-05 19:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-02-05 19:43:05 [DEBUG   ] spawn_process: at 2019-02-05 19:43:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-02-05 19:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-02-05 19:43:05 [DEBUG   ] spawn_process: at 2019-02-05 19:43:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-02-05 19:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-02-05 19:43:05 [DEBUG   ] spawn_process: at 2019-02-05 19:43:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-02-05 19:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-02-05 19:43:05 [DEBUG   ] spawn_process: at 2019-02-05 19:43:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-02-05 19:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-02-05 19:43:05 [DEBUG   ] spawn_process: at 2019-02-05 19:43:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-02-05 19:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-02-05 19:43:05 [DEBUG   ] spawn_process: at 2019-02-05 19:43:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-02-05 19:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-02-05 19:43:05 [DEBUG   ] spawn_process: at 2019-02-05 19:43:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-02-05 19:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-02-05 19:43:05 [DEBUG   ] spawn_process: at 2019-02-05 19:43:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-02-05 19:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-02-05 19:43:05 [DEBUG   ] spawn_process: at 2019-02-05 19:43:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-02-05 19:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-02-05 19:43:05 [DEBUG   ] spawn_process: at 2019-02-05 19:43:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-02-05 19:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-02-05 19:43:05 [DEBUG   ] spawn_process: at 2019-02-05 19:43:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-02-05 19:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-02-05 19:43:05 [DEBUG   ] spawn_process: at 2019-02-05 19:43:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-02-05 19:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-02-05 19:43:05 [DEBUG   ] spawn_process: at 2019-02-05 19:43:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-02-05 19:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-02-05 19:43:05 [DEBUG   ] spawn_process: at 2019-02-05 19:43:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-02-05 19:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-02-05 19:43:05 [DEBUG   ] spawn_process: at 2019-02-05 19:43:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-02-05 19:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-02-05 19:43:05 [DEBUG   ] spawn_process: at 2019-02-05 19:43:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-02-05 19:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-02-05 19:43:05 [DEBUG   ] spawn_process: at 2019-02-05 19:43:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-02-05 19:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-02-05 19:43:05 [DEBUG   ] spawn_process: at 2019-02-05 19:43:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-02-05 19:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-02-05 19:43:05 [DEBUG   ] spawn_process: at 2019-02-05 19:43:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-02-05 19:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-02-05 19:43:05 [DEBUG   ] spawn_process: at 2019-02-05 19:43:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-02-05 19:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-02-05 19:43:05 [DEBUG   ] spawn_process: at 2019-02-05 19:43:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-02-05 19:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-02-05 19:43:05 [DEBUG   ] spawn_process: at 2019-02-05 19:43:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-02-05 19:43:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-02-05 19:43:05 [DEBUG   ] spawn_process: at 2019-02-05 19:43:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-02-05 19:43:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 19:43:35 [DEBUG   ] Got command BAM from MCS: ref #1412589
2019-02-05 19:43:35 [INFO    ] Finished processing BAM request
2019-02-05 19:43:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:43:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412589   8 58519 71015025 A  ERROR'
2019-02-05 19:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-02-05 19:43:35 [DEBUG   ] spawn_process: at 2019-02-05 19:43:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-02-05 19:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-02-05 19:43:35 [DEBUG   ] spawn_process: at 2019-02-05 19:43:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-02-05 19:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-02-05 19:43:35 [DEBUG   ] spawn_process: at 2019-02-05 19:43:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-02-05 19:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-02-05 19:43:35 [DEBUG   ] spawn_process: at 2019-02-05 19:43:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-02-05 19:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-02-05 19:43:35 [DEBUG   ] spawn_process: at 2019-02-05 19:43:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-02-05 19:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-02-05 19:43:35 [DEBUG   ] spawn_process: at 2019-02-05 19:43:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-02-05 19:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-02-05 19:43:35 [DEBUG   ] spawn_process: at 2019-02-05 19:43:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-02-05 19:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-02-05 19:43:35 [DEBUG   ] spawn_process: at 2019-02-05 19:43:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-02-05 19:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-02-05 19:43:35 [DEBUG   ] spawn_process: at 2019-02-05 19:43:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-02-05 19:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-02-05 19:43:35 [DEBUG   ] spawn_process: at 2019-02-05 19:43:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-02-05 19:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-02-05 19:43:35 [DEBUG   ] spawn_process: at 2019-02-05 19:43:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-02-05 19:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-02-05 19:43:35 [DEBUG   ] spawn_process: at 2019-02-05 19:43:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-02-05 19:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-02-05 19:43:35 [DEBUG   ] spawn_process: at 2019-02-05 19:43:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-02-05 19:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-02-05 19:43:35 [DEBUG   ] spawn_process: at 2019-02-05 19:43:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-02-05 19:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-02-05 19:43:35 [DEBUG   ] spawn_process: at 2019-02-05 19:43:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-02-05 19:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-02-05 19:43:35 [DEBUG   ] spawn_process: at 2019-02-05 19:43:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-02-05 19:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-02-05 19:43:35 [DEBUG   ] spawn_process: at 2019-02-05 19:43:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-02-05 19:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-02-05 19:43:35 [DEBUG   ] spawn_process: at 2019-02-05 19:43:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-02-05 19:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-02-05 19:43:35 [DEBUG   ] spawn_process: at 2019-02-05 19:43:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-02-05 19:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-02-05 19:43:35 [DEBUG   ] spawn_process: at 2019-02-05 19:43:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-02-05 19:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-02-05 19:43:35 [DEBUG   ] spawn_process: at 2019-02-05 19:43:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-02-05 19:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-02-05 19:43:35 [DEBUG   ] spawn_process: at 2019-02-05 19:43:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-02-05 19:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-02-05 19:43:35 [DEBUG   ] spawn_process: at 2019-02-05 19:43:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-02-05 19:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-02-05 19:43:35 [DEBUG   ] spawn_process: at 2019-02-05 19:43:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-02-05 19:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-02-05 19:43:35 [DEBUG   ] spawn_process: at 2019-02-05 19:43:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-02-05 19:43:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-02-05 19:43:35 [DEBUG   ] spawn_process: at 2019-02-05 19:43:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-02-05 19:43:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 19:43:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 19:44:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:44:01 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-02-05 19:44:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-02-05 19:44:01 [WARNING ] (13, 1, 'bot')
2019-02-05 19:44:01 [WARNING ] (13, 1, 'bot')
2019-02-05 19:44:01 [WARNING ] (13, 1, 'bot')
2019-02-05 19:44:01 [WARNING ] (13, 1, 'bot')
2019-02-05 19:44:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:44:01 [DEBUG   ] Finished updating board flags in 1.222 seconds
2019-02-05 19:44:16 [DEBUG   ] Got command BAM from MCS: ref #1412594
2019-02-05 19:44:16 [INFO    ] Finished processing BAM request
2019-02-05 19:44:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:44:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412594   8 58519 71056029 A  ERROR'
2019-02-05 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 19:44:16 [DEBUG   ] spawn_process: at 2019-02-05 19:44:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 19:44:16 [DEBUG   ] spawn_process: at 2019-02-05 19:44:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 19:44:16 [DEBUG   ] spawn_process: at 2019-02-05 19:44:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 19:44:16 [DEBUG   ] spawn_process: at 2019-02-05 19:44:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 19:44:16 [DEBUG   ] spawn_process: at 2019-02-05 19:44:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 19:44:16 [DEBUG   ] spawn_process: at 2019-02-05 19:44:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 19:44:16 [DEBUG   ] spawn_process: at 2019-02-05 19:44:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 19:44:16 [DEBUG   ] spawn_process: at 2019-02-05 19:44:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 19:44:16 [DEBUG   ] spawn_process: at 2019-02-05 19:44:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 19:44:16 [DEBUG   ] spawn_process: at 2019-02-05 19:44:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 19:44:16 [DEBUG   ] spawn_process: at 2019-02-05 19:44:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 19:44:16 [DEBUG   ] spawn_process: at 2019-02-05 19:44:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 19:44:16 [DEBUG   ] spawn_process: at 2019-02-05 19:44:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 19:44:16 [DEBUG   ] spawn_process: at 2019-02-05 19:44:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 19:44:16 [DEBUG   ] spawn_process: at 2019-02-05 19:44:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 19:44:16 [DEBUG   ] spawn_process: at 2019-02-05 19:44:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 19:44:16 [DEBUG   ] spawn_process: at 2019-02-05 19:44:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 19:44:16 [DEBUG   ] spawn_process: at 2019-02-05 19:44:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 19:44:16 [DEBUG   ] spawn_process: at 2019-02-05 19:44:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 19:44:16 [DEBUG   ] spawn_process: at 2019-02-05 19:44:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 19:44:16 [DEBUG   ] spawn_process: at 2019-02-05 19:44:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 19:44:16 [DEBUG   ] spawn_process: at 2019-02-05 19:44:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 19:44:16 [DEBUG   ] spawn_process: at 2019-02-05 19:44:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 19:44:16 [DEBUG   ] spawn_process: at 2019-02-05 19:44:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 19:44:16 [DEBUG   ] spawn_process: at 2019-02-05 19:44:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 19:44:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 19:44:16 [DEBUG   ] spawn_process: at 2019-02-05 19:44:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 19:44:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 19:44:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 19:44:40 [DEBUG   ] Got command BAM from MCS: ref #1412597
2019-02-05 19:44:40 [INFO    ] Finished processing BAM request
2019-02-05 19:44:40 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:44:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412597   8 58519 71080033 A  ERROR'
2019-02-05 19:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 19:44:40 [DEBUG   ] spawn_process: at 2019-02-05 19:44:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 19:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 19:44:40 [DEBUG   ] spawn_process: at 2019-02-05 19:44:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 19:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 19:44:40 [DEBUG   ] spawn_process: at 2019-02-05 19:44:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 19:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 19:44:40 [DEBUG   ] spawn_process: at 2019-02-05 19:44:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 19:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 19:44:40 [DEBUG   ] spawn_process: at 2019-02-05 19:44:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 19:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 19:44:40 [DEBUG   ] spawn_process: at 2019-02-05 19:44:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 19:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 19:44:40 [DEBUG   ] spawn_process: at 2019-02-05 19:44:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 19:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 19:44:40 [DEBUG   ] spawn_process: at 2019-02-05 19:44:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 19:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 19:44:40 [DEBUG   ] spawn_process: at 2019-02-05 19:44:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 19:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 19:44:40 [DEBUG   ] spawn_process: at 2019-02-05 19:44:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 19:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 19:44:40 [DEBUG   ] spawn_process: at 2019-02-05 19:44:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 19:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 19:44:40 [DEBUG   ] spawn_process: at 2019-02-05 19:44:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 19:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 19:44:40 [DEBUG   ] spawn_process: at 2019-02-05 19:44:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 19:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 19:44:40 [DEBUG   ] spawn_process: at 2019-02-05 19:44:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 19:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 19:44:40 [DEBUG   ] spawn_process: at 2019-02-05 19:44:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 19:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 19:44:40 [DEBUG   ] spawn_process: at 2019-02-05 19:44:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 19:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 19:44:40 [DEBUG   ] spawn_process: at 2019-02-05 19:44:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 19:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 19:44:40 [DEBUG   ] spawn_process: at 2019-02-05 19:44:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 19:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 19:44:40 [DEBUG   ] spawn_process: at 2019-02-05 19:44:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 19:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 19:44:40 [DEBUG   ] spawn_process: at 2019-02-05 19:44:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 19:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 19:44:40 [DEBUG   ] spawn_process: at 2019-02-05 19:44:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 19:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 19:44:40 [DEBUG   ] spawn_process: at 2019-02-05 19:44:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 19:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 19:44:40 [DEBUG   ] spawn_process: at 2019-02-05 19:44:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 19:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 19:44:40 [DEBUG   ] spawn_process: at 2019-02-05 19:44:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 19:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 19:44:40 [DEBUG   ] spawn_process: at 2019-02-05 19:44:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 19:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 19:44:40 [DEBUG   ] spawn_process: at 2019-02-05 19:44:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 19:44:56 [DEBUG   ] Got command RPT from MCS: ref #1412598
2019-02-05 19:44:56 [DEBUG   ] summary = ERROR
2019-02-05 19:44:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412598  13 58519 71096047 A  ERRORERROR'
2019-02-05 19:44:56 [DEBUG   ] Got command RPT from MCS: ref #1412599
2019-02-05 19:44:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 19:44:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412599  77 58519 71096241 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 19:44:56 [DEBUG   ] Got command RPT from MCS: ref #1412600
2019-02-05 19:44:56 [DEBUG   ] summary = ERROR
2019-02-05 19:44:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412600  13 58519 71096445 A  ERRORERROR'
2019-02-05 19:44:56 [DEBUG   ] Got command RPT from MCS: ref #1412602
2019-02-05 19:44:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 19:44:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412602  77 58519 71096649 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 19:44:56 [DEBUG   ] Got command RPT from MCS: ref #1412603
2019-02-05 19:44:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 19:44:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412603  12 58519 71096853 A  ERRORB¤ff'
2019-02-05 19:44:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 19:45:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-02-05 19:45:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:45:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-02-05 19:45:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-02-05 19:45:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-02-05 19:45:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-05 19:45:01 [WARNING ] (13, 1, 'bot')
2019-02-05 19:45:01 [WARNING ] (13, 1, 'bot')
2019-02-05 19:45:01 [WARNING ] (13, 1, 'bot')
2019-02-05 19:45:01 [WARNING ] (13, 1, 'bot')
2019-02-05 19:45:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:45:01 [DEBUG   ] Finished updating board flags in 1.185 seconds
2019-02-05 19:45:17 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-05 19:45:26 [DEBUG   ] Got command BAM from MCS: ref #1412608
2019-02-05 19:45:26 [INFO    ] Finished processing BAM request
2019-02-05 19:45:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:45:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412608   8 58519 71126025 A  ERROR'
2019-02-05 19:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-02-05 19:45:26 [DEBUG   ] spawn_process: at 2019-02-05 19:45:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-02-05 19:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-02-05 19:45:26 [DEBUG   ] spawn_process: at 2019-02-05 19:45:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-02-05 19:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-02-05 19:45:26 [DEBUG   ] spawn_process: at 2019-02-05 19:45:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-02-05 19:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-02-05 19:45:26 [DEBUG   ] spawn_process: at 2019-02-05 19:45:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-02-05 19:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-02-05 19:45:26 [DEBUG   ] spawn_process: at 2019-02-05 19:45:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-02-05 19:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-02-05 19:45:26 [DEBUG   ] spawn_process: at 2019-02-05 19:45:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-02-05 19:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-02-05 19:45:26 [DEBUG   ] spawn_process: at 2019-02-05 19:45:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-02-05 19:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-02-05 19:45:26 [DEBUG   ] spawn_process: at 2019-02-05 19:45:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-02-05 19:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-02-05 19:45:26 [DEBUG   ] spawn_process: at 2019-02-05 19:45:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-02-05 19:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-02-05 19:45:26 [DEBUG   ] spawn_process: at 2019-02-05 19:45:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-02-05 19:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-02-05 19:45:26 [DEBUG   ] spawn_process: at 2019-02-05 19:45:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-02-05 19:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-02-05 19:45:26 [DEBUG   ] spawn_process: at 2019-02-05 19:45:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-02-05 19:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-02-05 19:45:26 [DEBUG   ] spawn_process: at 2019-02-05 19:45:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-02-05 19:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-02-05 19:45:26 [DEBUG   ] spawn_process: at 2019-02-05 19:45:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-02-05 19:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-02-05 19:45:26 [DEBUG   ] spawn_process: at 2019-02-05 19:45:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-02-05 19:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-02-05 19:45:26 [DEBUG   ] spawn_process: at 2019-02-05 19:45:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-02-05 19:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-02-05 19:45:26 [DEBUG   ] spawn_process: at 2019-02-05 19:45:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-02-05 19:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-02-05 19:45:26 [DEBUG   ] spawn_process: at 2019-02-05 19:45:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-02-05 19:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-02-05 19:45:26 [DEBUG   ] spawn_process: at 2019-02-05 19:45:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-02-05 19:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-02-05 19:45:26 [DEBUG   ] spawn_process: at 2019-02-05 19:45:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-02-05 19:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-02-05 19:45:26 [DEBUG   ] spawn_process: at 2019-02-05 19:45:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-02-05 19:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-02-05 19:45:26 [DEBUG   ] spawn_process: at 2019-02-05 19:45:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-02-05 19:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-02-05 19:45:26 [DEBUG   ] spawn_process: at 2019-02-05 19:45:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-02-05 19:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-02-05 19:45:26 [DEBUG   ] spawn_process: at 2019-02-05 19:45:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-02-05 19:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-02-05 19:45:26 [DEBUG   ] spawn_process: at 2019-02-05 19:45:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-02-05 19:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-02-05 19:45:26 [DEBUG   ] spawn_process: at 2019-02-05 19:45:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-02-05 19:45:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 19:45:45 [DEBUG   ] Got command BAM from MCS: ref #1412609
2019-02-05 19:45:45 [INFO    ] Finished processing BAM request
2019-02-05 19:45:45 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:45:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412609   8 58519 71145029 A  ERROR'
2019-02-05 19:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 19:45:45 [DEBUG   ] spawn_process: at 2019-02-05 19:45:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 19:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 19:45:45 [DEBUG   ] spawn_process: at 2019-02-05 19:45:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 19:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 19:45:45 [DEBUG   ] spawn_process: at 2019-02-05 19:45:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 19:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 19:45:45 [DEBUG   ] spawn_process: at 2019-02-05 19:45:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 19:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 19:45:45 [DEBUG   ] spawn_process: at 2019-02-05 19:45:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 19:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 19:45:45 [DEBUG   ] spawn_process: at 2019-02-05 19:45:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 19:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 19:45:45 [DEBUG   ] spawn_process: at 2019-02-05 19:45:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 19:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 19:45:45 [DEBUG   ] spawn_process: at 2019-02-05 19:45:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 19:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 19:45:45 [DEBUG   ] spawn_process: at 2019-02-05 19:45:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 19:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 19:45:45 [DEBUG   ] spawn_process: at 2019-02-05 19:45:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 19:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 19:45:45 [DEBUG   ] spawn_process: at 2019-02-05 19:45:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 19:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 19:45:45 [DEBUG   ] spawn_process: at 2019-02-05 19:45:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 19:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 19:45:45 [DEBUG   ] spawn_process: at 2019-02-05 19:45:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 19:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 19:45:45 [DEBUG   ] spawn_process: at 2019-02-05 19:45:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 19:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 19:45:45 [DEBUG   ] spawn_process: at 2019-02-05 19:45:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 19:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 19:45:45 [DEBUG   ] spawn_process: at 2019-02-05 19:45:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 19:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 19:45:45 [DEBUG   ] spawn_process: at 2019-02-05 19:45:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 19:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 19:45:45 [DEBUG   ] spawn_process: at 2019-02-05 19:45:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 19:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 19:45:45 [DEBUG   ] spawn_process: at 2019-02-05 19:45:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 19:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 19:45:45 [DEBUG   ] spawn_process: at 2019-02-05 19:45:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 19:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 19:45:45 [DEBUG   ] spawn_process: at 2019-02-05 19:45:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 19:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 19:45:45 [DEBUG   ] spawn_process: at 2019-02-05 19:45:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 19:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 19:45:45 [DEBUG   ] spawn_process: at 2019-02-05 19:45:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 19:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 19:45:45 [DEBUG   ] spawn_process: at 2019-02-05 19:45:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 19:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 19:45:45 [DEBUG   ] spawn_process: at 2019-02-05 19:45:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 19:45:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 19:45:45 [DEBUG   ] spawn_process: at 2019-02-05 19:45:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 19:45:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 19:46:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:46:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2019-02-05 19:46:01 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-02-05 19:46:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-02-05 19:46:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-05 19:46:01 [WARNING ] (13, 1, 'bot')
2019-02-05 19:46:01 [WARNING ] (13, 1, 'bot')
2019-02-05 19:46:01 [WARNING ] (13, 1, 'bot')
2019-02-05 19:46:01 [WARNING ] (13, 1, 'bot')
2019-02-05 19:46:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:46:01 [DEBUG   ] Finished updating board flags in 1.020 seconds
2019-02-05 19:46:12 [DEBUG   ] Got command RPT from MCS: ref #1412610
2019-02-05 19:46:12 [DEBUG   ] summary = ERROR
2019-02-05 19:46:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412610  13 58519 71172013 A  ERRORERROR'
2019-02-05 19:46:12 [DEBUG   ] Got command RPT from MCS: ref #1412611
2019-02-05 19:46:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 19:46:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412611  77 58519 71172014 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 19:46:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 19:46:35 [DEBUG   ] Got command BAM from MCS: ref #1412627
2019-02-05 19:46:35 [INFO    ] Finished processing BAM request
2019-02-05 19:46:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:46:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412627   8 58519 71195033 A  ERROR'
2019-02-05 19:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 19:46:35 [DEBUG   ] spawn_process: at 2019-02-05 19:46:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 19:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 19:46:35 [DEBUG   ] spawn_process: at 2019-02-05 19:46:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 19:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 19:46:35 [DEBUG   ] spawn_process: at 2019-02-05 19:46:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 19:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 19:46:35 [DEBUG   ] spawn_process: at 2019-02-05 19:46:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 19:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 19:46:35 [DEBUG   ] spawn_process: at 2019-02-05 19:46:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 19:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 19:46:35 [DEBUG   ] spawn_process: at 2019-02-05 19:46:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 19:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 19:46:35 [DEBUG   ] spawn_process: at 2019-02-05 19:46:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 19:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 19:46:35 [DEBUG   ] spawn_process: at 2019-02-05 19:46:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 19:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 19:46:35 [DEBUG   ] spawn_process: at 2019-02-05 19:46:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 19:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 19:46:35 [DEBUG   ] spawn_process: at 2019-02-05 19:46:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 19:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 19:46:35 [DEBUG   ] spawn_process: at 2019-02-05 19:46:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 19:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 19:46:35 [DEBUG   ] spawn_process: at 2019-02-05 19:46:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 19:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 19:46:35 [DEBUG   ] spawn_process: at 2019-02-05 19:46:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 19:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 19:46:35 [DEBUG   ] spawn_process: at 2019-02-05 19:46:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 19:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 19:46:35 [DEBUG   ] spawn_process: at 2019-02-05 19:46:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 19:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 19:46:35 [DEBUG   ] spawn_process: at 2019-02-05 19:46:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 19:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 19:46:35 [DEBUG   ] spawn_process: at 2019-02-05 19:46:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 19:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 19:46:35 [DEBUG   ] spawn_process: at 2019-02-05 19:46:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 19:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 19:46:35 [DEBUG   ] spawn_process: at 2019-02-05 19:46:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 19:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 19:46:35 [DEBUG   ] spawn_process: at 2019-02-05 19:46:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 19:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 19:46:35 [DEBUG   ] spawn_process: at 2019-02-05 19:46:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 19:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 19:46:35 [DEBUG   ] spawn_process: at 2019-02-05 19:46:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 19:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 19:46:35 [DEBUG   ] spawn_process: at 2019-02-05 19:46:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 19:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 19:46:35 [DEBUG   ] spawn_process: at 2019-02-05 19:46:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 19:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 19:46:35 [DEBUG   ] spawn_process: at 2019-02-05 19:46:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 19:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 19:46:35 [DEBUG   ] spawn_process: at 2019-02-05 19:46:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 19:46:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 19:46:50 [DEBUG   ] Got command BAM from MCS: ref #1412628
2019-02-05 19:46:50 [INFO    ] Finished processing BAM request
2019-02-05 19:46:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:46:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412628   8 58519 71210029 A  ERROR'
2019-02-05 19:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 19:46:50 [DEBUG   ] spawn_process: at 2019-02-05 19:46:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 19:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 19:46:50 [DEBUG   ] spawn_process: at 2019-02-05 19:46:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 19:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 19:46:50 [DEBUG   ] spawn_process: at 2019-02-05 19:46:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 19:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 19:46:50 [DEBUG   ] spawn_process: at 2019-02-05 19:46:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 19:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 19:46:50 [DEBUG   ] spawn_process: at 2019-02-05 19:46:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 19:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 19:46:50 [DEBUG   ] spawn_process: at 2019-02-05 19:46:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 19:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 19:46:50 [DEBUG   ] spawn_process: at 2019-02-05 19:46:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 19:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 19:46:50 [DEBUG   ] spawn_process: at 2019-02-05 19:46:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 19:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 19:46:50 [DEBUG   ] spawn_process: at 2019-02-05 19:46:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 19:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 19:46:50 [DEBUG   ] spawn_process: at 2019-02-05 19:46:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 19:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 19:46:50 [DEBUG   ] spawn_process: at 2019-02-05 19:46:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 19:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 19:46:50 [DEBUG   ] spawn_process: at 2019-02-05 19:46:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 19:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 19:46:50 [DEBUG   ] spawn_process: at 2019-02-05 19:46:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 19:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 19:46:50 [DEBUG   ] spawn_process: at 2019-02-05 19:46:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 19:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 19:46:50 [DEBUG   ] spawn_process: at 2019-02-05 19:46:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 19:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 19:46:50 [DEBUG   ] spawn_process: at 2019-02-05 19:46:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 19:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 19:46:50 [DEBUG   ] spawn_process: at 2019-02-05 19:46:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 19:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 19:46:50 [DEBUG   ] spawn_process: at 2019-02-05 19:46:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 19:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 19:46:50 [DEBUG   ] spawn_process: at 2019-02-05 19:46:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 19:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 19:46:50 [DEBUG   ] spawn_process: at 2019-02-05 19:46:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 19:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 19:46:50 [DEBUG   ] spawn_process: at 2019-02-05 19:46:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 19:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 19:46:50 [DEBUG   ] spawn_process: at 2019-02-05 19:46:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 19:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 19:46:50 [DEBUG   ] spawn_process: at 2019-02-05 19:46:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 19:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 19:46:50 [DEBUG   ] spawn_process: at 2019-02-05 19:46:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 19:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 19:46:50 [DEBUG   ] spawn_process: at 2019-02-05 19:46:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 19:46:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 19:46:50 [DEBUG   ] spawn_process: at 2019-02-05 19:46:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 19:46:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 19:47:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:47:01 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-02-05 19:47:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-02-05 19:47:01 [WARNING ] (13, 1, 'bot')
2019-02-05 19:47:01 [WARNING ] (13, 1, 'bot')
2019-02-05 19:47:01 [WARNING ] (13, 1, 'bot')
2019-02-05 19:47:01 [WARNING ] (13, 1, 'bot')
2019-02-05 19:47:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:47:01 [DEBUG   ] Finished updating board flags in 0.978 seconds
2019-02-05 19:47:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 19:47:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 19:47:44 [DEBUG   ] Got command BAM from MCS: ref #1412633
2019-02-05 19:47:44 [INFO    ] Finished processing BAM request
2019-02-05 19:47:44 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:47:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412633   8 58519 71264025 A  ERROR'
2019-02-05 19:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 19:47:44 [DEBUG   ] spawn_process: at 2019-02-05 19:47:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 19:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 19:47:44 [DEBUG   ] spawn_process: at 2019-02-05 19:47:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 19:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 19:47:44 [DEBUG   ] spawn_process: at 2019-02-05 19:47:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 19:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 19:47:44 [DEBUG   ] spawn_process: at 2019-02-05 19:47:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 19:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 19:47:44 [DEBUG   ] spawn_process: at 2019-02-05 19:47:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 19:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 19:47:44 [DEBUG   ] spawn_process: at 2019-02-05 19:47:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 19:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 19:47:44 [DEBUG   ] spawn_process: at 2019-02-05 19:47:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 19:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 19:47:44 [DEBUG   ] spawn_process: at 2019-02-05 19:47:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 19:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 19:47:44 [DEBUG   ] spawn_process: at 2019-02-05 19:47:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 19:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 19:47:44 [DEBUG   ] spawn_process: at 2019-02-05 19:47:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 19:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 19:47:44 [DEBUG   ] spawn_process: at 2019-02-05 19:47:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 19:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 19:47:44 [DEBUG   ] spawn_process: at 2019-02-05 19:47:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 19:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 19:47:44 [DEBUG   ] spawn_process: at 2019-02-05 19:47:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 19:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 19:47:44 [DEBUG   ] spawn_process: at 2019-02-05 19:47:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 19:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 19:47:44 [DEBUG   ] spawn_process: at 2019-02-05 19:47:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 19:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 19:47:44 [DEBUG   ] spawn_process: at 2019-02-05 19:47:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 19:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 19:47:44 [DEBUG   ] spawn_process: at 2019-02-05 19:47:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 19:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 19:47:44 [DEBUG   ] spawn_process: at 2019-02-05 19:47:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 19:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 19:47:44 [DEBUG   ] spawn_process: at 2019-02-05 19:47:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 19:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 19:47:44 [DEBUG   ] spawn_process: at 2019-02-05 19:47:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 19:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 19:47:44 [DEBUG   ] spawn_process: at 2019-02-05 19:47:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 19:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 19:47:44 [DEBUG   ] spawn_process: at 2019-02-05 19:47:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 19:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 19:47:44 [DEBUG   ] spawn_process: at 2019-02-05 19:47:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 19:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 19:47:44 [DEBUG   ] spawn_process: at 2019-02-05 19:47:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 19:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 19:47:44 [DEBUG   ] spawn_process: at 2019-02-05 19:47:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 19:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 19:47:44 [DEBUG   ] spawn_process: at 2019-02-05 19:47:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 19:47:55 [DEBUG   ] Got command BAM from MCS: ref #1412634
2019-02-05 19:47:55 [INFO    ] Finished processing BAM request
2019-02-05 19:47:55 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:47:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412634   8 58519 71275033 A  ERROR'
2019-02-05 19:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-02-05 19:47:55 [DEBUG   ] spawn_process: at 2019-02-05 19:47:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-02-05 19:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-02-05 19:47:55 [DEBUG   ] spawn_process: at 2019-02-05 19:47:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-02-05 19:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-02-05 19:47:55 [DEBUG   ] spawn_process: at 2019-02-05 19:47:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-02-05 19:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-02-05 19:47:55 [DEBUG   ] spawn_process: at 2019-02-05 19:47:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-02-05 19:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-02-05 19:47:55 [DEBUG   ] spawn_process: at 2019-02-05 19:47:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-02-05 19:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-02-05 19:47:55 [DEBUG   ] spawn_process: at 2019-02-05 19:47:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-02-05 19:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-02-05 19:47:55 [DEBUG   ] spawn_process: at 2019-02-05 19:47:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-02-05 19:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-02-05 19:47:55 [DEBUG   ] spawn_process: at 2019-02-05 19:47:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-02-05 19:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-02-05 19:47:55 [DEBUG   ] spawn_process: at 2019-02-05 19:47:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-02-05 19:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-02-05 19:47:55 [DEBUG   ] spawn_process: at 2019-02-05 19:47:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-02-05 19:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-02-05 19:47:55 [DEBUG   ] spawn_process: at 2019-02-05 19:47:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-02-05 19:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-02-05 19:47:55 [DEBUG   ] spawn_process: at 2019-02-05 19:47:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-02-05 19:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-02-05 19:47:55 [DEBUG   ] spawn_process: at 2019-02-05 19:47:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-02-05 19:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-02-05 19:47:55 [DEBUG   ] spawn_process: at 2019-02-05 19:47:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-02-05 19:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-02-05 19:47:55 [DEBUG   ] spawn_process: at 2019-02-05 19:47:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-02-05 19:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-02-05 19:47:55 [DEBUG   ] spawn_process: at 2019-02-05 19:47:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-02-05 19:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-02-05 19:47:55 [DEBUG   ] spawn_process: at 2019-02-05 19:47:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-02-05 19:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-02-05 19:47:55 [DEBUG   ] spawn_process: at 2019-02-05 19:47:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-02-05 19:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-02-05 19:47:55 [DEBUG   ] spawn_process: at 2019-02-05 19:47:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-02-05 19:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-02-05 19:47:55 [DEBUG   ] spawn_process: at 2019-02-05 19:47:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-02-05 19:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-02-05 19:47:55 [DEBUG   ] spawn_process: at 2019-02-05 19:47:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-02-05 19:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-02-05 19:47:55 [DEBUG   ] spawn_process: at 2019-02-05 19:47:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-02-05 19:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-02-05 19:47:55 [DEBUG   ] spawn_process: at 2019-02-05 19:47:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-02-05 19:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-02-05 19:47:55 [DEBUG   ] spawn_process: at 2019-02-05 19:47:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-02-05 19:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-02-05 19:47:55 [DEBUG   ] spawn_process: at 2019-02-05 19:47:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-02-05 19:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-02-05 19:47:55 [DEBUG   ] spawn_process: at 2019-02-05 19:47:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-02-05 19:47:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 19:48:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-02-05 19:48:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:48:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2019-02-05 19:48:02 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-02-05 19:48:02 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-02-05 19:48:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-05 19:48:02 [WARNING ] (13, 1, 'bot')
2019-02-05 19:48:02 [WARNING ] (13, 1, 'bot')
2019-02-05 19:48:02 [WARNING ] (13, 1, 'bot')
2019-02-05 19:48:02 [WARNING ] (13, 1, 'bot')
2019-02-05 19:48:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:48:02 [DEBUG   ] Finished updating board flags in 1.368 seconds
2019-02-05 19:48:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 19:48:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 19:48:52 [DEBUG   ] Got command BAM from MCS: ref #1412635
2019-02-05 19:48:52 [INFO    ] Finished processing BAM request
2019-02-05 19:48:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:48:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412635   8 58519 71332029 A  ERROR'
2019-02-05 19:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 19:48:52 [DEBUG   ] spawn_process: at 2019-02-05 19:48:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 19:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 19:48:52 [DEBUG   ] spawn_process: at 2019-02-05 19:48:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 19:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 19:48:52 [DEBUG   ] spawn_process: at 2019-02-05 19:48:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 19:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 19:48:52 [DEBUG   ] spawn_process: at 2019-02-05 19:48:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 19:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 19:48:52 [DEBUG   ] spawn_process: at 2019-02-05 19:48:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 19:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 19:48:52 [DEBUG   ] spawn_process: at 2019-02-05 19:48:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 19:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 19:48:52 [DEBUG   ] spawn_process: at 2019-02-05 19:48:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 19:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 19:48:52 [DEBUG   ] spawn_process: at 2019-02-05 19:48:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 19:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 19:48:52 [DEBUG   ] spawn_process: at 2019-02-05 19:48:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 19:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 19:48:52 [DEBUG   ] spawn_process: at 2019-02-05 19:48:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 19:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 19:48:52 [DEBUG   ] spawn_process: at 2019-02-05 19:48:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 19:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 19:48:52 [DEBUG   ] spawn_process: at 2019-02-05 19:48:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 19:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 19:48:52 [DEBUG   ] spawn_process: at 2019-02-05 19:48:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 19:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 19:48:52 [DEBUG   ] spawn_process: at 2019-02-05 19:48:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 19:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 19:48:52 [DEBUG   ] spawn_process: at 2019-02-05 19:48:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 19:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 19:48:52 [DEBUG   ] spawn_process: at 2019-02-05 19:48:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 19:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 19:48:52 [DEBUG   ] spawn_process: at 2019-02-05 19:48:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 19:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 19:48:52 [DEBUG   ] spawn_process: at 2019-02-05 19:48:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 19:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 19:48:52 [DEBUG   ] spawn_process: at 2019-02-05 19:48:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 19:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 19:48:52 [DEBUG   ] spawn_process: at 2019-02-05 19:48:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 19:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 19:48:52 [DEBUG   ] spawn_process: at 2019-02-05 19:48:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 19:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 19:48:52 [DEBUG   ] spawn_process: at 2019-02-05 19:48:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 19:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 19:48:52 [DEBUG   ] spawn_process: at 2019-02-05 19:48:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 19:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 19:48:52 [DEBUG   ] spawn_process: at 2019-02-05 19:48:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 19:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 19:48:52 [DEBUG   ] spawn_process: at 2019-02-05 19:48:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 19:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 19:48:52 [DEBUG   ] spawn_process: at 2019-02-05 19:48:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 19:48:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 19:49:00 [DEBUG   ] Got command BAM from MCS: ref #1412636
2019-02-05 19:49:00 [INFO    ] Finished processing BAM request
2019-02-05 19:49:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:49:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412636   8 58519 71340025 A  ERROR'
2019-02-05 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-02-05 19:49:00 [DEBUG   ] spawn_process: at 2019-02-05 19:49:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-02-05 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-02-05 19:49:00 [DEBUG   ] spawn_process: at 2019-02-05 19:49:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-02-05 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-02-05 19:49:00 [DEBUG   ] spawn_process: at 2019-02-05 19:49:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-02-05 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-02-05 19:49:00 [DEBUG   ] spawn_process: at 2019-02-05 19:49:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-02-05 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-02-05 19:49:00 [DEBUG   ] spawn_process: at 2019-02-05 19:49:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-02-05 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-02-05 19:49:00 [DEBUG   ] spawn_process: at 2019-02-05 19:49:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-02-05 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-02-05 19:49:00 [DEBUG   ] spawn_process: at 2019-02-05 19:49:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-02-05 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-02-05 19:49:00 [DEBUG   ] spawn_process: at 2019-02-05 19:49:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-02-05 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-02-05 19:49:00 [DEBUG   ] spawn_process: at 2019-02-05 19:49:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-02-05 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-02-05 19:49:00 [DEBUG   ] spawn_process: at 2019-02-05 19:49:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-02-05 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-02-05 19:49:00 [DEBUG   ] spawn_process: at 2019-02-05 19:49:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-02-05 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-02-05 19:49:00 [DEBUG   ] spawn_process: at 2019-02-05 19:49:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-02-05 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-02-05 19:49:00 [DEBUG   ] spawn_process: at 2019-02-05 19:49:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-02-05 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-02-05 19:49:00 [DEBUG   ] spawn_process: at 2019-02-05 19:49:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-02-05 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-02-05 19:49:00 [DEBUG   ] spawn_process: at 2019-02-05 19:49:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-02-05 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-02-05 19:49:00 [DEBUG   ] spawn_process: at 2019-02-05 19:49:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-02-05 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-02-05 19:49:00 [DEBUG   ] spawn_process: at 2019-02-05 19:49:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-02-05 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-02-05 19:49:00 [DEBUG   ] spawn_process: at 2019-02-05 19:49:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-02-05 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-02-05 19:49:00 [DEBUG   ] spawn_process: at 2019-02-05 19:49:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-02-05 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-02-05 19:49:00 [DEBUG   ] spawn_process: at 2019-02-05 19:49:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-02-05 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-02-05 19:49:00 [DEBUG   ] spawn_process: at 2019-02-05 19:49:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-02-05 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-02-05 19:49:00 [DEBUG   ] spawn_process: at 2019-02-05 19:49:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-02-05 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-02-05 19:49:00 [DEBUG   ] spawn_process: at 2019-02-05 19:49:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-02-05 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-02-05 19:49:00 [DEBUG   ] spawn_process: at 2019-02-05 19:49:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-02-05 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-02-05 19:49:00 [DEBUG   ] spawn_process: at 2019-02-05 19:49:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-02-05 19:49:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-02-05 19:49:00 [DEBUG   ] spawn_process: at 2019-02-05 19:49:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-02-05 19:49:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-02-05 19:49:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-02-05 19:49:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:49:02 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-02-05 19:49:02 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-02-05 19:49:02 [WARNING ] (13, 1, 'bot')
2019-02-05 19:49:02 [WARNING ] (13, 1, 'bot')
2019-02-05 19:49:02 [WARNING ] (13, 1, 'bot')
2019-02-05 19:49:02 [WARNING ] (13, 1, 'bot')
2019-02-05 19:49:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:49:02 [DEBUG   ] Finished updating board flags in 1.220 seconds
2019-02-05 19:49:17 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-05 19:49:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 19:49:56 [DEBUG   ] Got command RPT from MCS: ref #1412637
2019-02-05 19:49:56 [DEBUG   ] summary = ERROR
2019-02-05 19:49:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412637  13 58519 71396125 A  ERRORERROR'
2019-02-05 19:49:56 [DEBUG   ] Got command RPT from MCS: ref #1412638
2019-02-05 19:49:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 19:49:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412638  77 58519 71396329 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 19:49:56 [DEBUG   ] Got command RPT from MCS: ref #1412639
2019-02-05 19:49:56 [DEBUG   ] summary = ERROR
2019-02-05 19:49:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412639  13 58519 71396537 A  ERRORERROR'
2019-02-05 19:49:56 [DEBUG   ] Got command RPT from MCS: ref #1412640
2019-02-05 19:49:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 19:49:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412640  77 58519 71396729 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 19:49:56 [DEBUG   ] Got command RPT from MCS: ref #1412641
2019-02-05 19:49:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 19:49:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412641  12 58519 71396933 A  ERRORB¤ff'
2019-02-05 19:49:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 19:49:59 [DEBUG   ] Got command BAM from MCS: ref #1412642
2019-02-05 19:49:59 [INFO    ] Finished processing BAM request
2019-02-05 19:49:59 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:49:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412642   8 58519 71399025 A  ERROR'
2019-02-05 19:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-02-05 19:49:59 [DEBUG   ] spawn_process: at 2019-02-05 19:49:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-02-05 19:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-02-05 19:49:59 [DEBUG   ] spawn_process: at 2019-02-05 19:49:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-02-05 19:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-02-05 19:49:59 [DEBUG   ] spawn_process: at 2019-02-05 19:49:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-02-05 19:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-02-05 19:49:59 [DEBUG   ] spawn_process: at 2019-02-05 19:49:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-02-05 19:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-02-05 19:49:59 [DEBUG   ] spawn_process: at 2019-02-05 19:49:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-02-05 19:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-02-05 19:49:59 [DEBUG   ] spawn_process: at 2019-02-05 19:49:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-02-05 19:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-02-05 19:49:59 [DEBUG   ] spawn_process: at 2019-02-05 19:49:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-02-05 19:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-02-05 19:49:59 [DEBUG   ] spawn_process: at 2019-02-05 19:49:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-02-05 19:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-02-05 19:49:59 [DEBUG   ] spawn_process: at 2019-02-05 19:49:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-02-05 19:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-02-05 19:49:59 [DEBUG   ] spawn_process: at 2019-02-05 19:49:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-02-05 19:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-02-05 19:49:59 [DEBUG   ] spawn_process: at 2019-02-05 19:49:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-02-05 19:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-02-05 19:49:59 [DEBUG   ] spawn_process: at 2019-02-05 19:49:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-02-05 19:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-02-05 19:49:59 [DEBUG   ] spawn_process: at 2019-02-05 19:49:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-02-05 19:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-02-05 19:49:59 [DEBUG   ] spawn_process: at 2019-02-05 19:49:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-02-05 19:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-02-05 19:49:59 [DEBUG   ] spawn_process: at 2019-02-05 19:49:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-02-05 19:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-02-05 19:49:59 [DEBUG   ] spawn_process: at 2019-02-05 19:49:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-02-05 19:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-02-05 19:49:59 [DEBUG   ] spawn_process: at 2019-02-05 19:49:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-02-05 19:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-02-05 19:49:59 [DEBUG   ] spawn_process: at 2019-02-05 19:49:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-02-05 19:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-02-05 19:49:59 [DEBUG   ] spawn_process: at 2019-02-05 19:49:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-02-05 19:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-02-05 19:49:59 [DEBUG   ] spawn_process: at 2019-02-05 19:49:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-02-05 19:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-02-05 19:49:59 [DEBUG   ] spawn_process: at 2019-02-05 19:49:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-02-05 19:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-02-05 19:49:59 [DEBUG   ] spawn_process: at 2019-02-05 19:49:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-02-05 19:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-02-05 19:49:59 [DEBUG   ] spawn_process: at 2019-02-05 19:49:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-02-05 19:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-02-05 19:49:59 [DEBUG   ] spawn_process: at 2019-02-05 19:49:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-02-05 19:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-02-05 19:49:59 [DEBUG   ] spawn_process: at 2019-02-05 19:49:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-02-05 19:49:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-02-05 19:49:59 [DEBUG   ] spawn_process: at 2019-02-05 19:49:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-02-05 19:50:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-02-05 19:50:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-02-05 19:50:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:50:02 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-02-05 19:50:02 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-02-05 19:50:02 [WARNING ] (13, 1, 'bot')
2019-02-05 19:50:02 [WARNING ] (13, 1, 'bot')
2019-02-05 19:50:02 [WARNING ] (13, 1, 'bot')
2019-02-05 19:50:02 [WARNING ] (13, 1, 'bot')
2019-02-05 19:50:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:50:02 [DEBUG   ] Finished updating board flags in 1.183 seconds
2019-02-05 19:50:05 [DEBUG   ] Got command BAM from MCS: ref #1412643
2019-02-05 19:50:05 [INFO    ] Finished processing BAM request
2019-02-05 19:50:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:50:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412643   8 58519 71405033 A  ERROR'
2019-02-05 19:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-02-05 19:50:05 [DEBUG   ] spawn_process: at 2019-02-05 19:50:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-02-05 19:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-02-05 19:50:05 [DEBUG   ] spawn_process: at 2019-02-05 19:50:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-02-05 19:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-02-05 19:50:05 [DEBUG   ] spawn_process: at 2019-02-05 19:50:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-02-05 19:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-02-05 19:50:05 [DEBUG   ] spawn_process: at 2019-02-05 19:50:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-02-05 19:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-02-05 19:50:05 [DEBUG   ] spawn_process: at 2019-02-05 19:50:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-02-05 19:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-02-05 19:50:05 [DEBUG   ] spawn_process: at 2019-02-05 19:50:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-02-05 19:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-02-05 19:50:05 [DEBUG   ] spawn_process: at 2019-02-05 19:50:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-02-05 19:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-02-05 19:50:05 [DEBUG   ] spawn_process: at 2019-02-05 19:50:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-02-05 19:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-02-05 19:50:05 [DEBUG   ] spawn_process: at 2019-02-05 19:50:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-02-05 19:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-02-05 19:50:05 [DEBUG   ] spawn_process: at 2019-02-05 19:50:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-02-05 19:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-02-05 19:50:05 [DEBUG   ] spawn_process: at 2019-02-05 19:50:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-02-05 19:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-02-05 19:50:05 [DEBUG   ] spawn_process: at 2019-02-05 19:50:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-02-05 19:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-02-05 19:50:05 [DEBUG   ] spawn_process: at 2019-02-05 19:50:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-02-05 19:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-02-05 19:50:05 [DEBUG   ] spawn_process: at 2019-02-05 19:50:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-02-05 19:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-02-05 19:50:05 [DEBUG   ] spawn_process: at 2019-02-05 19:50:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-02-05 19:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-02-05 19:50:05 [DEBUG   ] spawn_process: at 2019-02-05 19:50:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-02-05 19:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-02-05 19:50:05 [DEBUG   ] spawn_process: at 2019-02-05 19:50:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-02-05 19:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-02-05 19:50:05 [DEBUG   ] spawn_process: at 2019-02-05 19:50:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-02-05 19:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-02-05 19:50:05 [DEBUG   ] spawn_process: at 2019-02-05 19:50:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-02-05 19:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-02-05 19:50:05 [DEBUG   ] spawn_process: at 2019-02-05 19:50:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-02-05 19:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-02-05 19:50:05 [DEBUG   ] spawn_process: at 2019-02-05 19:50:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-02-05 19:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-02-05 19:50:05 [DEBUG   ] spawn_process: at 2019-02-05 19:50:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-02-05 19:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-02-05 19:50:05 [DEBUG   ] spawn_process: at 2019-02-05 19:50:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-02-05 19:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-02-05 19:50:05 [DEBUG   ] spawn_process: at 2019-02-05 19:50:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-02-05 19:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-02-05 19:50:05 [DEBUG   ] spawn_process: at 2019-02-05 19:50:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-02-05 19:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-02-05 19:50:05 [DEBUG   ] spawn_process: at 2019-02-05 19:50:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-02-05 19:50:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 19:50:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 19:50:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 19:51:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2019-02-05 19:51:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:51:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2019-02-05 19:51:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2019-02-05 19:51:02 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-02-05 19:51:02 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-02-05 19:51:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-02-05 19:51:02 [WARNING ] (13, 1, 'bot')
2019-02-05 19:51:02 [WARNING ] (13, 1, 'bot')
2019-02-05 19:51:02 [WARNING ] (13, 1, 'bot')
2019-02-05 19:51:02 [WARNING ] (13, 1, 'bot')
2019-02-05 19:51:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:51:02 [DEBUG   ] Finished updating board flags in 1.084 seconds
2019-02-05 19:51:05 [DEBUG   ] Got command BAM from MCS: ref #1412648
2019-02-05 19:51:05 [INFO    ] Finished processing BAM request
2019-02-05 19:51:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412648   8 58519 71465033 A  ERROR'
2019-02-05 19:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-02-05 19:51:05 [DEBUG   ] spawn_process: at 2019-02-05 19:51:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-02-05 19:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-02-05 19:51:05 [DEBUG   ] spawn_process: at 2019-02-05 19:51:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-02-05 19:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-02-05 19:51:05 [DEBUG   ] spawn_process: at 2019-02-05 19:51:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-02-05 19:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-02-05 19:51:05 [DEBUG   ] spawn_process: at 2019-02-05 19:51:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-02-05 19:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-02-05 19:51:05 [DEBUG   ] spawn_process: at 2019-02-05 19:51:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-02-05 19:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-02-05 19:51:05 [DEBUG   ] spawn_process: at 2019-02-05 19:51:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-02-05 19:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-02-05 19:51:05 [DEBUG   ] spawn_process: at 2019-02-05 19:51:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-02-05 19:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-02-05 19:51:05 [DEBUG   ] spawn_process: at 2019-02-05 19:51:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-02-05 19:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-02-05 19:51:05 [DEBUG   ] spawn_process: at 2019-02-05 19:51:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-02-05 19:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-02-05 19:51:05 [DEBUG   ] spawn_process: at 2019-02-05 19:51:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-02-05 19:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-02-05 19:51:05 [DEBUG   ] spawn_process: at 2019-02-05 19:51:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-02-05 19:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-02-05 19:51:05 [DEBUG   ] spawn_process: at 2019-02-05 19:51:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-02-05 19:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-02-05 19:51:05 [DEBUG   ] spawn_process: at 2019-02-05 19:51:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-02-05 19:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-02-05 19:51:05 [DEBUG   ] spawn_process: at 2019-02-05 19:51:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-02-05 19:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-02-05 19:51:05 [DEBUG   ] spawn_process: at 2019-02-05 19:51:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-02-05 19:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-02-05 19:51:05 [DEBUG   ] spawn_process: at 2019-02-05 19:51:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-02-05 19:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-02-05 19:51:05 [DEBUG   ] spawn_process: at 2019-02-05 19:51:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-02-05 19:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-02-05 19:51:05 [DEBUG   ] spawn_process: at 2019-02-05 19:51:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-02-05 19:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-02-05 19:51:05 [DEBUG   ] spawn_process: at 2019-02-05 19:51:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-02-05 19:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-02-05 19:51:05 [DEBUG   ] spawn_process: at 2019-02-05 19:51:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-02-05 19:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-02-05 19:51:05 [DEBUG   ] spawn_process: at 2019-02-05 19:51:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-02-05 19:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-02-05 19:51:05 [DEBUG   ] spawn_process: at 2019-02-05 19:51:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-02-05 19:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-02-05 19:51:05 [DEBUG   ] spawn_process: at 2019-02-05 19:51:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-02-05 19:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-02-05 19:51:05 [DEBUG   ] spawn_process: at 2019-02-05 19:51:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-02-05 19:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-02-05 19:51:05 [DEBUG   ] spawn_process: at 2019-02-05 19:51:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-02-05 19:51:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-02-05 19:51:05 [DEBUG   ] spawn_process: at 2019-02-05 19:51:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-02-05 19:51:10 [DEBUG   ] Got command BAM from MCS: ref #1412649
2019-02-05 19:51:10 [INFO    ] Finished processing BAM request
2019-02-05 19:51:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:51:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412649   8 58519 71470029 A  ERROR'
2019-02-05 19:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-02-05 19:51:10 [DEBUG   ] spawn_process: at 2019-02-05 19:51:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-02-05 19:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-02-05 19:51:10 [DEBUG   ] spawn_process: at 2019-02-05 19:51:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-02-05 19:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-02-05 19:51:10 [DEBUG   ] spawn_process: at 2019-02-05 19:51:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-02-05 19:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-02-05 19:51:10 [DEBUG   ] spawn_process: at 2019-02-05 19:51:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-02-05 19:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-02-05 19:51:10 [DEBUG   ] spawn_process: at 2019-02-05 19:51:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-02-05 19:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-02-05 19:51:10 [DEBUG   ] spawn_process: at 2019-02-05 19:51:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-02-05 19:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-02-05 19:51:10 [DEBUG   ] spawn_process: at 2019-02-05 19:51:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-02-05 19:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-02-05 19:51:10 [DEBUG   ] spawn_process: at 2019-02-05 19:51:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-02-05 19:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-02-05 19:51:10 [DEBUG   ] spawn_process: at 2019-02-05 19:51:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-02-05 19:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-02-05 19:51:10 [DEBUG   ] spawn_process: at 2019-02-05 19:51:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-02-05 19:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-02-05 19:51:10 [DEBUG   ] spawn_process: at 2019-02-05 19:51:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-02-05 19:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-02-05 19:51:10 [DEBUG   ] spawn_process: at 2019-02-05 19:51:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-02-05 19:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-02-05 19:51:10 [DEBUG   ] spawn_process: at 2019-02-05 19:51:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-02-05 19:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-02-05 19:51:10 [DEBUG   ] spawn_process: at 2019-02-05 19:51:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-02-05 19:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-02-05 19:51:10 [DEBUG   ] spawn_process: at 2019-02-05 19:51:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-02-05 19:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-02-05 19:51:10 [DEBUG   ] spawn_process: at 2019-02-05 19:51:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-02-05 19:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-02-05 19:51:10 [DEBUG   ] spawn_process: at 2019-02-05 19:51:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-02-05 19:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-02-05 19:51:10 [DEBUG   ] spawn_process: at 2019-02-05 19:51:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-02-05 19:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-02-05 19:51:10 [DEBUG   ] spawn_process: at 2019-02-05 19:51:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-02-05 19:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-02-05 19:51:10 [DEBUG   ] spawn_process: at 2019-02-05 19:51:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-02-05 19:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-02-05 19:51:10 [DEBUG   ] spawn_process: at 2019-02-05 19:51:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-02-05 19:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-02-05 19:51:10 [DEBUG   ] spawn_process: at 2019-02-05 19:51:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-02-05 19:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-02-05 19:51:10 [DEBUG   ] spawn_process: at 2019-02-05 19:51:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-02-05 19:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-02-05 19:51:10 [DEBUG   ] spawn_process: at 2019-02-05 19:51:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-02-05 19:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-02-05 19:51:10 [DEBUG   ] spawn_process: at 2019-02-05 19:51:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-02-05 19:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-02-05 19:51:10 [DEBUG   ] spawn_process: at 2019-02-05 19:51:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-02-05 19:51:12 [DEBUG   ] Got command RPT from MCS: ref #1412650
2019-02-05 19:51:12 [DEBUG   ] summary = ERROR
2019-02-05 19:51:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412650  13 58519 71472017 A  ERRORERROR'
2019-02-05 19:51:12 [DEBUG   ] Got command RPT from MCS: ref #1412651
2019-02-05 19:51:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 19:51:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412651  77 58519 71472018 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 19:51:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 19:51:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 19:51:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 19:52:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-02-05 19:52:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:52:03 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-02-05 19:52:03 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-02-05 19:52:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-05 19:52:03 [WARNING ] (13, 1, 'bot')
2019-02-05 19:52:03 [WARNING ] (13, 1, 'bot')
2019-02-05 19:52:03 [WARNING ] (13, 1, 'bot')
2019-02-05 19:52:03 [WARNING ] (13, 1, 'bot')
2019-02-05 19:52:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:52:03 [DEBUG   ] Finished updating board flags in 1.994 seconds
2019-02-05 19:52:11 [DEBUG   ] Got command BAM from MCS: ref #1412667
2019-02-05 19:52:11 [INFO    ] Finished processing BAM request
2019-02-05 19:52:11 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:52:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412667   8 58519 71531029 A  ERROR'
2019-02-05 19:52:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 19:52:11 [DEBUG   ] spawn_process: at 2019-02-05 19:52:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 19:52:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 19:52:11 [DEBUG   ] spawn_process: at 2019-02-05 19:52:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 19:52:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 19:52:11 [DEBUG   ] spawn_process: at 2019-02-05 19:52:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 19:52:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 19:52:11 [DEBUG   ] spawn_process: at 2019-02-05 19:52:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 19:52:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 19:52:11 [DEBUG   ] spawn_process: at 2019-02-05 19:52:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 19:52:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 19:52:11 [DEBUG   ] spawn_process: at 2019-02-05 19:52:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 19:52:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 19:52:11 [DEBUG   ] spawn_process: at 2019-02-05 19:52:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 19:52:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 19:52:11 [DEBUG   ] spawn_process: at 2019-02-05 19:52:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 19:52:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 19:52:11 [DEBUG   ] spawn_process: at 2019-02-05 19:52:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 19:52:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 19:52:11 [DEBUG   ] spawn_process: at 2019-02-05 19:52:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 19:52:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 19:52:11 [DEBUG   ] spawn_process: at 2019-02-05 19:52:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 19:52:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 19:52:11 [DEBUG   ] spawn_process: at 2019-02-05 19:52:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 19:52:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 19:52:11 [DEBUG   ] spawn_process: at 2019-02-05 19:52:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 19:52:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 19:52:11 [DEBUG   ] spawn_process: at 2019-02-05 19:52:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 19:52:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 19:52:11 [DEBUG   ] spawn_process: at 2019-02-05 19:52:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 19:52:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 19:52:11 [DEBUG   ] spawn_process: at 2019-02-05 19:52:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 19:52:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 19:52:11 [DEBUG   ] spawn_process: at 2019-02-05 19:52:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 19:52:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 19:52:11 [DEBUG   ] spawn_process: at 2019-02-05 19:52:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 19:52:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 19:52:11 [DEBUG   ] spawn_process: at 2019-02-05 19:52:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 19:52:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 19:52:11 [DEBUG   ] spawn_process: at 2019-02-05 19:52:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 19:52:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 19:52:11 [DEBUG   ] spawn_process: at 2019-02-05 19:52:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 19:52:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 19:52:11 [DEBUG   ] spawn_process: at 2019-02-05 19:52:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 19:52:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 19:52:11 [DEBUG   ] spawn_process: at 2019-02-05 19:52:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 19:52:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 19:52:11 [DEBUG   ] spawn_process: at 2019-02-05 19:52:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 19:52:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 19:52:11 [DEBUG   ] spawn_process: at 2019-02-05 19:52:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 19:52:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 19:52:11 [DEBUG   ] spawn_process: at 2019-02-05 19:52:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 19:52:15 [DEBUG   ] Got command BAM from MCS: ref #1412668
2019-02-05 19:52:15 [INFO    ] Finished processing BAM request
2019-02-05 19:52:15 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:52:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412668   8 58519 71535033 A  ERROR'
2019-02-05 19:52:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 19:52:15 [DEBUG   ] spawn_process: at 2019-02-05 19:52:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 19:52:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 19:52:15 [DEBUG   ] spawn_process: at 2019-02-05 19:52:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 19:52:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 19:52:15 [DEBUG   ] spawn_process: at 2019-02-05 19:52:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 19:52:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 19:52:15 [DEBUG   ] spawn_process: at 2019-02-05 19:52:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 19:52:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 19:52:15 [DEBUG   ] spawn_process: at 2019-02-05 19:52:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 19:52:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 19:52:15 [DEBUG   ] spawn_process: at 2019-02-05 19:52:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 19:52:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 19:52:15 [DEBUG   ] spawn_process: at 2019-02-05 19:52:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 19:52:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 19:52:15 [DEBUG   ] spawn_process: at 2019-02-05 19:52:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 19:52:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 19:52:15 [DEBUG   ] spawn_process: at 2019-02-05 19:52:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 19:52:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 19:52:15 [DEBUG   ] spawn_process: at 2019-02-05 19:52:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 19:52:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 19:52:15 [DEBUG   ] spawn_process: at 2019-02-05 19:52:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 19:52:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 19:52:15 [DEBUG   ] spawn_process: at 2019-02-05 19:52:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 19:52:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 19:52:15 [DEBUG   ] spawn_process: at 2019-02-05 19:52:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 19:52:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 19:52:15 [DEBUG   ] spawn_process: at 2019-02-05 19:52:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 19:52:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 19:52:15 [DEBUG   ] spawn_process: at 2019-02-05 19:52:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 19:52:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 19:52:15 [DEBUG   ] spawn_process: at 2019-02-05 19:52:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 19:52:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 19:52:15 [DEBUG   ] spawn_process: at 2019-02-05 19:52:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 19:52:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 19:52:15 [DEBUG   ] spawn_process: at 2019-02-05 19:52:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 19:52:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 19:52:15 [DEBUG   ] spawn_process: at 2019-02-05 19:52:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 19:52:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 19:52:15 [DEBUG   ] spawn_process: at 2019-02-05 19:52:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 19:52:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 19:52:15 [DEBUG   ] spawn_process: at 2019-02-05 19:52:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 19:52:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 19:52:15 [DEBUG   ] spawn_process: at 2019-02-05 19:52:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 19:52:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 19:52:15 [DEBUG   ] spawn_process: at 2019-02-05 19:52:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 19:52:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 19:52:15 [DEBUG   ] spawn_process: at 2019-02-05 19:52:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 19:52:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 19:52:15 [DEBUG   ] spawn_process: at 2019-02-05 19:52:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 19:52:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 19:52:15 [DEBUG   ] spawn_process: at 2019-02-05 19:52:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 19:52:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 19:52:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 19:52:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 19:53:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 19:53:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-02-05 19:53:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:53:03 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-02-05 19:53:03 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-02-05 19:53:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-05 19:53:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-02-05 19:53:03 [WARNING ] (13, 1, 'bot')
2019-02-05 19:53:03 [WARNING ] (13, 1, 'bot')
2019-02-05 19:53:03 [WARNING ] (13, 1, 'bot')
2019-02-05 19:53:03 [WARNING ] (13, 1, 'bot')
2019-02-05 19:53:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:53:03 [DEBUG   ] Finished updating board flags in 1.815 seconds
2019-02-05 19:53:16 [DEBUG   ] Got command BAM from MCS: ref #1412673
2019-02-05 19:53:16 [INFO    ] Finished processing BAM request
2019-02-05 19:53:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:53:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412673   8 58519 71596025 A  ERROR'
2019-02-05 19:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-02-05 19:53:16 [DEBUG   ] spawn_process: at 2019-02-05 19:53:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-02-05 19:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-02-05 19:53:16 [DEBUG   ] spawn_process: at 2019-02-05 19:53:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-02-05 19:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-02-05 19:53:16 [DEBUG   ] spawn_process: at 2019-02-05 19:53:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-02-05 19:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-02-05 19:53:16 [DEBUG   ] spawn_process: at 2019-02-05 19:53:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-02-05 19:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-02-05 19:53:16 [DEBUG   ] spawn_process: at 2019-02-05 19:53:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-02-05 19:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-02-05 19:53:16 [DEBUG   ] spawn_process: at 2019-02-05 19:53:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-02-05 19:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-02-05 19:53:16 [DEBUG   ] spawn_process: at 2019-02-05 19:53:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-02-05 19:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-02-05 19:53:16 [DEBUG   ] spawn_process: at 2019-02-05 19:53:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-02-05 19:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-02-05 19:53:16 [DEBUG   ] spawn_process: at 2019-02-05 19:53:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-02-05 19:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-02-05 19:53:16 [DEBUG   ] spawn_process: at 2019-02-05 19:53:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-02-05 19:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-02-05 19:53:16 [DEBUG   ] spawn_process: at 2019-02-05 19:53:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-02-05 19:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-02-05 19:53:16 [DEBUG   ] spawn_process: at 2019-02-05 19:53:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-02-05 19:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-02-05 19:53:16 [DEBUG   ] spawn_process: at 2019-02-05 19:53:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-02-05 19:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-02-05 19:53:16 [DEBUG   ] spawn_process: at 2019-02-05 19:53:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-02-05 19:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-02-05 19:53:16 [DEBUG   ] spawn_process: at 2019-02-05 19:53:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-02-05 19:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-02-05 19:53:16 [DEBUG   ] spawn_process: at 2019-02-05 19:53:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-02-05 19:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-02-05 19:53:16 [DEBUG   ] spawn_process: at 2019-02-05 19:53:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-02-05 19:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-02-05 19:53:16 [DEBUG   ] spawn_process: at 2019-02-05 19:53:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-02-05 19:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-02-05 19:53:16 [DEBUG   ] spawn_process: at 2019-02-05 19:53:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-02-05 19:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-02-05 19:53:16 [DEBUG   ] spawn_process: at 2019-02-05 19:53:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-02-05 19:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-02-05 19:53:16 [DEBUG   ] spawn_process: at 2019-02-05 19:53:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-02-05 19:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-02-05 19:53:16 [DEBUG   ] spawn_process: at 2019-02-05 19:53:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-02-05 19:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-02-05 19:53:16 [DEBUG   ] spawn_process: at 2019-02-05 19:53:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-02-05 19:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-02-05 19:53:16 [DEBUG   ] spawn_process: at 2019-02-05 19:53:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-02-05 19:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-02-05 19:53:16 [DEBUG   ] spawn_process: at 2019-02-05 19:53:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-02-05 19:53:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-02-05 19:53:16 [DEBUG   ] spawn_process: at 2019-02-05 19:53:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-02-05 19:53:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 19:53:20 [DEBUG   ] Got command BAM from MCS: ref #1412674
2019-02-05 19:53:20 [INFO    ] Finished processing BAM request
2019-02-05 19:53:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:53:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412674   8 58519 71600025 A  ERROR'
2019-02-05 19:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 19:53:20 [DEBUG   ] spawn_process: at 2019-02-05 19:53:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 19:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 19:53:20 [DEBUG   ] spawn_process: at 2019-02-05 19:53:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 19:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 19:53:20 [DEBUG   ] spawn_process: at 2019-02-05 19:53:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 19:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 19:53:20 [DEBUG   ] spawn_process: at 2019-02-05 19:53:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 19:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 19:53:20 [DEBUG   ] spawn_process: at 2019-02-05 19:53:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 19:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 19:53:20 [DEBUG   ] spawn_process: at 2019-02-05 19:53:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 19:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 19:53:20 [DEBUG   ] spawn_process: at 2019-02-05 19:53:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 19:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 19:53:20 [DEBUG   ] spawn_process: at 2019-02-05 19:53:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 19:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 19:53:20 [DEBUG   ] spawn_process: at 2019-02-05 19:53:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 19:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 19:53:20 [DEBUG   ] spawn_process: at 2019-02-05 19:53:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 19:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 19:53:20 [DEBUG   ] spawn_process: at 2019-02-05 19:53:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 19:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 19:53:20 [DEBUG   ] spawn_process: at 2019-02-05 19:53:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 19:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 19:53:20 [DEBUG   ] spawn_process: at 2019-02-05 19:53:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 19:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 19:53:20 [DEBUG   ] spawn_process: at 2019-02-05 19:53:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 19:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 19:53:20 [DEBUG   ] spawn_process: at 2019-02-05 19:53:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 19:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 19:53:20 [DEBUG   ] spawn_process: at 2019-02-05 19:53:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 19:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 19:53:20 [DEBUG   ] spawn_process: at 2019-02-05 19:53:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 19:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 19:53:20 [DEBUG   ] spawn_process: at 2019-02-05 19:53:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 19:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 19:53:20 [DEBUG   ] spawn_process: at 2019-02-05 19:53:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 19:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 19:53:20 [DEBUG   ] spawn_process: at 2019-02-05 19:53:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 19:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 19:53:20 [DEBUG   ] spawn_process: at 2019-02-05 19:53:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 19:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 19:53:20 [DEBUG   ] spawn_process: at 2019-02-05 19:53:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 19:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 19:53:20 [DEBUG   ] spawn_process: at 2019-02-05 19:53:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 19:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 19:53:20 [DEBUG   ] spawn_process: at 2019-02-05 19:53:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 19:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 19:53:20 [DEBUG   ] spawn_process: at 2019-02-05 19:53:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 19:53:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 19:53:20 [DEBUG   ] spawn_process: at 2019-02-05 19:53:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 19:53:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 19:53:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 19:54:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-02-05 19:54:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-02-05 19:54:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:54:02 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-02-05 19:54:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-02-05 19:54:02 [WARNING ] (13, 1, 'bot')
2019-02-05 19:54:02 [WARNING ] (13, 1, 'bot')
2019-02-05 19:54:02 [WARNING ] (13, 1, 'bot')
2019-02-05 19:54:02 [WARNING ] (13, 1, 'bot')
2019-02-05 19:54:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:54:02 [DEBUG   ] Finished updating board flags in 1.181 seconds
2019-02-05 19:54:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 19:54:20 [DEBUG   ] Got command BAM from MCS: ref #1412675
2019-02-05 19:54:20 [INFO    ] Finished processing BAM request
2019-02-05 19:54:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412675   8 58519 71660029 A  ERROR'
2019-02-05 19:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-02-05 19:54:20 [DEBUG   ] spawn_process: at 2019-02-05 19:54:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-02-05 19:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-02-05 19:54:20 [DEBUG   ] spawn_process: at 2019-02-05 19:54:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-02-05 19:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-02-05 19:54:20 [DEBUG   ] spawn_process: at 2019-02-05 19:54:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-02-05 19:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-02-05 19:54:20 [DEBUG   ] spawn_process: at 2019-02-05 19:54:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-02-05 19:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-02-05 19:54:20 [DEBUG   ] spawn_process: at 2019-02-05 19:54:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-02-05 19:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-02-05 19:54:20 [DEBUG   ] spawn_process: at 2019-02-05 19:54:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-02-05 19:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-02-05 19:54:20 [DEBUG   ] spawn_process: at 2019-02-05 19:54:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-02-05 19:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-02-05 19:54:20 [DEBUG   ] spawn_process: at 2019-02-05 19:54:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-02-05 19:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-02-05 19:54:20 [DEBUG   ] spawn_process: at 2019-02-05 19:54:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-02-05 19:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-02-05 19:54:20 [DEBUG   ] spawn_process: at 2019-02-05 19:54:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-02-05 19:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-02-05 19:54:20 [DEBUG   ] spawn_process: at 2019-02-05 19:54:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-02-05 19:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-02-05 19:54:20 [DEBUG   ] spawn_process: at 2019-02-05 19:54:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-02-05 19:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-02-05 19:54:20 [DEBUG   ] spawn_process: at 2019-02-05 19:54:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-02-05 19:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-02-05 19:54:20 [DEBUG   ] spawn_process: at 2019-02-05 19:54:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-02-05 19:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-02-05 19:54:20 [DEBUG   ] spawn_process: at 2019-02-05 19:54:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-02-05 19:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-02-05 19:54:20 [DEBUG   ] spawn_process: at 2019-02-05 19:54:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-02-05 19:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-02-05 19:54:20 [DEBUG   ] spawn_process: at 2019-02-05 19:54:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-02-05 19:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-02-05 19:54:20 [DEBUG   ] spawn_process: at 2019-02-05 19:54:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-02-05 19:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-02-05 19:54:20 [DEBUG   ] spawn_process: at 2019-02-05 19:54:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-02-05 19:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-02-05 19:54:20 [DEBUG   ] spawn_process: at 2019-02-05 19:54:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-02-05 19:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-02-05 19:54:20 [DEBUG   ] spawn_process: at 2019-02-05 19:54:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-02-05 19:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-02-05 19:54:20 [DEBUG   ] spawn_process: at 2019-02-05 19:54:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-02-05 19:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-02-05 19:54:20 [DEBUG   ] spawn_process: at 2019-02-05 19:54:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-02-05 19:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-02-05 19:54:20 [DEBUG   ] spawn_process: at 2019-02-05 19:54:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-02-05 19:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-02-05 19:54:20 [DEBUG   ] spawn_process: at 2019-02-05 19:54:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-02-05 19:54:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-02-05 19:54:20 [DEBUG   ] spawn_process: at 2019-02-05 19:54:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-02-05 19:54:25 [DEBUG   ] Got command BAM from MCS: ref #1412676
2019-02-05 19:54:25 [INFO    ] Finished processing BAM request
2019-02-05 19:54:25 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:54:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412676   8 58519 71665025 A  ERROR'
2019-02-05 19:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-02-05 19:54:25 [DEBUG   ] spawn_process: at 2019-02-05 19:54:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-02-05 19:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-02-05 19:54:25 [DEBUG   ] spawn_process: at 2019-02-05 19:54:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-02-05 19:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-02-05 19:54:25 [DEBUG   ] spawn_process: at 2019-02-05 19:54:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-02-05 19:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-02-05 19:54:25 [DEBUG   ] spawn_process: at 2019-02-05 19:54:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-02-05 19:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-02-05 19:54:25 [DEBUG   ] spawn_process: at 2019-02-05 19:54:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-02-05 19:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-02-05 19:54:25 [DEBUG   ] spawn_process: at 2019-02-05 19:54:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-02-05 19:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-02-05 19:54:25 [DEBUG   ] spawn_process: at 2019-02-05 19:54:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-02-05 19:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-02-05 19:54:25 [DEBUG   ] spawn_process: at 2019-02-05 19:54:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-02-05 19:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-02-05 19:54:25 [DEBUG   ] spawn_process: at 2019-02-05 19:54:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-02-05 19:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-02-05 19:54:25 [DEBUG   ] spawn_process: at 2019-02-05 19:54:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-02-05 19:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-02-05 19:54:25 [DEBUG   ] spawn_process: at 2019-02-05 19:54:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-02-05 19:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-02-05 19:54:25 [DEBUG   ] spawn_process: at 2019-02-05 19:54:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-02-05 19:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-02-05 19:54:25 [DEBUG   ] spawn_process: at 2019-02-05 19:54:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-02-05 19:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-02-05 19:54:25 [DEBUG   ] spawn_process: at 2019-02-05 19:54:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-02-05 19:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-02-05 19:54:25 [DEBUG   ] spawn_process: at 2019-02-05 19:54:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-02-05 19:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-02-05 19:54:25 [DEBUG   ] spawn_process: at 2019-02-05 19:54:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-02-05 19:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-02-05 19:54:25 [DEBUG   ] spawn_process: at 2019-02-05 19:54:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-02-05 19:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-02-05 19:54:25 [DEBUG   ] spawn_process: at 2019-02-05 19:54:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-02-05 19:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-02-05 19:54:25 [DEBUG   ] spawn_process: at 2019-02-05 19:54:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-02-05 19:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-02-05 19:54:25 [DEBUG   ] spawn_process: at 2019-02-05 19:54:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-02-05 19:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-02-05 19:54:25 [DEBUG   ] spawn_process: at 2019-02-05 19:54:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-02-05 19:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-02-05 19:54:25 [DEBUG   ] spawn_process: at 2019-02-05 19:54:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-02-05 19:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-02-05 19:54:25 [DEBUG   ] spawn_process: at 2019-02-05 19:54:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-02-05 19:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-02-05 19:54:25 [DEBUG   ] spawn_process: at 2019-02-05 19:54:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-02-05 19:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-02-05 19:54:25 [DEBUG   ] spawn_process: at 2019-02-05 19:54:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-02-05 19:54:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-02-05 19:54:25 [DEBUG   ] spawn_process: at 2019-02-05 19:54:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-02-05 19:54:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 19:54:56 [DEBUG   ] Got command RPT from MCS: ref #1412679
2019-02-05 19:54:56 [DEBUG   ] summary = ERROR
2019-02-05 19:54:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412679  13 58519 71696217 A  ERRORERROR'
2019-02-05 19:54:56 [DEBUG   ] Got command RPT from MCS: ref #1412680
2019-02-05 19:54:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 19:54:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412680  77 58519 71696421 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 19:54:56 [DEBUG   ] Got command RPT from MCS: ref #1412681
2019-02-05 19:54:56 [DEBUG   ] summary = ERROR
2019-02-05 19:54:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412681  13 58519 71696613 A  ERRORERROR'
2019-02-05 19:54:56 [DEBUG   ] Got command RPT from MCS: ref #1412683
2019-02-05 19:54:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 19:54:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412683  77 58519 71696817 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 19:54:57 [DEBUG   ] Got command RPT from MCS: ref #1412685
2019-02-05 19:54:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 19:54:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412685  12 58519 71697021 A  ERRORB¤ff'
2019-02-05 19:54:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 19:55:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:55:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-02-05 19:55:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2019-02-05 19:55:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-02-05 19:55:03 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-02-05 19:55:03 [WARNING ] (13, 1, 'bot')
2019-02-05 19:55:03 [WARNING ] (13, 1, 'bot')
2019-02-05 19:55:03 [WARNING ] (13, 1, 'bot')
2019-02-05 19:55:03 [WARNING ] (13, 1, 'bot')
2019-02-05 19:55:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:55:03 [DEBUG   ] Finished updating board flags in 1.541 seconds
2019-02-05 19:55:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 19:55:24 [DEBUG   ] Got command BAM from MCS: ref #1412689
2019-02-05 19:55:24 [INFO    ] Finished processing BAM request
2019-02-05 19:55:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:55:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412689   8 58519 71724025 A  ERROR'
2019-02-05 19:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-02-05 19:55:24 [DEBUG   ] spawn_process: at 2019-02-05 19:55:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-02-05 19:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-02-05 19:55:24 [DEBUG   ] spawn_process: at 2019-02-05 19:55:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-02-05 19:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-02-05 19:55:24 [DEBUG   ] spawn_process: at 2019-02-05 19:55:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-02-05 19:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-02-05 19:55:24 [DEBUG   ] spawn_process: at 2019-02-05 19:55:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-02-05 19:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-02-05 19:55:24 [DEBUG   ] spawn_process: at 2019-02-05 19:55:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-02-05 19:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-02-05 19:55:24 [DEBUG   ] spawn_process: at 2019-02-05 19:55:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-02-05 19:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-02-05 19:55:24 [DEBUG   ] spawn_process: at 2019-02-05 19:55:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-02-05 19:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-02-05 19:55:24 [DEBUG   ] spawn_process: at 2019-02-05 19:55:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-02-05 19:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-02-05 19:55:24 [DEBUG   ] spawn_process: at 2019-02-05 19:55:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-02-05 19:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-02-05 19:55:24 [DEBUG   ] spawn_process: at 2019-02-05 19:55:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-02-05 19:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-02-05 19:55:24 [DEBUG   ] spawn_process: at 2019-02-05 19:55:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-02-05 19:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-02-05 19:55:24 [DEBUG   ] spawn_process: at 2019-02-05 19:55:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-02-05 19:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-02-05 19:55:24 [DEBUG   ] spawn_process: at 2019-02-05 19:55:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-02-05 19:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-02-05 19:55:24 [DEBUG   ] spawn_process: at 2019-02-05 19:55:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-02-05 19:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-02-05 19:55:24 [DEBUG   ] spawn_process: at 2019-02-05 19:55:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-02-05 19:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-02-05 19:55:24 [DEBUG   ] spawn_process: at 2019-02-05 19:55:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-02-05 19:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-02-05 19:55:24 [DEBUG   ] spawn_process: at 2019-02-05 19:55:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-02-05 19:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-02-05 19:55:24 [DEBUG   ] spawn_process: at 2019-02-05 19:55:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-02-05 19:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-02-05 19:55:24 [DEBUG   ] spawn_process: at 2019-02-05 19:55:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-02-05 19:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-02-05 19:55:24 [DEBUG   ] spawn_process: at 2019-02-05 19:55:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-02-05 19:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-02-05 19:55:24 [DEBUG   ] spawn_process: at 2019-02-05 19:55:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-02-05 19:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-02-05 19:55:24 [DEBUG   ] spawn_process: at 2019-02-05 19:55:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-02-05 19:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-02-05 19:55:24 [DEBUG   ] spawn_process: at 2019-02-05 19:55:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-02-05 19:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-02-05 19:55:24 [DEBUG   ] spawn_process: at 2019-02-05 19:55:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-02-05 19:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-02-05 19:55:24 [DEBUG   ] spawn_process: at 2019-02-05 19:55:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-02-05 19:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-02-05 19:55:24 [DEBUG   ] spawn_process: at 2019-02-05 19:55:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-02-05 19:55:30 [DEBUG   ] Got command BAM from MCS: ref #1412690
2019-02-05 19:55:30 [INFO    ] Finished processing BAM request
2019-02-05 19:55:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:55:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412690   8 58519 71730029 A  ERROR'
2019-02-05 19:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 19:55:30 [DEBUG   ] spawn_process: at 2019-02-05 19:55:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 19:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 19:55:30 [DEBUG   ] spawn_process: at 2019-02-05 19:55:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 19:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 19:55:30 [DEBUG   ] spawn_process: at 2019-02-05 19:55:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 19:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 19:55:30 [DEBUG   ] spawn_process: at 2019-02-05 19:55:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 19:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 19:55:30 [DEBUG   ] spawn_process: at 2019-02-05 19:55:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 19:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 19:55:30 [DEBUG   ] spawn_process: at 2019-02-05 19:55:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 19:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 19:55:30 [DEBUG   ] spawn_process: at 2019-02-05 19:55:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 19:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 19:55:30 [DEBUG   ] spawn_process: at 2019-02-05 19:55:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 19:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 19:55:30 [DEBUG   ] spawn_process: at 2019-02-05 19:55:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 19:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 19:55:30 [DEBUG   ] spawn_process: at 2019-02-05 19:55:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 19:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 19:55:30 [DEBUG   ] spawn_process: at 2019-02-05 19:55:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 19:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 19:55:30 [DEBUG   ] spawn_process: at 2019-02-05 19:55:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 19:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 19:55:30 [DEBUG   ] spawn_process: at 2019-02-05 19:55:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 19:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 19:55:30 [DEBUG   ] spawn_process: at 2019-02-05 19:55:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 19:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 19:55:30 [DEBUG   ] spawn_process: at 2019-02-05 19:55:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 19:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 19:55:30 [DEBUG   ] spawn_process: at 2019-02-05 19:55:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 19:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 19:55:30 [DEBUG   ] spawn_process: at 2019-02-05 19:55:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 19:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 19:55:30 [DEBUG   ] spawn_process: at 2019-02-05 19:55:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 19:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 19:55:30 [DEBUG   ] spawn_process: at 2019-02-05 19:55:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 19:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 19:55:30 [DEBUG   ] spawn_process: at 2019-02-05 19:55:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 19:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 19:55:30 [DEBUG   ] spawn_process: at 2019-02-05 19:55:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 19:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 19:55:30 [DEBUG   ] spawn_process: at 2019-02-05 19:55:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 19:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 19:55:30 [DEBUG   ] spawn_process: at 2019-02-05 19:55:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 19:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 19:55:30 [DEBUG   ] spawn_process: at 2019-02-05 19:55:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 19:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 19:55:30 [DEBUG   ] spawn_process: at 2019-02-05 19:55:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 19:55:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 19:55:30 [DEBUG   ] spawn_process: at 2019-02-05 19:55:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 19:55:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 19:55:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 19:56:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 19:56:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:56:03 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-02-05 19:56:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-05 19:56:03 [WARNING ] (13, 1, 'bot')
2019-02-05 19:56:03 [WARNING ] (13, 1, 'bot')
2019-02-05 19:56:03 [WARNING ] (13, 1, 'bot')
2019-02-05 19:56:03 [WARNING ] (13, 1, 'bot')
2019-02-05 19:56:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:56:03 [DEBUG   ] Finished updating board flags in 1.401 seconds
2019-02-05 19:56:12 [DEBUG   ] Got command RPT from MCS: ref #1412691
2019-02-05 19:56:12 [DEBUG   ] summary = ERROR
2019-02-05 19:56:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412691  13 58519 71772017 A  ERRORERROR'
2019-02-05 19:56:12 [DEBUG   ] Got command RPT from MCS: ref #1412692
2019-02-05 19:56:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 19:56:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412692  77 58519 71772018 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 19:56:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 19:56:27 [DEBUG   ] Got command BAM from MCS: ref #1412712
2019-02-05 19:56:27 [INFO    ] Finished processing BAM request
2019-02-05 19:56:27 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:56:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412712   8 58519 71787025 A  ERROR'
2019-02-05 19:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-02-05 19:56:27 [DEBUG   ] spawn_process: at 2019-02-05 19:56:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-02-05 19:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-02-05 19:56:27 [DEBUG   ] spawn_process: at 2019-02-05 19:56:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-02-05 19:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-02-05 19:56:27 [DEBUG   ] spawn_process: at 2019-02-05 19:56:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-02-05 19:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-02-05 19:56:27 [DEBUG   ] spawn_process: at 2019-02-05 19:56:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-02-05 19:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-02-05 19:56:27 [DEBUG   ] spawn_process: at 2019-02-05 19:56:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-02-05 19:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-02-05 19:56:27 [DEBUG   ] spawn_process: at 2019-02-05 19:56:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-02-05 19:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-02-05 19:56:27 [DEBUG   ] spawn_process: at 2019-02-05 19:56:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-02-05 19:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-02-05 19:56:27 [DEBUG   ] spawn_process: at 2019-02-05 19:56:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-02-05 19:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-02-05 19:56:27 [DEBUG   ] spawn_process: at 2019-02-05 19:56:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-02-05 19:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-02-05 19:56:27 [DEBUG   ] spawn_process: at 2019-02-05 19:56:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-02-05 19:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-02-05 19:56:27 [DEBUG   ] spawn_process: at 2019-02-05 19:56:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-02-05 19:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-02-05 19:56:27 [DEBUG   ] spawn_process: at 2019-02-05 19:56:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-02-05 19:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-02-05 19:56:27 [DEBUG   ] spawn_process: at 2019-02-05 19:56:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-02-05 19:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-02-05 19:56:27 [DEBUG   ] spawn_process: at 2019-02-05 19:56:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-02-05 19:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-02-05 19:56:27 [DEBUG   ] spawn_process: at 2019-02-05 19:56:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-02-05 19:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-02-05 19:56:27 [DEBUG   ] spawn_process: at 2019-02-05 19:56:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-02-05 19:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-02-05 19:56:27 [DEBUG   ] spawn_process: at 2019-02-05 19:56:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-02-05 19:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-02-05 19:56:27 [DEBUG   ] spawn_process: at 2019-02-05 19:56:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-02-05 19:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-02-05 19:56:27 [DEBUG   ] spawn_process: at 2019-02-05 19:56:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-02-05 19:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-02-05 19:56:27 [DEBUG   ] spawn_process: at 2019-02-05 19:56:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-02-05 19:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-02-05 19:56:27 [DEBUG   ] spawn_process: at 2019-02-05 19:56:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-02-05 19:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-02-05 19:56:27 [DEBUG   ] spawn_process: at 2019-02-05 19:56:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-02-05 19:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-02-05 19:56:27 [DEBUG   ] spawn_process: at 2019-02-05 19:56:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-02-05 19:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-02-05 19:56:27 [DEBUG   ] spawn_process: at 2019-02-05 19:56:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-02-05 19:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-02-05 19:56:27 [DEBUG   ] spawn_process: at 2019-02-05 19:56:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-02-05 19:56:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-02-05 19:56:27 [DEBUG   ] spawn_process: at 2019-02-05 19:56:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-02-05 19:56:34 [DEBUG   ] Got command BAM from MCS: ref #1412713
2019-02-05 19:56:34 [INFO    ] Finished processing BAM request
2019-02-05 19:56:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:56:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412713   8 58519 71794025 A  ERROR'
2019-02-05 19:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 19:56:34 [DEBUG   ] spawn_process: at 2019-02-05 19:56:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 19:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 19:56:34 [DEBUG   ] spawn_process: at 2019-02-05 19:56:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 19:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 19:56:34 [DEBUG   ] spawn_process: at 2019-02-05 19:56:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 19:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 19:56:34 [DEBUG   ] spawn_process: at 2019-02-05 19:56:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 19:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 19:56:34 [DEBUG   ] spawn_process: at 2019-02-05 19:56:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 19:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 19:56:34 [DEBUG   ] spawn_process: at 2019-02-05 19:56:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 19:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 19:56:34 [DEBUG   ] spawn_process: at 2019-02-05 19:56:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 19:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 19:56:34 [DEBUG   ] spawn_process: at 2019-02-05 19:56:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 19:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 19:56:34 [DEBUG   ] spawn_process: at 2019-02-05 19:56:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 19:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 19:56:34 [DEBUG   ] spawn_process: at 2019-02-05 19:56:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 19:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 19:56:34 [DEBUG   ] spawn_process: at 2019-02-05 19:56:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 19:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 19:56:34 [DEBUG   ] spawn_process: at 2019-02-05 19:56:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 19:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 19:56:34 [DEBUG   ] spawn_process: at 2019-02-05 19:56:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 19:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 19:56:34 [DEBUG   ] spawn_process: at 2019-02-05 19:56:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 19:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 19:56:34 [DEBUG   ] spawn_process: at 2019-02-05 19:56:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 19:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 19:56:34 [DEBUG   ] spawn_process: at 2019-02-05 19:56:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 19:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 19:56:34 [DEBUG   ] spawn_process: at 2019-02-05 19:56:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 19:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 19:56:34 [DEBUG   ] spawn_process: at 2019-02-05 19:56:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 19:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 19:56:34 [DEBUG   ] spawn_process: at 2019-02-05 19:56:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 19:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 19:56:34 [DEBUG   ] spawn_process: at 2019-02-05 19:56:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 19:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 19:56:34 [DEBUG   ] spawn_process: at 2019-02-05 19:56:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 19:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 19:56:34 [DEBUG   ] spawn_process: at 2019-02-05 19:56:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 19:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 19:56:34 [DEBUG   ] spawn_process: at 2019-02-05 19:56:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 19:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 19:56:34 [DEBUG   ] spawn_process: at 2019-02-05 19:56:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 19:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 19:56:34 [DEBUG   ] spawn_process: at 2019-02-05 19:56:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 19:56:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 19:56:34 [DEBUG   ] spawn_process: at 2019-02-05 19:56:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 19:56:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 19:56:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 19:57:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-02-05 19:57:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2019-02-05 19:57:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:57:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-02-05 19:57:03 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-02-05 19:57:03 [WARNING ] (13, 1, 'bot')
2019-02-05 19:57:03 [WARNING ] (13, 1, 'bot')
2019-02-05 19:57:03 [WARNING ] (13, 1, 'bot')
2019-02-05 19:57:03 [WARNING ] (13, 1, 'bot')
2019-02-05 19:57:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:57:03 [DEBUG   ] Finished updating board flags in 1.852 seconds
2019-02-05 19:57:17 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-05 19:57:30 [DEBUG   ] Got command BAM from MCS: ref #1412714
2019-02-05 19:57:30 [INFO    ] Finished processing BAM request
2019-02-05 19:57:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:57:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412714   8 58519 71850025 A  ERROR'
2019-02-05 19:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-02-05 19:57:30 [DEBUG   ] spawn_process: at 2019-02-05 19:57:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-02-05 19:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-02-05 19:57:30 [DEBUG   ] spawn_process: at 2019-02-05 19:57:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-02-05 19:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-02-05 19:57:30 [DEBUG   ] spawn_process: at 2019-02-05 19:57:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-02-05 19:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-02-05 19:57:30 [DEBUG   ] spawn_process: at 2019-02-05 19:57:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-02-05 19:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-02-05 19:57:30 [DEBUG   ] spawn_process: at 2019-02-05 19:57:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-02-05 19:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-02-05 19:57:30 [DEBUG   ] spawn_process: at 2019-02-05 19:57:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-02-05 19:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-02-05 19:57:30 [DEBUG   ] spawn_process: at 2019-02-05 19:57:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-02-05 19:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-02-05 19:57:30 [DEBUG   ] spawn_process: at 2019-02-05 19:57:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-02-05 19:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-02-05 19:57:30 [DEBUG   ] spawn_process: at 2019-02-05 19:57:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-02-05 19:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-02-05 19:57:30 [DEBUG   ] spawn_process: at 2019-02-05 19:57:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-02-05 19:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-02-05 19:57:30 [DEBUG   ] spawn_process: at 2019-02-05 19:57:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-02-05 19:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-02-05 19:57:30 [DEBUG   ] spawn_process: at 2019-02-05 19:57:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-02-05 19:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-02-05 19:57:30 [DEBUG   ] spawn_process: at 2019-02-05 19:57:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-02-05 19:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-02-05 19:57:30 [DEBUG   ] spawn_process: at 2019-02-05 19:57:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-02-05 19:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-02-05 19:57:30 [DEBUG   ] spawn_process: at 2019-02-05 19:57:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-02-05 19:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-02-05 19:57:30 [DEBUG   ] spawn_process: at 2019-02-05 19:57:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-02-05 19:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-02-05 19:57:30 [DEBUG   ] spawn_process: at 2019-02-05 19:57:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-02-05 19:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-02-05 19:57:30 [DEBUG   ] spawn_process: at 2019-02-05 19:57:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-02-05 19:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-02-05 19:57:30 [DEBUG   ] spawn_process: at 2019-02-05 19:57:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-02-05 19:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-02-05 19:57:30 [DEBUG   ] spawn_process: at 2019-02-05 19:57:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-02-05 19:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-02-05 19:57:30 [DEBUG   ] spawn_process: at 2019-02-05 19:57:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-02-05 19:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-02-05 19:57:30 [DEBUG   ] spawn_process: at 2019-02-05 19:57:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-02-05 19:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-02-05 19:57:30 [DEBUG   ] spawn_process: at 2019-02-05 19:57:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-02-05 19:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-02-05 19:57:30 [DEBUG   ] spawn_process: at 2019-02-05 19:57:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-02-05 19:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-02-05 19:57:30 [DEBUG   ] spawn_process: at 2019-02-05 19:57:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-02-05 19:57:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-02-05 19:57:30 [DEBUG   ] spawn_process: at 2019-02-05 19:57:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-02-05 19:57:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 19:57:38 [DEBUG   ] Got command BAM from MCS: ref #1412715
2019-02-05 19:57:38 [INFO    ] Finished processing BAM request
2019-02-05 19:57:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:57:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412715   8 58519 71858025 A  ERROR'
2019-02-05 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 19:57:38 [DEBUG   ] spawn_process: at 2019-02-05 19:57:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 19:57:38 [DEBUG   ] spawn_process: at 2019-02-05 19:57:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 19:57:38 [DEBUG   ] spawn_process: at 2019-02-05 19:57:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 19:57:38 [DEBUG   ] spawn_process: at 2019-02-05 19:57:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 19:57:38 [DEBUG   ] spawn_process: at 2019-02-05 19:57:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 19:57:38 [DEBUG   ] spawn_process: at 2019-02-05 19:57:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 19:57:38 [DEBUG   ] spawn_process: at 2019-02-05 19:57:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 19:57:38 [DEBUG   ] spawn_process: at 2019-02-05 19:57:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 19:57:38 [DEBUG   ] spawn_process: at 2019-02-05 19:57:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 19:57:38 [DEBUG   ] spawn_process: at 2019-02-05 19:57:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 19:57:38 [DEBUG   ] spawn_process: at 2019-02-05 19:57:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 19:57:38 [DEBUG   ] spawn_process: at 2019-02-05 19:57:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 19:57:38 [DEBUG   ] spawn_process: at 2019-02-05 19:57:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 19:57:38 [DEBUG   ] spawn_process: at 2019-02-05 19:57:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 19:57:38 [DEBUG   ] spawn_process: at 2019-02-05 19:57:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 19:57:38 [DEBUG   ] spawn_process: at 2019-02-05 19:57:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 19:57:38 [DEBUG   ] spawn_process: at 2019-02-05 19:57:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 19:57:38 [DEBUG   ] spawn_process: at 2019-02-05 19:57:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 19:57:38 [DEBUG   ] spawn_process: at 2019-02-05 19:57:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 19:57:38 [DEBUG   ] spawn_process: at 2019-02-05 19:57:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 19:57:38 [DEBUG   ] spawn_process: at 2019-02-05 19:57:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 19:57:38 [DEBUG   ] spawn_process: at 2019-02-05 19:57:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 19:57:38 [DEBUG   ] spawn_process: at 2019-02-05 19:57:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 19:57:38 [DEBUG   ] spawn_process: at 2019-02-05 19:57:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 19:57:38 [DEBUG   ] spawn_process: at 2019-02-05 19:57:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 19:57:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 19:57:38 [DEBUG   ] spawn_process: at 2019-02-05 19:57:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 19:57:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 19:58:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:58:03 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-02-05 19:58:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-02-05 19:58:03 [WARNING ] (13, 1, 'bot')
2019-02-05 19:58:03 [WARNING ] (13, 1, 'bot')
2019-02-05 19:58:03 [WARNING ] (13, 1, 'bot')
2019-02-05 19:58:03 [WARNING ] (13, 1, 'bot')
2019-02-05 19:58:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:58:03 [DEBUG   ] Finished updating board flags in 1.337 seconds
2019-02-05 19:58:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 19:58:32 [DEBUG   ] Got command BAM from MCS: ref #1412716
2019-02-05 19:58:32 [INFO    ] Finished processing BAM request
2019-02-05 19:58:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:58:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412716   8 58519 71912025 A  ERROR'
2019-02-05 19:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 19:58:32 [DEBUG   ] spawn_process: at 2019-02-05 19:58:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 19:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 19:58:32 [DEBUG   ] spawn_process: at 2019-02-05 19:58:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 19:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 19:58:32 [DEBUG   ] spawn_process: at 2019-02-05 19:58:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 19:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 19:58:32 [DEBUG   ] spawn_process: at 2019-02-05 19:58:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 19:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 19:58:32 [DEBUG   ] spawn_process: at 2019-02-05 19:58:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 19:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 19:58:32 [DEBUG   ] spawn_process: at 2019-02-05 19:58:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 19:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 19:58:32 [DEBUG   ] spawn_process: at 2019-02-05 19:58:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 19:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 19:58:32 [DEBUG   ] spawn_process: at 2019-02-05 19:58:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 19:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 19:58:32 [DEBUG   ] spawn_process: at 2019-02-05 19:58:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 19:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 19:58:32 [DEBUG   ] spawn_process: at 2019-02-05 19:58:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 19:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 19:58:32 [DEBUG   ] spawn_process: at 2019-02-05 19:58:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 19:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 19:58:32 [DEBUG   ] spawn_process: at 2019-02-05 19:58:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 19:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 19:58:32 [DEBUG   ] spawn_process: at 2019-02-05 19:58:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 19:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 19:58:32 [DEBUG   ] spawn_process: at 2019-02-05 19:58:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 19:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 19:58:32 [DEBUG   ] spawn_process: at 2019-02-05 19:58:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 19:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 19:58:32 [DEBUG   ] spawn_process: at 2019-02-05 19:58:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 19:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 19:58:32 [DEBUG   ] spawn_process: at 2019-02-05 19:58:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 19:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 19:58:32 [DEBUG   ] spawn_process: at 2019-02-05 19:58:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 19:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 19:58:32 [DEBUG   ] spawn_process: at 2019-02-05 19:58:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 19:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 19:58:32 [DEBUG   ] spawn_process: at 2019-02-05 19:58:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 19:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 19:58:32 [DEBUG   ] spawn_process: at 2019-02-05 19:58:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 19:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 19:58:32 [DEBUG   ] spawn_process: at 2019-02-05 19:58:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 19:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 19:58:32 [DEBUG   ] spawn_process: at 2019-02-05 19:58:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 19:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 19:58:32 [DEBUG   ] spawn_process: at 2019-02-05 19:58:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 19:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 19:58:32 [DEBUG   ] spawn_process: at 2019-02-05 19:58:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 19:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 19:58:32 [DEBUG   ] spawn_process: at 2019-02-05 19:58:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 19:58:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 19:58:42 [DEBUG   ] Got command BAM from MCS: ref #1412717
2019-02-05 19:58:42 [INFO    ] Finished processing BAM request
2019-02-05 19:58:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:58:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412717   8 58519 71922029 A  ERROR'
2019-02-05 19:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-02-05 19:58:42 [DEBUG   ] spawn_process: at 2019-02-05 19:58:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-02-05 19:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-02-05 19:58:42 [DEBUG   ] spawn_process: at 2019-02-05 19:58:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-02-05 19:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-02-05 19:58:42 [DEBUG   ] spawn_process: at 2019-02-05 19:58:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-02-05 19:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-02-05 19:58:42 [DEBUG   ] spawn_process: at 2019-02-05 19:58:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-02-05 19:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-02-05 19:58:42 [DEBUG   ] spawn_process: at 2019-02-05 19:58:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-02-05 19:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-02-05 19:58:42 [DEBUG   ] spawn_process: at 2019-02-05 19:58:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-02-05 19:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-02-05 19:58:42 [DEBUG   ] spawn_process: at 2019-02-05 19:58:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-02-05 19:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-02-05 19:58:42 [DEBUG   ] spawn_process: at 2019-02-05 19:58:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-02-05 19:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-02-05 19:58:42 [DEBUG   ] spawn_process: at 2019-02-05 19:58:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-02-05 19:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-02-05 19:58:42 [DEBUG   ] spawn_process: at 2019-02-05 19:58:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-02-05 19:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-02-05 19:58:42 [DEBUG   ] spawn_process: at 2019-02-05 19:58:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-02-05 19:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-02-05 19:58:42 [DEBUG   ] spawn_process: at 2019-02-05 19:58:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-02-05 19:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-02-05 19:58:42 [DEBUG   ] spawn_process: at 2019-02-05 19:58:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-02-05 19:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-02-05 19:58:42 [DEBUG   ] spawn_process: at 2019-02-05 19:58:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-02-05 19:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-02-05 19:58:42 [DEBUG   ] spawn_process: at 2019-02-05 19:58:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-02-05 19:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-02-05 19:58:42 [DEBUG   ] spawn_process: at 2019-02-05 19:58:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-02-05 19:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-02-05 19:58:42 [DEBUG   ] spawn_process: at 2019-02-05 19:58:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-02-05 19:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-02-05 19:58:42 [DEBUG   ] spawn_process: at 2019-02-05 19:58:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-02-05 19:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-02-05 19:58:42 [DEBUG   ] spawn_process: at 2019-02-05 19:58:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-02-05 19:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-02-05 19:58:42 [DEBUG   ] spawn_process: at 2019-02-05 19:58:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-02-05 19:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-02-05 19:58:42 [DEBUG   ] spawn_process: at 2019-02-05 19:58:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-02-05 19:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-02-05 19:58:42 [DEBUG   ] spawn_process: at 2019-02-05 19:58:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-02-05 19:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-02-05 19:58:42 [DEBUG   ] spawn_process: at 2019-02-05 19:58:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-02-05 19:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-02-05 19:58:42 [DEBUG   ] spawn_process: at 2019-02-05 19:58:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-02-05 19:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-02-05 19:58:42 [DEBUG   ] spawn_process: at 2019-02-05 19:58:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-02-05 19:58:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-02-05 19:58:42 [DEBUG   ] spawn_process: at 2019-02-05 19:58:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-02-05 19:58:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 19:59:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-02-05 19:59:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 19:59:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-02-05 19:59:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-05 19:59:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-02-05 19:59:03 [WARNING ] (13, 1, 'bot')
2019-02-05 19:59:03 [WARNING ] (13, 1, 'bot')
2019-02-05 19:59:03 [WARNING ] (13, 1, 'bot')
2019-02-05 19:59:03 [WARNING ] (13, 1, 'bot')
2019-02-05 19:59:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 19:59:03 [DEBUG   ] Finished updating board flags in 1.211 seconds
2019-02-05 19:59:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 19:59:33 [DEBUG   ] Got command BAM from MCS: ref #1412722
2019-02-05 19:59:33 [INFO    ] Finished processing BAM request
2019-02-05 19:59:33 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:59:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412722   8 58519 71973033 A  ERROR'
2019-02-05 19:59:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-02-05 19:59:33 [DEBUG   ] spawn_process: at 2019-02-05 19:59:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-02-05 19:59:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-02-05 19:59:33 [DEBUG   ] spawn_process: at 2019-02-05 19:59:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-02-05 19:59:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-02-05 19:59:33 [DEBUG   ] spawn_process: at 2019-02-05 19:59:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-02-05 19:59:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-02-05 19:59:33 [DEBUG   ] spawn_process: at 2019-02-05 19:59:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-02-05 19:59:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-02-05 19:59:33 [DEBUG   ] spawn_process: at 2019-02-05 19:59:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-02-05 19:59:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-02-05 19:59:33 [DEBUG   ] spawn_process: at 2019-02-05 19:59:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-02-05 19:59:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-02-05 19:59:33 [DEBUG   ] spawn_process: at 2019-02-05 19:59:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-02-05 19:59:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-02-05 19:59:33 [DEBUG   ] spawn_process: at 2019-02-05 19:59:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-02-05 19:59:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-02-05 19:59:33 [DEBUG   ] spawn_process: at 2019-02-05 19:59:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-02-05 19:59:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-02-05 19:59:33 [DEBUG   ] spawn_process: at 2019-02-05 19:59:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-02-05 19:59:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-02-05 19:59:33 [DEBUG   ] spawn_process: at 2019-02-05 19:59:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-02-05 19:59:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-02-05 19:59:33 [DEBUG   ] spawn_process: at 2019-02-05 19:59:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-02-05 19:59:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-02-05 19:59:33 [DEBUG   ] spawn_process: at 2019-02-05 19:59:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-02-05 19:59:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-02-05 19:59:33 [DEBUG   ] spawn_process: at 2019-02-05 19:59:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-02-05 19:59:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-02-05 19:59:33 [DEBUG   ] spawn_process: at 2019-02-05 19:59:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-02-05 19:59:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-02-05 19:59:33 [DEBUG   ] spawn_process: at 2019-02-05 19:59:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-02-05 19:59:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-02-05 19:59:33 [DEBUG   ] spawn_process: at 2019-02-05 19:59:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-02-05 19:59:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-02-05 19:59:33 [DEBUG   ] spawn_process: at 2019-02-05 19:59:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-02-05 19:59:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-02-05 19:59:33 [DEBUG   ] spawn_process: at 2019-02-05 19:59:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-02-05 19:59:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-02-05 19:59:33 [DEBUG   ] spawn_process: at 2019-02-05 19:59:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-02-05 19:59:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-02-05 19:59:33 [DEBUG   ] spawn_process: at 2019-02-05 19:59:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-02-05 19:59:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-02-05 19:59:33 [DEBUG   ] spawn_process: at 2019-02-05 19:59:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-02-05 19:59:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-02-05 19:59:33 [DEBUG   ] spawn_process: at 2019-02-05 19:59:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-02-05 19:59:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-02-05 19:59:33 [DEBUG   ] spawn_process: at 2019-02-05 19:59:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-02-05 19:59:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-02-05 19:59:33 [DEBUG   ] spawn_process: at 2019-02-05 19:59:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-02-05 19:59:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-02-05 19:59:33 [DEBUG   ] spawn_process: at 2019-02-05 19:59:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-02-05 19:59:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 19:59:46 [DEBUG   ] Got command BAM from MCS: ref #1412723
2019-02-05 19:59:46 [INFO    ] Finished processing BAM request
2019-02-05 19:59:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 19:59:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412723   8 58519 71986029 A  ERROR'
2019-02-05 19:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 19:59:46 [DEBUG   ] spawn_process: at 2019-02-05 19:59:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 19:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 19:59:46 [DEBUG   ] spawn_process: at 2019-02-05 19:59:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 19:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 19:59:46 [DEBUG   ] spawn_process: at 2019-02-05 19:59:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 19:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 19:59:46 [DEBUG   ] spawn_process: at 2019-02-05 19:59:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 19:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 19:59:46 [DEBUG   ] spawn_process: at 2019-02-05 19:59:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 19:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 19:59:46 [DEBUG   ] spawn_process: at 2019-02-05 19:59:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 19:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 19:59:46 [DEBUG   ] spawn_process: at 2019-02-05 19:59:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 19:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 19:59:46 [DEBUG   ] spawn_process: at 2019-02-05 19:59:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 19:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 19:59:46 [DEBUG   ] spawn_process: at 2019-02-05 19:59:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 19:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 19:59:46 [DEBUG   ] spawn_process: at 2019-02-05 19:59:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 19:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 19:59:46 [DEBUG   ] spawn_process: at 2019-02-05 19:59:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 19:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 19:59:46 [DEBUG   ] spawn_process: at 2019-02-05 19:59:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 19:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 19:59:46 [DEBUG   ] spawn_process: at 2019-02-05 19:59:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 19:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 19:59:46 [DEBUG   ] spawn_process: at 2019-02-05 19:59:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 19:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 19:59:46 [DEBUG   ] spawn_process: at 2019-02-05 19:59:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 19:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 19:59:46 [DEBUG   ] spawn_process: at 2019-02-05 19:59:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 19:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 19:59:46 [DEBUG   ] spawn_process: at 2019-02-05 19:59:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 19:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 19:59:46 [DEBUG   ] spawn_process: at 2019-02-05 19:59:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 19:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 19:59:46 [DEBUG   ] spawn_process: at 2019-02-05 19:59:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 19:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 19:59:46 [DEBUG   ] spawn_process: at 2019-02-05 19:59:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 19:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 19:59:46 [DEBUG   ] spawn_process: at 2019-02-05 19:59:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 19:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 19:59:46 [DEBUG   ] spawn_process: at 2019-02-05 19:59:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 19:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 19:59:46 [DEBUG   ] spawn_process: at 2019-02-05 19:59:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 19:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 19:59:46 [DEBUG   ] spawn_process: at 2019-02-05 19:59:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 19:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 19:59:46 [DEBUG   ] spawn_process: at 2019-02-05 19:59:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 19:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 19:59:46 [DEBUG   ] spawn_process: at 2019-02-05 19:59:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 19:59:56 [DEBUG   ] Got command RPT from MCS: ref #1412724
2019-02-05 19:59:56 [DEBUG   ] summary = ERROR
2019-02-05 19:59:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412724  13 58519 71996301 A  ERRORERROR'
2019-02-05 19:59:56 [DEBUG   ] Got command RPT from MCS: ref #1412725
2019-02-05 19:59:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 19:59:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412725  77 58519 71996505 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 19:59:56 [DEBUG   ] Got command RPT from MCS: ref #1412726
2019-02-05 19:59:56 [DEBUG   ] summary = ERROR
2019-02-05 19:59:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412726  13 58519 71996709 A  ERRORERROR'
2019-02-05 19:59:56 [DEBUG   ] Got command RPT from MCS: ref #1412727
2019-02-05 19:59:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 19:59:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412727  77 58519 71996905 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 19:59:57 [DEBUG   ] Got command RPT from MCS: ref #1412728
2019-02-05 19:59:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 19:59:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412728  12 58519 71997105 A  ERRORB£ff'
2019-02-05 19:59:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:00:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-02-05 20:00:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:00:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-02-05 20:00:03 [WARNING ] (13, 1, 'bot')
2019-02-05 20:00:03 [WARNING ] (13, 1, 'bot')
2019-02-05 20:00:03 [WARNING ] (13, 1, 'bot')
2019-02-05 20:00:03 [WARNING ] (13, 1, 'bot')
2019-02-05 20:00:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:00:03 [DEBUG   ] Finished updating board flags in 1.195 seconds
2019-02-05 20:00:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:00:34 [DEBUG   ] Got command BAM from MCS: ref #1412729
2019-02-05 20:00:34 [INFO    ] Finished processing BAM request
2019-02-05 20:00:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:00:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412729   8 58519 72034029 A  ERROR'
2019-02-05 20:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-02-05 20:00:34 [DEBUG   ] spawn_process: at 2019-02-05 20:00:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-02-05 20:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-02-05 20:00:34 [DEBUG   ] spawn_process: at 2019-02-05 20:00:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-02-05 20:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-02-05 20:00:34 [DEBUG   ] spawn_process: at 2019-02-05 20:00:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-02-05 20:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-02-05 20:00:34 [DEBUG   ] spawn_process: at 2019-02-05 20:00:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-02-05 20:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-02-05 20:00:34 [DEBUG   ] spawn_process: at 2019-02-05 20:00:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-02-05 20:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-02-05 20:00:34 [DEBUG   ] spawn_process: at 2019-02-05 20:00:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-02-05 20:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-02-05 20:00:34 [DEBUG   ] spawn_process: at 2019-02-05 20:00:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-02-05 20:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-02-05 20:00:34 [DEBUG   ] spawn_process: at 2019-02-05 20:00:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-02-05 20:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-02-05 20:00:34 [DEBUG   ] spawn_process: at 2019-02-05 20:00:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-02-05 20:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-02-05 20:00:34 [DEBUG   ] spawn_process: at 2019-02-05 20:00:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-02-05 20:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-02-05 20:00:34 [DEBUG   ] spawn_process: at 2019-02-05 20:00:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-02-05 20:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-02-05 20:00:34 [DEBUG   ] spawn_process: at 2019-02-05 20:00:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-02-05 20:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-02-05 20:00:34 [DEBUG   ] spawn_process: at 2019-02-05 20:00:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-02-05 20:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-02-05 20:00:34 [DEBUG   ] spawn_process: at 2019-02-05 20:00:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-02-05 20:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-02-05 20:00:34 [DEBUG   ] spawn_process: at 2019-02-05 20:00:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-02-05 20:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-02-05 20:00:34 [DEBUG   ] spawn_process: at 2019-02-05 20:00:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-02-05 20:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-02-05 20:00:34 [DEBUG   ] spawn_process: at 2019-02-05 20:00:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-02-05 20:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-02-05 20:00:34 [DEBUG   ] spawn_process: at 2019-02-05 20:00:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-02-05 20:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-02-05 20:00:34 [DEBUG   ] spawn_process: at 2019-02-05 20:00:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-02-05 20:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-02-05 20:00:34 [DEBUG   ] spawn_process: at 2019-02-05 20:00:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-02-05 20:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-02-05 20:00:34 [DEBUG   ] spawn_process: at 2019-02-05 20:00:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-02-05 20:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-02-05 20:00:34 [DEBUG   ] spawn_process: at 2019-02-05 20:00:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-02-05 20:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-02-05 20:00:34 [DEBUG   ] spawn_process: at 2019-02-05 20:00:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-02-05 20:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-02-05 20:00:34 [DEBUG   ] spawn_process: at 2019-02-05 20:00:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-02-05 20:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-02-05 20:00:34 [DEBUG   ] spawn_process: at 2019-02-05 20:00:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-02-05 20:00:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-02-05 20:00:34 [DEBUG   ] spawn_process: at 2019-02-05 20:00:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-02-05 20:00:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:00:50 [DEBUG   ] Got command BAM from MCS: ref #1412730
2019-02-05 20:00:50 [INFO    ] Finished processing BAM request
2019-02-05 20:00:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:00:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412730   8 58519 72050029 A  ERROR'
2019-02-05 20:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 20:00:50 [DEBUG   ] spawn_process: at 2019-02-05 20:00:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 20:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 20:00:50 [DEBUG   ] spawn_process: at 2019-02-05 20:00:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 20:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 20:00:50 [DEBUG   ] spawn_process: at 2019-02-05 20:00:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 20:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 20:00:50 [DEBUG   ] spawn_process: at 2019-02-05 20:00:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 20:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 20:00:50 [DEBUG   ] spawn_process: at 2019-02-05 20:00:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 20:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 20:00:50 [DEBUG   ] spawn_process: at 2019-02-05 20:00:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 20:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 20:00:50 [DEBUG   ] spawn_process: at 2019-02-05 20:00:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 20:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 20:00:50 [DEBUG   ] spawn_process: at 2019-02-05 20:00:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 20:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 20:00:50 [DEBUG   ] spawn_process: at 2019-02-05 20:00:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 20:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 20:00:50 [DEBUG   ] spawn_process: at 2019-02-05 20:00:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 20:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 20:00:50 [DEBUG   ] spawn_process: at 2019-02-05 20:00:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 20:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 20:00:50 [DEBUG   ] spawn_process: at 2019-02-05 20:00:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 20:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 20:00:50 [DEBUG   ] spawn_process: at 2019-02-05 20:00:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 20:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 20:00:50 [DEBUG   ] spawn_process: at 2019-02-05 20:00:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 20:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 20:00:50 [DEBUG   ] spawn_process: at 2019-02-05 20:00:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 20:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 20:00:50 [DEBUG   ] spawn_process: at 2019-02-05 20:00:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 20:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 20:00:50 [DEBUG   ] spawn_process: at 2019-02-05 20:00:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 20:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 20:00:50 [DEBUG   ] spawn_process: at 2019-02-05 20:00:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 20:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 20:00:50 [DEBUG   ] spawn_process: at 2019-02-05 20:00:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 20:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 20:00:50 [DEBUG   ] spawn_process: at 2019-02-05 20:00:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 20:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 20:00:50 [DEBUG   ] spawn_process: at 2019-02-05 20:00:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 20:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 20:00:50 [DEBUG   ] spawn_process: at 2019-02-05 20:00:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 20:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 20:00:50 [DEBUG   ] spawn_process: at 2019-02-05 20:00:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 20:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 20:00:50 [DEBUG   ] spawn_process: at 2019-02-05 20:00:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 20:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 20:00:50 [DEBUG   ] spawn_process: at 2019-02-05 20:00:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 20:00:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 20:00:50 [DEBUG   ] spawn_process: at 2019-02-05 20:00:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 20:00:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:01:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 20:01:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:01:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-02-05 20:01:03 [WARNING ] (13, 1, 'bot')
2019-02-05 20:01:03 [WARNING ] (13, 1, 'bot')
2019-02-05 20:01:03 [WARNING ] (13, 1, 'bot')
2019-02-05 20:01:03 [WARNING ] (13, 1, 'bot')
2019-02-05 20:01:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:01:03 [DEBUG   ] Finished updating board flags in 1.004 seconds
2019-02-05 20:01:12 [DEBUG   ] Got command RPT from MCS: ref #1412731
2019-02-05 20:01:12 [DEBUG   ] summary = ERROR
2019-02-05 20:01:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412731  13 58519 72072021 A  ERRORERROR'
2019-02-05 20:01:12 [DEBUG   ] Got command RPT from MCS: ref #1412732
2019-02-05 20:01:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 20:01:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412732  77 58519 72072022 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 20:01:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:01:34 [DEBUG   ] Got command BAM from MCS: ref #1412748
2019-02-05 20:01:34 [INFO    ] Finished processing BAM request
2019-02-05 20:01:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:01:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412748   8 58519 72094025 A  ERROR'
2019-02-05 20:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 20:01:34 [DEBUG   ] spawn_process: at 2019-02-05 20:01:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 20:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 20:01:34 [DEBUG   ] spawn_process: at 2019-02-05 20:01:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 20:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 20:01:34 [DEBUG   ] spawn_process: at 2019-02-05 20:01:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 20:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 20:01:34 [DEBUG   ] spawn_process: at 2019-02-05 20:01:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 20:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 20:01:34 [DEBUG   ] spawn_process: at 2019-02-05 20:01:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 20:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 20:01:34 [DEBUG   ] spawn_process: at 2019-02-05 20:01:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 20:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 20:01:34 [DEBUG   ] spawn_process: at 2019-02-05 20:01:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 20:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 20:01:34 [DEBUG   ] spawn_process: at 2019-02-05 20:01:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 20:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 20:01:34 [DEBUG   ] spawn_process: at 2019-02-05 20:01:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 20:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 20:01:34 [DEBUG   ] spawn_process: at 2019-02-05 20:01:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 20:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 20:01:34 [DEBUG   ] spawn_process: at 2019-02-05 20:01:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 20:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 20:01:34 [DEBUG   ] spawn_process: at 2019-02-05 20:01:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 20:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 20:01:34 [DEBUG   ] spawn_process: at 2019-02-05 20:01:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 20:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 20:01:34 [DEBUG   ] spawn_process: at 2019-02-05 20:01:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 20:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 20:01:34 [DEBUG   ] spawn_process: at 2019-02-05 20:01:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 20:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 20:01:34 [DEBUG   ] spawn_process: at 2019-02-05 20:01:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 20:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 20:01:34 [DEBUG   ] spawn_process: at 2019-02-05 20:01:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 20:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 20:01:34 [DEBUG   ] spawn_process: at 2019-02-05 20:01:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 20:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 20:01:34 [DEBUG   ] spawn_process: at 2019-02-05 20:01:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 20:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 20:01:34 [DEBUG   ] spawn_process: at 2019-02-05 20:01:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 20:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 20:01:34 [DEBUG   ] spawn_process: at 2019-02-05 20:01:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 20:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 20:01:34 [DEBUG   ] spawn_process: at 2019-02-05 20:01:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 20:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 20:01:34 [DEBUG   ] spawn_process: at 2019-02-05 20:01:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 20:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 20:01:34 [DEBUG   ] spawn_process: at 2019-02-05 20:01:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 20:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 20:01:34 [DEBUG   ] spawn_process: at 2019-02-05 20:01:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 20:01:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 20:01:34 [DEBUG   ] spawn_process: at 2019-02-05 20:01:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 20:01:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:01:54 [DEBUG   ] Got command BAM from MCS: ref #1412749
2019-02-05 20:01:54 [INFO    ] Finished processing BAM request
2019-02-05 20:01:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:01:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412749   8 58519 72114025 A  ERROR'
2019-02-05 20:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 20:01:54 [DEBUG   ] spawn_process: at 2019-02-05 20:01:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 20:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 20:01:54 [DEBUG   ] spawn_process: at 2019-02-05 20:01:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 20:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 20:01:54 [DEBUG   ] spawn_process: at 2019-02-05 20:01:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 20:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 20:01:54 [DEBUG   ] spawn_process: at 2019-02-05 20:01:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 20:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 20:01:54 [DEBUG   ] spawn_process: at 2019-02-05 20:01:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 20:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 20:01:54 [DEBUG   ] spawn_process: at 2019-02-05 20:01:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 20:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 20:01:54 [DEBUG   ] spawn_process: at 2019-02-05 20:01:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 20:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 20:01:54 [DEBUG   ] spawn_process: at 2019-02-05 20:01:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 20:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 20:01:54 [DEBUG   ] spawn_process: at 2019-02-05 20:01:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 20:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 20:01:54 [DEBUG   ] spawn_process: at 2019-02-05 20:01:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 20:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 20:01:54 [DEBUG   ] spawn_process: at 2019-02-05 20:01:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 20:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 20:01:54 [DEBUG   ] spawn_process: at 2019-02-05 20:01:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 20:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 20:01:54 [DEBUG   ] spawn_process: at 2019-02-05 20:01:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 20:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 20:01:54 [DEBUG   ] spawn_process: at 2019-02-05 20:01:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 20:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 20:01:54 [DEBUG   ] spawn_process: at 2019-02-05 20:01:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 20:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 20:01:54 [DEBUG   ] spawn_process: at 2019-02-05 20:01:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 20:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 20:01:54 [DEBUG   ] spawn_process: at 2019-02-05 20:01:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 20:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 20:01:54 [DEBUG   ] spawn_process: at 2019-02-05 20:01:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 20:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 20:01:54 [DEBUG   ] spawn_process: at 2019-02-05 20:01:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 20:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 20:01:54 [DEBUG   ] spawn_process: at 2019-02-05 20:01:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 20:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 20:01:54 [DEBUG   ] spawn_process: at 2019-02-05 20:01:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 20:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 20:01:54 [DEBUG   ] spawn_process: at 2019-02-05 20:01:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 20:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 20:01:54 [DEBUG   ] spawn_process: at 2019-02-05 20:01:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 20:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 20:01:54 [DEBUG   ] spawn_process: at 2019-02-05 20:01:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 20:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 20:01:54 [DEBUG   ] spawn_process: at 2019-02-05 20:01:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 20:01:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 20:01:54 [DEBUG   ] spawn_process: at 2019-02-05 20:01:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 20:01:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:02:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-02-05 20:02:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:02:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-02-05 20:02:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-05 20:02:03 [WARNING ] (13, 1, 'bot')
2019-02-05 20:02:03 [WARNING ] (13, 1, 'bot')
2019-02-05 20:02:03 [WARNING ] (13, 1, 'bot')
2019-02-05 20:02:03 [WARNING ] (13, 1, 'bot')
2019-02-05 20:02:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:02:03 [DEBUG   ] Finished updating board flags in 1.009 seconds
2019-02-05 20:02:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:02:34 [DEBUG   ] Got command BAM from MCS: ref #1412754
2019-02-05 20:02:34 [INFO    ] Finished processing BAM request
2019-02-05 20:02:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:02:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412754   8 58519 72154025 A  ERROR'
2019-02-05 20:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 20:02:34 [DEBUG   ] spawn_process: at 2019-02-05 20:02:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 20:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 20:02:34 [DEBUG   ] spawn_process: at 2019-02-05 20:02:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 20:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 20:02:34 [DEBUG   ] spawn_process: at 2019-02-05 20:02:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 20:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 20:02:34 [DEBUG   ] spawn_process: at 2019-02-05 20:02:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 20:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 20:02:34 [DEBUG   ] spawn_process: at 2019-02-05 20:02:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 20:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 20:02:34 [DEBUG   ] spawn_process: at 2019-02-05 20:02:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 20:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 20:02:34 [DEBUG   ] spawn_process: at 2019-02-05 20:02:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 20:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 20:02:34 [DEBUG   ] spawn_process: at 2019-02-05 20:02:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 20:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 20:02:34 [DEBUG   ] spawn_process: at 2019-02-05 20:02:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 20:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 20:02:34 [DEBUG   ] spawn_process: at 2019-02-05 20:02:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 20:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 20:02:34 [DEBUG   ] spawn_process: at 2019-02-05 20:02:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 20:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 20:02:34 [DEBUG   ] spawn_process: at 2019-02-05 20:02:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 20:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 20:02:34 [DEBUG   ] spawn_process: at 2019-02-05 20:02:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 20:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 20:02:34 [DEBUG   ] spawn_process: at 2019-02-05 20:02:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 20:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 20:02:34 [DEBUG   ] spawn_process: at 2019-02-05 20:02:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 20:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 20:02:34 [DEBUG   ] spawn_process: at 2019-02-05 20:02:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 20:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 20:02:34 [DEBUG   ] spawn_process: at 2019-02-05 20:02:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 20:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 20:02:34 [DEBUG   ] spawn_process: at 2019-02-05 20:02:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 20:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 20:02:34 [DEBUG   ] spawn_process: at 2019-02-05 20:02:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 20:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 20:02:34 [DEBUG   ] spawn_process: at 2019-02-05 20:02:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 20:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 20:02:34 [DEBUG   ] spawn_process: at 2019-02-05 20:02:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 20:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 20:02:34 [DEBUG   ] spawn_process: at 2019-02-05 20:02:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 20:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 20:02:34 [DEBUG   ] spawn_process: at 2019-02-05 20:02:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 20:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 20:02:34 [DEBUG   ] spawn_process: at 2019-02-05 20:02:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 20:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 20:02:34 [DEBUG   ] spawn_process: at 2019-02-05 20:02:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 20:02:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 20:02:34 [DEBUG   ] spawn_process: at 2019-02-05 20:02:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 20:02:37 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-05 20:02:57 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 20:02:58 [DEBUG   ] Got command BAM from MCS: ref #1412755
2019-02-05 20:02:58 [INFO    ] Finished processing BAM request
2019-02-05 20:02:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:02:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412755   8 58519 72178025 A  ERROR'
2019-02-05 20:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 20:02:58 [DEBUG   ] spawn_process: at 2019-02-05 20:02:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 20:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 20:02:58 [DEBUG   ] spawn_process: at 2019-02-05 20:02:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 20:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 20:02:58 [DEBUG   ] spawn_process: at 2019-02-05 20:02:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 20:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 20:02:58 [DEBUG   ] spawn_process: at 2019-02-05 20:02:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 20:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 20:02:58 [DEBUG   ] spawn_process: at 2019-02-05 20:02:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 20:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 20:02:58 [DEBUG   ] spawn_process: at 2019-02-05 20:02:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 20:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 20:02:58 [DEBUG   ] spawn_process: at 2019-02-05 20:02:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 20:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 20:02:58 [DEBUG   ] spawn_process: at 2019-02-05 20:02:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 20:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 20:02:58 [DEBUG   ] spawn_process: at 2019-02-05 20:02:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 20:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 20:02:58 [DEBUG   ] spawn_process: at 2019-02-05 20:02:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 20:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 20:02:58 [DEBUG   ] spawn_process: at 2019-02-05 20:02:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 20:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 20:02:58 [DEBUG   ] spawn_process: at 2019-02-05 20:02:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 20:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 20:02:58 [DEBUG   ] spawn_process: at 2019-02-05 20:02:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 20:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 20:02:58 [DEBUG   ] spawn_process: at 2019-02-05 20:02:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 20:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 20:02:58 [DEBUG   ] spawn_process: at 2019-02-05 20:02:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 20:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 20:02:58 [DEBUG   ] spawn_process: at 2019-02-05 20:02:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 20:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 20:02:58 [DEBUG   ] spawn_process: at 2019-02-05 20:02:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 20:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 20:02:58 [DEBUG   ] spawn_process: at 2019-02-05 20:02:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 20:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 20:02:58 [DEBUG   ] spawn_process: at 2019-02-05 20:02:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 20:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 20:02:58 [DEBUG   ] spawn_process: at 2019-02-05 20:02:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 20:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 20:02:58 [DEBUG   ] spawn_process: at 2019-02-05 20:02:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 20:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 20:02:58 [DEBUG   ] spawn_process: at 2019-02-05 20:02:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 20:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 20:02:58 [DEBUG   ] spawn_process: at 2019-02-05 20:02:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 20:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 20:02:58 [DEBUG   ] spawn_process: at 2019-02-05 20:02:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 20:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 20:02:58 [DEBUG   ] spawn_process: at 2019-02-05 20:02:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 20:02:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 20:02:58 [DEBUG   ] spawn_process: at 2019-02-05 20:02:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 20:03:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 20:03:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-02-05 20:03:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:03:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-02-05 20:03:03 [WARNING ] (13, 1, 'bot')
2019-02-05 20:03:03 [WARNING ] (13, 1, 'bot')
2019-02-05 20:03:03 [WARNING ] (13, 1, 'bot')
2019-02-05 20:03:03 [WARNING ] (13, 1, 'bot')
2019-02-05 20:03:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:03:03 [DEBUG   ] Finished updating board flags in 0.985 seconds
2019-02-05 20:03:17 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 20:03:33 [DEBUG   ] Got command BAM from MCS: ref #1412756
2019-02-05 20:03:33 [INFO    ] Finished processing BAM request
2019-02-05 20:03:33 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:03:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412756   8 58519 72213033 A  ERROR'
2019-02-05 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 20:03:33 [DEBUG   ] spawn_process: at 2019-02-05 20:03:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 20:03:33 [DEBUG   ] spawn_process: at 2019-02-05 20:03:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 20:03:33 [DEBUG   ] spawn_process: at 2019-02-05 20:03:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 20:03:33 [DEBUG   ] spawn_process: at 2019-02-05 20:03:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 20:03:33 [DEBUG   ] spawn_process: at 2019-02-05 20:03:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 20:03:33 [DEBUG   ] spawn_process: at 2019-02-05 20:03:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 20:03:33 [DEBUG   ] spawn_process: at 2019-02-05 20:03:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 20:03:33 [DEBUG   ] spawn_process: at 2019-02-05 20:03:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 20:03:33 [DEBUG   ] spawn_process: at 2019-02-05 20:03:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 20:03:33 [DEBUG   ] spawn_process: at 2019-02-05 20:03:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 20:03:33 [DEBUG   ] spawn_process: at 2019-02-05 20:03:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 20:03:33 [DEBUG   ] spawn_process: at 2019-02-05 20:03:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 20:03:33 [DEBUG   ] spawn_process: at 2019-02-05 20:03:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 20:03:33 [DEBUG   ] spawn_process: at 2019-02-05 20:03:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 20:03:33 [DEBUG   ] spawn_process: at 2019-02-05 20:03:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 20:03:33 [DEBUG   ] spawn_process: at 2019-02-05 20:03:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 20:03:33 [DEBUG   ] spawn_process: at 2019-02-05 20:03:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 20:03:33 [DEBUG   ] spawn_process: at 2019-02-05 20:03:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 20:03:33 [DEBUG   ] spawn_process: at 2019-02-05 20:03:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 20:03:33 [DEBUG   ] spawn_process: at 2019-02-05 20:03:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 20:03:33 [DEBUG   ] spawn_process: at 2019-02-05 20:03:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 20:03:33 [DEBUG   ] spawn_process: at 2019-02-05 20:03:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 20:03:33 [DEBUG   ] spawn_process: at 2019-02-05 20:03:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 20:03:33 [DEBUG   ] spawn_process: at 2019-02-05 20:03:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 20:03:33 [DEBUG   ] spawn_process: at 2019-02-05 20:03:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 20:03:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 20:03:33 [DEBUG   ] spawn_process: at 2019-02-05 20:03:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 20:03:37 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 20:03:57 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 20:04:02 [DEBUG   ] Got command BAM from MCS: ref #1412757
2019-02-05 20:04:02 [INFO    ] Finished processing BAM request
2019-02-05 20:04:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:04:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412757   8 58519 72242033 A  ERROR'
2019-02-05 20:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 20:04:02 [DEBUG   ] spawn_process: at 2019-02-05 20:04:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 20:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 20:04:02 [DEBUG   ] spawn_process: at 2019-02-05 20:04:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 20:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 20:04:02 [DEBUG   ] spawn_process: at 2019-02-05 20:04:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 20:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 20:04:02 [DEBUG   ] spawn_process: at 2019-02-05 20:04:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 20:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 20:04:02 [DEBUG   ] spawn_process: at 2019-02-05 20:04:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 20:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 20:04:02 [DEBUG   ] spawn_process: at 2019-02-05 20:04:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 20:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 20:04:02 [DEBUG   ] spawn_process: at 2019-02-05 20:04:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 20:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 20:04:02 [DEBUG   ] spawn_process: at 2019-02-05 20:04:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 20:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 20:04:02 [DEBUG   ] spawn_process: at 2019-02-05 20:04:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 20:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 20:04:02 [DEBUG   ] spawn_process: at 2019-02-05 20:04:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 20:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 20:04:02 [DEBUG   ] spawn_process: at 2019-02-05 20:04:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 20:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 20:04:02 [DEBUG   ] spawn_process: at 2019-02-05 20:04:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 20:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 20:04:02 [DEBUG   ] spawn_process: at 2019-02-05 20:04:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 20:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 20:04:02 [DEBUG   ] spawn_process: at 2019-02-05 20:04:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 20:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 20:04:02 [DEBUG   ] spawn_process: at 2019-02-05 20:04:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 20:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 20:04:02 [DEBUG   ] spawn_process: at 2019-02-05 20:04:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 20:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 20:04:02 [DEBUG   ] spawn_process: at 2019-02-05 20:04:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 20:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 20:04:02 [DEBUG   ] spawn_process: at 2019-02-05 20:04:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 20:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 20:04:02 [DEBUG   ] spawn_process: at 2019-02-05 20:04:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 20:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 20:04:02 [DEBUG   ] spawn_process: at 2019-02-05 20:04:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 20:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 20:04:02 [DEBUG   ] spawn_process: at 2019-02-05 20:04:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 20:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 20:04:02 [DEBUG   ] spawn_process: at 2019-02-05 20:04:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 20:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 20:04:02 [DEBUG   ] spawn_process: at 2019-02-05 20:04:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 20:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 20:04:02 [DEBUG   ] spawn_process: at 2019-02-05 20:04:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 20:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 20:04:02 [DEBUG   ] spawn_process: at 2019-02-05 20:04:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 20:04:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 20:04:02 [DEBUG   ] spawn_process: at 2019-02-05 20:04:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 20:04:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-02-05 20:04:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:04:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-02-05 20:04:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-05 20:04:03 [WARNING ] (13, 1, 'bot')
2019-02-05 20:04:03 [WARNING ] (13, 1, 'bot')
2019-02-05 20:04:03 [WARNING ] (13, 1, 'bot')
2019-02-05 20:04:03 [WARNING ] (13, 1, 'bot')
2019-02-05 20:04:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:04:03 [DEBUG   ] Finished updating board flags in 1.262 seconds
2019-02-05 20:04:17 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 20:04:32 [DEBUG   ] Got command BAM from MCS: ref #1412760
2019-02-05 20:04:32 [INFO    ] Finished processing BAM request
2019-02-05 20:04:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:04:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412760   8 58519 72272025 A  ERROR'
2019-02-05 20:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 20:04:32 [DEBUG   ] spawn_process: at 2019-02-05 20:04:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 20:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 20:04:32 [DEBUG   ] spawn_process: at 2019-02-05 20:04:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 20:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 20:04:32 [DEBUG   ] spawn_process: at 2019-02-05 20:04:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 20:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 20:04:32 [DEBUG   ] spawn_process: at 2019-02-05 20:04:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 20:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 20:04:32 [DEBUG   ] spawn_process: at 2019-02-05 20:04:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 20:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 20:04:32 [DEBUG   ] spawn_process: at 2019-02-05 20:04:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 20:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 20:04:32 [DEBUG   ] spawn_process: at 2019-02-05 20:04:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 20:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 20:04:32 [DEBUG   ] spawn_process: at 2019-02-05 20:04:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 20:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 20:04:32 [DEBUG   ] spawn_process: at 2019-02-05 20:04:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 20:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 20:04:32 [DEBUG   ] spawn_process: at 2019-02-05 20:04:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 20:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 20:04:32 [DEBUG   ] spawn_process: at 2019-02-05 20:04:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 20:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 20:04:32 [DEBUG   ] spawn_process: at 2019-02-05 20:04:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 20:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 20:04:32 [DEBUG   ] spawn_process: at 2019-02-05 20:04:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 20:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 20:04:32 [DEBUG   ] spawn_process: at 2019-02-05 20:04:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 20:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 20:04:32 [DEBUG   ] spawn_process: at 2019-02-05 20:04:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 20:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 20:04:32 [DEBUG   ] spawn_process: at 2019-02-05 20:04:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 20:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 20:04:32 [DEBUG   ] spawn_process: at 2019-02-05 20:04:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 20:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 20:04:32 [DEBUG   ] spawn_process: at 2019-02-05 20:04:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 20:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 20:04:32 [DEBUG   ] spawn_process: at 2019-02-05 20:04:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 20:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 20:04:32 [DEBUG   ] spawn_process: at 2019-02-05 20:04:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 20:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 20:04:32 [DEBUG   ] spawn_process: at 2019-02-05 20:04:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 20:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 20:04:32 [DEBUG   ] spawn_process: at 2019-02-05 20:04:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 20:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 20:04:32 [DEBUG   ] spawn_process: at 2019-02-05 20:04:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 20:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 20:04:32 [DEBUG   ] spawn_process: at 2019-02-05 20:04:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 20:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 20:04:32 [DEBUG   ] spawn_process: at 2019-02-05 20:04:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 20:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 20:04:32 [DEBUG   ] spawn_process: at 2019-02-05 20:04:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 20:04:37 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 20:04:56 [DEBUG   ] Got command RPT from MCS: ref #1412761
2019-02-05 20:04:56 [DEBUG   ] summary = ERROR
2019-02-05 20:04:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412761  13 58519 72296385 A  ERRORERROR'
2019-02-05 20:04:56 [DEBUG   ] Got command RPT from MCS: ref #1412762
2019-02-05 20:04:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 20:04:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412762  77 58519 72296589 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 20:04:56 [DEBUG   ] Got command RPT from MCS: ref #1412763
2019-02-05 20:04:56 [DEBUG   ] summary = ERROR
2019-02-05 20:04:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412763  13 58519 72296793 A  ERRORERROR'
2019-02-05 20:04:56 [DEBUG   ] Got command RPT from MCS: ref #1412765
2019-02-05 20:04:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 20:04:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412765  77 58519 72296997 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 20:04:57 [DEBUG   ] Got command RPT from MCS: ref #1412766
2019-02-05 20:04:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 20:04:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412766  12 58519 72297189 A  ERRORB£ff'
2019-02-05 20:04:57 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 20:05:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 2
2019-02-05 20:05:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:05:03 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-02-05 20:05:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-02-05 20:05:03 [WARNING ] (13, 1, 'bot')
2019-02-05 20:05:03 [WARNING ] (13, 1, 'bot')
2019-02-05 20:05:03 [WARNING ] (13, 1, 'bot')
2019-02-05 20:05:03 [WARNING ] (13, 1, 'bot')
2019-02-05 20:05:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:05:03 [DEBUG   ] Finished updating board flags in 1.219 seconds
2019-02-05 20:05:06 [DEBUG   ] Got command BAM from MCS: ref #1412771
2019-02-05 20:05:06 [INFO    ] Finished processing BAM request
2019-02-05 20:05:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:05:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412771   8 58519 72306033 A  ERROR'
2019-02-05 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 20:05:06 [DEBUG   ] spawn_process: at 2019-02-05 20:05:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 20:05:06 [DEBUG   ] spawn_process: at 2019-02-05 20:05:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 20:05:06 [DEBUG   ] spawn_process: at 2019-02-05 20:05:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 20:05:06 [DEBUG   ] spawn_process: at 2019-02-05 20:05:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 20:05:06 [DEBUG   ] spawn_process: at 2019-02-05 20:05:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 20:05:06 [DEBUG   ] spawn_process: at 2019-02-05 20:05:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 20:05:06 [DEBUG   ] spawn_process: at 2019-02-05 20:05:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 20:05:06 [DEBUG   ] spawn_process: at 2019-02-05 20:05:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 20:05:06 [DEBUG   ] spawn_process: at 2019-02-05 20:05:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 20:05:06 [DEBUG   ] spawn_process: at 2019-02-05 20:05:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 20:05:06 [DEBUG   ] spawn_process: at 2019-02-05 20:05:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 20:05:06 [DEBUG   ] spawn_process: at 2019-02-05 20:05:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 20:05:06 [DEBUG   ] spawn_process: at 2019-02-05 20:05:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 20:05:06 [DEBUG   ] spawn_process: at 2019-02-05 20:05:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 20:05:06 [DEBUG   ] spawn_process: at 2019-02-05 20:05:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 20:05:06 [DEBUG   ] spawn_process: at 2019-02-05 20:05:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 20:05:06 [DEBUG   ] spawn_process: at 2019-02-05 20:05:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 20:05:06 [DEBUG   ] spawn_process: at 2019-02-05 20:05:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 20:05:06 [DEBUG   ] spawn_process: at 2019-02-05 20:05:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 20:05:06 [DEBUG   ] spawn_process: at 2019-02-05 20:05:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 20:05:06 [DEBUG   ] spawn_process: at 2019-02-05 20:05:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 20:05:06 [DEBUG   ] spawn_process: at 2019-02-05 20:05:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 20:05:06 [DEBUG   ] spawn_process: at 2019-02-05 20:05:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 20:05:06 [DEBUG   ] spawn_process: at 2019-02-05 20:05:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 20:05:06 [DEBUG   ] spawn_process: at 2019-02-05 20:05:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 20:05:06 [DEBUG   ] spawn_process: at 2019-02-05 20:05:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 20:05:17 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 20:05:30 [DEBUG   ] Got command BAM from MCS: ref #1412776
2019-02-05 20:05:30 [INFO    ] Finished processing BAM request
2019-02-05 20:05:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:05:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412776   8 58519 72330029 A  ERROR'
2019-02-05 20:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 20:05:30 [DEBUG   ] spawn_process: at 2019-02-05 20:05:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 20:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 20:05:30 [DEBUG   ] spawn_process: at 2019-02-05 20:05:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 20:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 20:05:30 [DEBUG   ] spawn_process: at 2019-02-05 20:05:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 20:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 20:05:30 [DEBUG   ] spawn_process: at 2019-02-05 20:05:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 20:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 20:05:30 [DEBUG   ] spawn_process: at 2019-02-05 20:05:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 20:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 20:05:30 [DEBUG   ] spawn_process: at 2019-02-05 20:05:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 20:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 20:05:30 [DEBUG   ] spawn_process: at 2019-02-05 20:05:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 20:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 20:05:30 [DEBUG   ] spawn_process: at 2019-02-05 20:05:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 20:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 20:05:30 [DEBUG   ] spawn_process: at 2019-02-05 20:05:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 20:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 20:05:30 [DEBUG   ] spawn_process: at 2019-02-05 20:05:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 20:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 20:05:30 [DEBUG   ] spawn_process: at 2019-02-05 20:05:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 20:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 20:05:30 [DEBUG   ] spawn_process: at 2019-02-05 20:05:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 20:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 20:05:30 [DEBUG   ] spawn_process: at 2019-02-05 20:05:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 20:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 20:05:30 [DEBUG   ] spawn_process: at 2019-02-05 20:05:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 20:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 20:05:30 [DEBUG   ] spawn_process: at 2019-02-05 20:05:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 20:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 20:05:30 [DEBUG   ] spawn_process: at 2019-02-05 20:05:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 20:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 20:05:30 [DEBUG   ] spawn_process: at 2019-02-05 20:05:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 20:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 20:05:30 [DEBUG   ] spawn_process: at 2019-02-05 20:05:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 20:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 20:05:30 [DEBUG   ] spawn_process: at 2019-02-05 20:05:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 20:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 20:05:30 [DEBUG   ] spawn_process: at 2019-02-05 20:05:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 20:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 20:05:30 [DEBUG   ] spawn_process: at 2019-02-05 20:05:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 20:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 20:05:30 [DEBUG   ] spawn_process: at 2019-02-05 20:05:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 20:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 20:05:30 [DEBUG   ] spawn_process: at 2019-02-05 20:05:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 20:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 20:05:30 [DEBUG   ] spawn_process: at 2019-02-05 20:05:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 20:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 20:05:30 [DEBUG   ] spawn_process: at 2019-02-05 20:05:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 20:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 20:05:30 [DEBUG   ] spawn_process: at 2019-02-05 20:05:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 20:05:37 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 20:05:57 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 20:06:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 2
2019-02-05 20:06:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2019-02-05 20:06:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:06:04 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-02-05 20:06:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-02-05 20:06:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-02-05 20:06:04 [WARNING ] (13, 1, 'bot')
2019-02-05 20:06:04 [WARNING ] (13, 1, 'bot')
2019-02-05 20:06:04 [WARNING ] (13, 1, 'bot')
2019-02-05 20:06:04 [WARNING ] (13, 1, 'bot')
2019-02-05 20:06:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:06:04 [DEBUG   ] Finished updating board flags in 1.793 seconds
2019-02-05 20:06:10 [DEBUG   ] Got command BAM from MCS: ref #1412777
2019-02-05 20:06:10 [INFO    ] Finished processing BAM request
2019-02-05 20:06:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:06:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412777   8 58519 72370029 A  ERROR'
2019-02-05 20:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 20:06:10 [DEBUG   ] spawn_process: at 2019-02-05 20:06:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 20:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 20:06:10 [DEBUG   ] spawn_process: at 2019-02-05 20:06:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 20:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 20:06:10 [DEBUG   ] spawn_process: at 2019-02-05 20:06:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 20:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 20:06:10 [DEBUG   ] spawn_process: at 2019-02-05 20:06:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 20:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 20:06:10 [DEBUG   ] spawn_process: at 2019-02-05 20:06:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 20:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 20:06:10 [DEBUG   ] spawn_process: at 2019-02-05 20:06:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 20:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 20:06:10 [DEBUG   ] spawn_process: at 2019-02-05 20:06:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 20:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 20:06:10 [DEBUG   ] spawn_process: at 2019-02-05 20:06:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 20:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 20:06:10 [DEBUG   ] spawn_process: at 2019-02-05 20:06:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 20:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 20:06:10 [DEBUG   ] spawn_process: at 2019-02-05 20:06:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 20:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 20:06:10 [DEBUG   ] spawn_process: at 2019-02-05 20:06:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 20:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 20:06:10 [DEBUG   ] spawn_process: at 2019-02-05 20:06:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 20:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 20:06:10 [DEBUG   ] spawn_process: at 2019-02-05 20:06:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 20:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 20:06:10 [DEBUG   ] spawn_process: at 2019-02-05 20:06:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 20:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 20:06:10 [DEBUG   ] spawn_process: at 2019-02-05 20:06:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 20:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 20:06:10 [DEBUG   ] spawn_process: at 2019-02-05 20:06:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 20:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 20:06:10 [DEBUG   ] spawn_process: at 2019-02-05 20:06:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 20:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 20:06:10 [DEBUG   ] spawn_process: at 2019-02-05 20:06:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 20:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 20:06:10 [DEBUG   ] spawn_process: at 2019-02-05 20:06:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 20:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 20:06:10 [DEBUG   ] spawn_process: at 2019-02-05 20:06:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 20:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 20:06:10 [DEBUG   ] spawn_process: at 2019-02-05 20:06:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 20:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 20:06:10 [DEBUG   ] spawn_process: at 2019-02-05 20:06:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 20:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 20:06:10 [DEBUG   ] spawn_process: at 2019-02-05 20:06:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 20:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 20:06:10 [DEBUG   ] spawn_process: at 2019-02-05 20:06:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 20:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 20:06:10 [DEBUG   ] spawn_process: at 2019-02-05 20:06:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 20:06:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 20:06:10 [DEBUG   ] spawn_process: at 2019-02-05 20:06:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 20:06:12 [DEBUG   ] Got command RPT from MCS: ref #1412778
2019-02-05 20:06:12 [DEBUG   ] summary = ERROR
2019-02-05 20:06:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412778  13 58519 72372021 A  ERRORERROR'
2019-02-05 20:06:12 [DEBUG   ] Got command RPT from MCS: ref #1412779
2019-02-05 20:06:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 20:06:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412779  77 58519 72372022 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 20:06:17 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 20:06:28 [DEBUG   ] Got command BAM from MCS: ref #1412795
2019-02-05 20:06:28 [INFO    ] Finished processing BAM request
2019-02-05 20:06:28 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:06:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412795   8 58519 72388029 A  ERROR'
2019-02-05 20:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-02-05 20:06:28 [DEBUG   ] spawn_process: at 2019-02-05 20:06:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-02-05 20:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-02-05 20:06:28 [DEBUG   ] spawn_process: at 2019-02-05 20:06:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-02-05 20:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-02-05 20:06:28 [DEBUG   ] spawn_process: at 2019-02-05 20:06:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-02-05 20:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-02-05 20:06:28 [DEBUG   ] spawn_process: at 2019-02-05 20:06:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-02-05 20:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-02-05 20:06:28 [DEBUG   ] spawn_process: at 2019-02-05 20:06:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-02-05 20:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-02-05 20:06:28 [DEBUG   ] spawn_process: at 2019-02-05 20:06:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-02-05 20:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-02-05 20:06:28 [DEBUG   ] spawn_process: at 2019-02-05 20:06:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-02-05 20:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-02-05 20:06:28 [DEBUG   ] spawn_process: at 2019-02-05 20:06:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-02-05 20:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-02-05 20:06:28 [DEBUG   ] spawn_process: at 2019-02-05 20:06:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-02-05 20:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-02-05 20:06:28 [DEBUG   ] spawn_process: at 2019-02-05 20:06:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-02-05 20:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-02-05 20:06:28 [DEBUG   ] spawn_process: at 2019-02-05 20:06:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-02-05 20:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-02-05 20:06:28 [DEBUG   ] spawn_process: at 2019-02-05 20:06:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-02-05 20:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-02-05 20:06:28 [DEBUG   ] spawn_process: at 2019-02-05 20:06:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-02-05 20:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-02-05 20:06:28 [DEBUG   ] spawn_process: at 2019-02-05 20:06:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-02-05 20:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-02-05 20:06:28 [DEBUG   ] spawn_process: at 2019-02-05 20:06:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-02-05 20:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-02-05 20:06:28 [DEBUG   ] spawn_process: at 2019-02-05 20:06:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-02-05 20:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-02-05 20:06:28 [DEBUG   ] spawn_process: at 2019-02-05 20:06:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-02-05 20:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-02-05 20:06:28 [DEBUG   ] spawn_process: at 2019-02-05 20:06:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-02-05 20:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-02-05 20:06:28 [DEBUG   ] spawn_process: at 2019-02-05 20:06:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-02-05 20:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-02-05 20:06:28 [DEBUG   ] spawn_process: at 2019-02-05 20:06:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-02-05 20:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-02-05 20:06:28 [DEBUG   ] spawn_process: at 2019-02-05 20:06:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-02-05 20:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-02-05 20:06:28 [DEBUG   ] spawn_process: at 2019-02-05 20:06:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-02-05 20:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-02-05 20:06:28 [DEBUG   ] spawn_process: at 2019-02-05 20:06:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-02-05 20:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-02-05 20:06:28 [DEBUG   ] spawn_process: at 2019-02-05 20:06:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-02-05 20:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-02-05 20:06:28 [DEBUG   ] spawn_process: at 2019-02-05 20:06:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-02-05 20:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-02-05 20:06:28 [DEBUG   ] spawn_process: at 2019-02-05 20:06:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-02-05 20:06:37 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 20:06:57 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 20:07:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2019-02-05 20:07:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:07:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-02-05 20:07:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2019-02-05 20:07:03 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-02-05 20:07:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-05 20:07:03 [WARNING ] (13, 1, 'bot')
2019-02-05 20:07:03 [WARNING ] (13, 1, 'bot')
2019-02-05 20:07:03 [WARNING ] (13, 1, 'bot')
2019-02-05 20:07:03 [WARNING ] (13, 1, 'bot')
2019-02-05 20:07:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:07:03 [DEBUG   ] Finished updating board flags in 0.992 seconds
2019-02-05 20:07:14 [DEBUG   ] Got command BAM from MCS: ref #1412796
2019-02-05 20:07:14 [INFO    ] Finished processing BAM request
2019-02-05 20:07:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:07:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412796   8 58519 72434025 A  ERROR'
2019-02-05 20:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-02-05 20:07:14 [DEBUG   ] spawn_process: at 2019-02-05 20:07:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-02-05 20:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-02-05 20:07:14 [DEBUG   ] spawn_process: at 2019-02-05 20:07:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-02-05 20:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-02-05 20:07:14 [DEBUG   ] spawn_process: at 2019-02-05 20:07:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-02-05 20:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-02-05 20:07:14 [DEBUG   ] spawn_process: at 2019-02-05 20:07:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-02-05 20:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-02-05 20:07:14 [DEBUG   ] spawn_process: at 2019-02-05 20:07:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-02-05 20:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-02-05 20:07:14 [DEBUG   ] spawn_process: at 2019-02-05 20:07:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-02-05 20:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-02-05 20:07:14 [DEBUG   ] spawn_process: at 2019-02-05 20:07:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-02-05 20:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-02-05 20:07:14 [DEBUG   ] spawn_process: at 2019-02-05 20:07:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-02-05 20:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-02-05 20:07:14 [DEBUG   ] spawn_process: at 2019-02-05 20:07:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-02-05 20:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-02-05 20:07:14 [DEBUG   ] spawn_process: at 2019-02-05 20:07:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-02-05 20:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-02-05 20:07:14 [DEBUG   ] spawn_process: at 2019-02-05 20:07:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-02-05 20:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-02-05 20:07:14 [DEBUG   ] spawn_process: at 2019-02-05 20:07:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-02-05 20:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-02-05 20:07:14 [DEBUG   ] spawn_process: at 2019-02-05 20:07:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-02-05 20:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-02-05 20:07:14 [DEBUG   ] spawn_process: at 2019-02-05 20:07:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-02-05 20:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-02-05 20:07:14 [DEBUG   ] spawn_process: at 2019-02-05 20:07:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-02-05 20:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-02-05 20:07:14 [DEBUG   ] spawn_process: at 2019-02-05 20:07:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-02-05 20:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-02-05 20:07:14 [DEBUG   ] spawn_process: at 2019-02-05 20:07:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-02-05 20:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-02-05 20:07:14 [DEBUG   ] spawn_process: at 2019-02-05 20:07:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-02-05 20:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-02-05 20:07:14 [DEBUG   ] spawn_process: at 2019-02-05 20:07:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-02-05 20:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-02-05 20:07:14 [DEBUG   ] spawn_process: at 2019-02-05 20:07:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-02-05 20:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-02-05 20:07:14 [DEBUG   ] spawn_process: at 2019-02-05 20:07:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-02-05 20:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-02-05 20:07:14 [DEBUG   ] spawn_process: at 2019-02-05 20:07:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-02-05 20:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-02-05 20:07:14 [DEBUG   ] spawn_process: at 2019-02-05 20:07:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-02-05 20:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-02-05 20:07:14 [DEBUG   ] spawn_process: at 2019-02-05 20:07:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-02-05 20:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-02-05 20:07:14 [DEBUG   ] spawn_process: at 2019-02-05 20:07:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-02-05 20:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-02-05 20:07:14 [DEBUG   ] spawn_process: at 2019-02-05 20:07:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-02-05 20:07:17 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-02-05 20:07:26 [DEBUG   ] Got command BAM from MCS: ref #1412797
2019-02-05 20:07:26 [INFO    ] Finished processing BAM request
2019-02-05 20:07:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:07:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412797   8 58519 72446029 A  ERROR'
2019-02-05 20:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 20:07:26 [DEBUG   ] spawn_process: at 2019-02-05 20:07:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 20:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 20:07:26 [DEBUG   ] spawn_process: at 2019-02-05 20:07:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 20:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 20:07:26 [DEBUG   ] spawn_process: at 2019-02-05 20:07:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 20:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 20:07:26 [DEBUG   ] spawn_process: at 2019-02-05 20:07:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 20:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 20:07:26 [DEBUG   ] spawn_process: at 2019-02-05 20:07:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 20:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 20:07:26 [DEBUG   ] spawn_process: at 2019-02-05 20:07:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 20:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 20:07:26 [DEBUG   ] spawn_process: at 2019-02-05 20:07:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 20:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 20:07:26 [DEBUG   ] spawn_process: at 2019-02-05 20:07:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 20:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 20:07:26 [DEBUG   ] spawn_process: at 2019-02-05 20:07:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 20:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 20:07:26 [DEBUG   ] spawn_process: at 2019-02-05 20:07:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 20:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 20:07:26 [DEBUG   ] spawn_process: at 2019-02-05 20:07:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 20:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 20:07:26 [DEBUG   ] spawn_process: at 2019-02-05 20:07:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 20:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 20:07:26 [DEBUG   ] spawn_process: at 2019-02-05 20:07:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 20:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 20:07:26 [DEBUG   ] spawn_process: at 2019-02-05 20:07:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 20:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 20:07:26 [DEBUG   ] spawn_process: at 2019-02-05 20:07:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 20:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 20:07:26 [DEBUG   ] spawn_process: at 2019-02-05 20:07:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 20:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 20:07:26 [DEBUG   ] spawn_process: at 2019-02-05 20:07:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 20:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 20:07:26 [DEBUG   ] spawn_process: at 2019-02-05 20:07:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 20:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 20:07:26 [DEBUG   ] spawn_process: at 2019-02-05 20:07:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 20:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 20:07:26 [DEBUG   ] spawn_process: at 2019-02-05 20:07:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 20:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 20:07:26 [DEBUG   ] spawn_process: at 2019-02-05 20:07:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 20:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 20:07:26 [DEBUG   ] spawn_process: at 2019-02-05 20:07:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 20:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 20:07:26 [DEBUG   ] spawn_process: at 2019-02-05 20:07:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 20:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 20:07:26 [DEBUG   ] spawn_process: at 2019-02-05 20:07:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 20:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 20:07:26 [DEBUG   ] spawn_process: at 2019-02-05 20:07:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 20:07:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 20:07:26 [DEBUG   ] spawn_process: at 2019-02-05 20:07:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 20:07:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 20:07:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 20:08:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:08:04 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2019-02-05 20:08:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-02-05 20:08:04 [WARNING ] (13, 1, 'bot')
2019-02-05 20:08:04 [WARNING ] (13, 1, 'bot')
2019-02-05 20:08:04 [WARNING ] (13, 1, 'bot')
2019-02-05 20:08:04 [WARNING ] (13, 1, 'bot')
2019-02-05 20:08:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:08:04 [DEBUG   ] Finished updating board flags in 1.366 seconds
2019-02-05 20:08:18 [DEBUG   ] Got command BAM from MCS: ref #1412802
2019-02-05 20:08:18 [INFO    ] Finished processing BAM request
2019-02-05 20:08:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:08:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412802   8 58519 72498029 A  ERROR'
2019-02-05 20:08:18 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-05 20:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-02-05 20:08:18 [DEBUG   ] spawn_process: at 2019-02-05 20:08:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-02-05 20:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-02-05 20:08:18 [DEBUG   ] spawn_process: at 2019-02-05 20:08:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-02-05 20:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-02-05 20:08:18 [DEBUG   ] spawn_process: at 2019-02-05 20:08:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-02-05 20:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-02-05 20:08:18 [DEBUG   ] spawn_process: at 2019-02-05 20:08:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-02-05 20:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-02-05 20:08:18 [DEBUG   ] spawn_process: at 2019-02-05 20:08:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-02-05 20:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-02-05 20:08:18 [DEBUG   ] spawn_process: at 2019-02-05 20:08:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-02-05 20:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-02-05 20:08:18 [DEBUG   ] spawn_process: at 2019-02-05 20:08:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-02-05 20:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-02-05 20:08:18 [DEBUG   ] spawn_process: at 2019-02-05 20:08:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-02-05 20:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-02-05 20:08:18 [DEBUG   ] spawn_process: at 2019-02-05 20:08:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-02-05 20:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-02-05 20:08:18 [DEBUG   ] spawn_process: at 2019-02-05 20:08:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-02-05 20:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-02-05 20:08:18 [DEBUG   ] spawn_process: at 2019-02-05 20:08:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-02-05 20:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-02-05 20:08:18 [DEBUG   ] spawn_process: at 2019-02-05 20:08:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-02-05 20:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-02-05 20:08:18 [DEBUG   ] spawn_process: at 2019-02-05 20:08:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-02-05 20:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-02-05 20:08:18 [DEBUG   ] spawn_process: at 2019-02-05 20:08:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-02-05 20:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-02-05 20:08:18 [DEBUG   ] spawn_process: at 2019-02-05 20:08:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-02-05 20:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-02-05 20:08:18 [DEBUG   ] spawn_process: at 2019-02-05 20:08:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-02-05 20:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-02-05 20:08:18 [DEBUG   ] spawn_process: at 2019-02-05 20:08:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-02-05 20:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-02-05 20:08:18 [DEBUG   ] spawn_process: at 2019-02-05 20:08:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-02-05 20:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-02-05 20:08:18 [DEBUG   ] spawn_process: at 2019-02-05 20:08:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-02-05 20:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-02-05 20:08:18 [DEBUG   ] spawn_process: at 2019-02-05 20:08:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-02-05 20:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-02-05 20:08:18 [DEBUG   ] spawn_process: at 2019-02-05 20:08:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-02-05 20:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-02-05 20:08:18 [DEBUG   ] spawn_process: at 2019-02-05 20:08:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-02-05 20:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-02-05 20:08:18 [DEBUG   ] spawn_process: at 2019-02-05 20:08:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-02-05 20:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-02-05 20:08:18 [DEBUG   ] spawn_process: at 2019-02-05 20:08:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-02-05 20:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-02-05 20:08:18 [DEBUG   ] spawn_process: at 2019-02-05 20:08:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-02-05 20:08:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-02-05 20:08:18 [DEBUG   ] spawn_process: at 2019-02-05 20:08:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-02-05 20:08:23 [DEBUG   ] Got command BAM from MCS: ref #1412803
2019-02-05 20:08:23 [INFO    ] Finished processing BAM request
2019-02-05 20:08:23 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:08:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412803   8 58519 72503029 A  ERROR'
2019-02-05 20:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-02-05 20:08:23 [DEBUG   ] spawn_process: at 2019-02-05 20:08:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-02-05 20:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-02-05 20:08:23 [DEBUG   ] spawn_process: at 2019-02-05 20:08:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-02-05 20:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-02-05 20:08:23 [DEBUG   ] spawn_process: at 2019-02-05 20:08:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-02-05 20:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-02-05 20:08:23 [DEBUG   ] spawn_process: at 2019-02-05 20:08:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-02-05 20:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-02-05 20:08:23 [DEBUG   ] spawn_process: at 2019-02-05 20:08:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-02-05 20:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-02-05 20:08:23 [DEBUG   ] spawn_process: at 2019-02-05 20:08:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-02-05 20:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-02-05 20:08:23 [DEBUG   ] spawn_process: at 2019-02-05 20:08:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-02-05 20:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-02-05 20:08:23 [DEBUG   ] spawn_process: at 2019-02-05 20:08:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-02-05 20:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-02-05 20:08:23 [DEBUG   ] spawn_process: at 2019-02-05 20:08:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-02-05 20:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-02-05 20:08:23 [DEBUG   ] spawn_process: at 2019-02-05 20:08:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-02-05 20:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-02-05 20:08:23 [DEBUG   ] spawn_process: at 2019-02-05 20:08:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-02-05 20:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-02-05 20:08:23 [DEBUG   ] spawn_process: at 2019-02-05 20:08:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-02-05 20:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-02-05 20:08:23 [DEBUG   ] spawn_process: at 2019-02-05 20:08:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-02-05 20:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-02-05 20:08:23 [DEBUG   ] spawn_process: at 2019-02-05 20:08:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-02-05 20:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-02-05 20:08:23 [DEBUG   ] spawn_process: at 2019-02-05 20:08:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-02-05 20:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-02-05 20:08:23 [DEBUG   ] spawn_process: at 2019-02-05 20:08:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-02-05 20:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-02-05 20:08:23 [DEBUG   ] spawn_process: at 2019-02-05 20:08:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-02-05 20:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-02-05 20:08:23 [DEBUG   ] spawn_process: at 2019-02-05 20:08:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-02-05 20:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-02-05 20:08:23 [DEBUG   ] spawn_process: at 2019-02-05 20:08:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-02-05 20:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-02-05 20:08:23 [DEBUG   ] spawn_process: at 2019-02-05 20:08:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-02-05 20:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-02-05 20:08:23 [DEBUG   ] spawn_process: at 2019-02-05 20:08:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-02-05 20:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-02-05 20:08:23 [DEBUG   ] spawn_process: at 2019-02-05 20:08:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-02-05 20:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-02-05 20:08:23 [DEBUG   ] spawn_process: at 2019-02-05 20:08:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-02-05 20:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-02-05 20:08:23 [DEBUG   ] spawn_process: at 2019-02-05 20:08:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-02-05 20:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-02-05 20:08:23 [DEBUG   ] spawn_process: at 2019-02-05 20:08:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-02-05 20:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-02-05 20:08:23 [DEBUG   ] spawn_process: at 2019-02-05 20:08:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-02-05 20:08:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 20:08:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 20:09:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-02-05 20:09:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-02-05 20:09:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:09:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2019-02-05 20:09:04 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2019-02-05 20:09:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-02-05 20:09:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-05 20:09:04 [WARNING ] (13, 1, 'bot')
2019-02-05 20:09:04 [WARNING ] (13, 1, 'bot')
2019-02-05 20:09:04 [WARNING ] (13, 1, 'bot')
2019-02-05 20:09:04 [WARNING ] (13, 1, 'bot')
2019-02-05 20:09:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:09:04 [DEBUG   ] Finished updating board flags in 1.184 seconds
2019-02-05 20:09:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 20:09:20 [DEBUG   ] Got command BAM from MCS: ref #1412804
2019-02-05 20:09:20 [INFO    ] Finished processing BAM request
2019-02-05 20:09:20 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412804   8 58519 72560029 A  ERROR'
2019-02-05 20:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 20:09:20 [DEBUG   ] spawn_process: at 2019-02-05 20:09:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 20:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 20:09:20 [DEBUG   ] spawn_process: at 2019-02-05 20:09:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 20:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 20:09:20 [DEBUG   ] spawn_process: at 2019-02-05 20:09:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 20:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 20:09:20 [DEBUG   ] spawn_process: at 2019-02-05 20:09:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 20:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 20:09:20 [DEBUG   ] spawn_process: at 2019-02-05 20:09:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 20:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 20:09:20 [DEBUG   ] spawn_process: at 2019-02-05 20:09:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 20:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 20:09:20 [DEBUG   ] spawn_process: at 2019-02-05 20:09:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 20:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 20:09:20 [DEBUG   ] spawn_process: at 2019-02-05 20:09:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 20:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 20:09:20 [DEBUG   ] spawn_process: at 2019-02-05 20:09:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 20:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 20:09:20 [DEBUG   ] spawn_process: at 2019-02-05 20:09:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 20:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 20:09:20 [DEBUG   ] spawn_process: at 2019-02-05 20:09:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 20:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 20:09:20 [DEBUG   ] spawn_process: at 2019-02-05 20:09:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 20:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 20:09:20 [DEBUG   ] spawn_process: at 2019-02-05 20:09:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 20:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 20:09:20 [DEBUG   ] spawn_process: at 2019-02-05 20:09:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 20:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 20:09:20 [DEBUG   ] spawn_process: at 2019-02-05 20:09:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 20:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 20:09:20 [DEBUG   ] spawn_process: at 2019-02-05 20:09:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 20:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 20:09:20 [DEBUG   ] spawn_process: at 2019-02-05 20:09:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 20:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 20:09:20 [DEBUG   ] spawn_process: at 2019-02-05 20:09:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 20:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 20:09:20 [DEBUG   ] spawn_process: at 2019-02-05 20:09:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 20:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 20:09:20 [DEBUG   ] spawn_process: at 2019-02-05 20:09:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 20:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 20:09:20 [DEBUG   ] spawn_process: at 2019-02-05 20:09:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 20:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 20:09:20 [DEBUG   ] spawn_process: at 2019-02-05 20:09:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 20:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 20:09:20 [DEBUG   ] spawn_process: at 2019-02-05 20:09:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 20:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 20:09:20 [DEBUG   ] spawn_process: at 2019-02-05 20:09:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 20:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 20:09:20 [DEBUG   ] spawn_process: at 2019-02-05 20:09:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 20:09:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 20:09:20 [DEBUG   ] spawn_process: at 2019-02-05 20:09:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 20:09:22 [DEBUG   ] Got command BAM from MCS: ref #1412805
2019-02-05 20:09:22 [INFO    ] Finished processing BAM request
2019-02-05 20:09:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:09:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412805   8 58519 72562025 A  ERROR'
2019-02-05 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-02-05 20:09:22 [DEBUG   ] spawn_process: at 2019-02-05 20:09:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-02-05 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-02-05 20:09:22 [DEBUG   ] spawn_process: at 2019-02-05 20:09:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-02-05 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-02-05 20:09:22 [DEBUG   ] spawn_process: at 2019-02-05 20:09:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-02-05 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-02-05 20:09:22 [DEBUG   ] spawn_process: at 2019-02-05 20:09:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-02-05 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-02-05 20:09:22 [DEBUG   ] spawn_process: at 2019-02-05 20:09:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-02-05 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-02-05 20:09:22 [DEBUG   ] spawn_process: at 2019-02-05 20:09:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-02-05 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-02-05 20:09:22 [DEBUG   ] spawn_process: at 2019-02-05 20:09:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-02-05 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-02-05 20:09:22 [DEBUG   ] spawn_process: at 2019-02-05 20:09:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-02-05 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-02-05 20:09:22 [DEBUG   ] spawn_process: at 2019-02-05 20:09:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-02-05 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-02-05 20:09:22 [DEBUG   ] spawn_process: at 2019-02-05 20:09:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-02-05 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-02-05 20:09:22 [DEBUG   ] spawn_process: at 2019-02-05 20:09:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-02-05 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-02-05 20:09:22 [DEBUG   ] spawn_process: at 2019-02-05 20:09:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-02-05 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-02-05 20:09:22 [DEBUG   ] spawn_process: at 2019-02-05 20:09:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-02-05 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-02-05 20:09:22 [DEBUG   ] spawn_process: at 2019-02-05 20:09:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-02-05 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-02-05 20:09:22 [DEBUG   ] spawn_process: at 2019-02-05 20:09:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-02-05 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-02-05 20:09:22 [DEBUG   ] spawn_process: at 2019-02-05 20:09:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-02-05 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-02-05 20:09:22 [DEBUG   ] spawn_process: at 2019-02-05 20:09:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-02-05 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-02-05 20:09:22 [DEBUG   ] spawn_process: at 2019-02-05 20:09:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-02-05 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-02-05 20:09:22 [DEBUG   ] spawn_process: at 2019-02-05 20:09:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-02-05 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-02-05 20:09:22 [DEBUG   ] spawn_process: at 2019-02-05 20:09:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-02-05 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-02-05 20:09:22 [DEBUG   ] spawn_process: at 2019-02-05 20:09:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-02-05 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-02-05 20:09:22 [DEBUG   ] spawn_process: at 2019-02-05 20:09:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-02-05 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-02-05 20:09:22 [DEBUG   ] spawn_process: at 2019-02-05 20:09:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-02-05 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-02-05 20:09:22 [DEBUG   ] spawn_process: at 2019-02-05 20:09:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-02-05 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-02-05 20:09:22 [DEBUG   ] spawn_process: at 2019-02-05 20:09:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-02-05 20:09:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-02-05 20:09:22 [DEBUG   ] spawn_process: at 2019-02-05 20:09:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-02-05 20:09:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 20:09:56 [DEBUG   ] Got command RPT from MCS: ref #1412806
2019-02-05 20:09:56 [DEBUG   ] summary = ERROR
2019-02-05 20:09:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412806  13 58519 72596477 A  ERRORERROR'
2019-02-05 20:09:56 [DEBUG   ] Got command RPT from MCS: ref #1412807
2019-02-05 20:09:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 20:09:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412807  77 58519 72596669 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 20:09:56 [DEBUG   ] Got command RPT from MCS: ref #1412808
2019-02-05 20:09:56 [DEBUG   ] summary = ERROR
2019-02-05 20:09:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412808  13 58519 72596873 A  ERRORERROR'
2019-02-05 20:09:57 [DEBUG   ] Got command RPT from MCS: ref #1412809
2019-02-05 20:09:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 20:09:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412809  77 58519 72597077 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 20:09:57 [DEBUG   ] Got command RPT from MCS: ref #1412810
2019-02-05 20:09:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 20:09:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412810  12 58519 72597282 A  ERRORB¥ff'
2019-02-05 20:09:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 20:10:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-02-05 20:10:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-02-05 20:10:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:10:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2019-02-05 20:10:04 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2019-02-05 20:10:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-02-05 20:10:04 [WARNING ] (13, 1, 'bot')
2019-02-05 20:10:04 [WARNING ] (13, 1, 'bot')
2019-02-05 20:10:04 [WARNING ] (13, 1, 'bot')
2019-02-05 20:10:04 [WARNING ] (13, 1, 'bot')
2019-02-05 20:10:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:10:04 [DEBUG   ] Finished updating board flags in 1.008 seconds
2019-02-05 20:10:16 [DEBUG   ] Got command BAM from MCS: ref #1412811
2019-02-05 20:10:16 [INFO    ] Finished processing BAM request
2019-02-05 20:10:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:10:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412811   8 58519 72616025 A  ERROR'
2019-02-05 20:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 20:10:16 [DEBUG   ] spawn_process: at 2019-02-05 20:10:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 20:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 20:10:16 [DEBUG   ] spawn_process: at 2019-02-05 20:10:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 20:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 20:10:16 [DEBUG   ] spawn_process: at 2019-02-05 20:10:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 20:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 20:10:16 [DEBUG   ] spawn_process: at 2019-02-05 20:10:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 20:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 20:10:16 [DEBUG   ] spawn_process: at 2019-02-05 20:10:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 20:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 20:10:16 [DEBUG   ] spawn_process: at 2019-02-05 20:10:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 20:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 20:10:16 [DEBUG   ] spawn_process: at 2019-02-05 20:10:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 20:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 20:10:16 [DEBUG   ] spawn_process: at 2019-02-05 20:10:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 20:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 20:10:16 [DEBUG   ] spawn_process: at 2019-02-05 20:10:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 20:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 20:10:16 [DEBUG   ] spawn_process: at 2019-02-05 20:10:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 20:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 20:10:16 [DEBUG   ] spawn_process: at 2019-02-05 20:10:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 20:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 20:10:16 [DEBUG   ] spawn_process: at 2019-02-05 20:10:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 20:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 20:10:16 [DEBUG   ] spawn_process: at 2019-02-05 20:10:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 20:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 20:10:16 [DEBUG   ] spawn_process: at 2019-02-05 20:10:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 20:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 20:10:16 [DEBUG   ] spawn_process: at 2019-02-05 20:10:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 20:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 20:10:16 [DEBUG   ] spawn_process: at 2019-02-05 20:10:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 20:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 20:10:16 [DEBUG   ] spawn_process: at 2019-02-05 20:10:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 20:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 20:10:16 [DEBUG   ] spawn_process: at 2019-02-05 20:10:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 20:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 20:10:16 [DEBUG   ] spawn_process: at 2019-02-05 20:10:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 20:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 20:10:16 [DEBUG   ] spawn_process: at 2019-02-05 20:10:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 20:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 20:10:16 [DEBUG   ] spawn_process: at 2019-02-05 20:10:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 20:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 20:10:16 [DEBUG   ] spawn_process: at 2019-02-05 20:10:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 20:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 20:10:16 [DEBUG   ] spawn_process: at 2019-02-05 20:10:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 20:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 20:10:16 [DEBUG   ] spawn_process: at 2019-02-05 20:10:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 20:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 20:10:16 [DEBUG   ] spawn_process: at 2019-02-05 20:10:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 20:10:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 20:10:16 [DEBUG   ] spawn_process: at 2019-02-05 20:10:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 20:10:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 20:10:26 [DEBUG   ] Got command BAM from MCS: ref #1412812
2019-02-05 20:10:26 [INFO    ] Finished processing BAM request
2019-02-05 20:10:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:10:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412812   8 58519 72626029 A  ERROR'
2019-02-05 20:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 20:10:26 [DEBUG   ] spawn_process: at 2019-02-05 20:10:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 20:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 20:10:26 [DEBUG   ] spawn_process: at 2019-02-05 20:10:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 20:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 20:10:26 [DEBUG   ] spawn_process: at 2019-02-05 20:10:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 20:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 20:10:26 [DEBUG   ] spawn_process: at 2019-02-05 20:10:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 20:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 20:10:26 [DEBUG   ] spawn_process: at 2019-02-05 20:10:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 20:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 20:10:26 [DEBUG   ] spawn_process: at 2019-02-05 20:10:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 20:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 20:10:26 [DEBUG   ] spawn_process: at 2019-02-05 20:10:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 20:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 20:10:26 [DEBUG   ] spawn_process: at 2019-02-05 20:10:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 20:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 20:10:26 [DEBUG   ] spawn_process: at 2019-02-05 20:10:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 20:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 20:10:26 [DEBUG   ] spawn_process: at 2019-02-05 20:10:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 20:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 20:10:26 [DEBUG   ] spawn_process: at 2019-02-05 20:10:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 20:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 20:10:26 [DEBUG   ] spawn_process: at 2019-02-05 20:10:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 20:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 20:10:26 [DEBUG   ] spawn_process: at 2019-02-05 20:10:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 20:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 20:10:26 [DEBUG   ] spawn_process: at 2019-02-05 20:10:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 20:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 20:10:26 [DEBUG   ] spawn_process: at 2019-02-05 20:10:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 20:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 20:10:26 [DEBUG   ] spawn_process: at 2019-02-05 20:10:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 20:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 20:10:26 [DEBUG   ] spawn_process: at 2019-02-05 20:10:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 20:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 20:10:26 [DEBUG   ] spawn_process: at 2019-02-05 20:10:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 20:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 20:10:26 [DEBUG   ] spawn_process: at 2019-02-05 20:10:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 20:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 20:10:26 [DEBUG   ] spawn_process: at 2019-02-05 20:10:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 20:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 20:10:26 [DEBUG   ] spawn_process: at 2019-02-05 20:10:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 20:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 20:10:26 [DEBUG   ] spawn_process: at 2019-02-05 20:10:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 20:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 20:10:26 [DEBUG   ] spawn_process: at 2019-02-05 20:10:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 20:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 20:10:26 [DEBUG   ] spawn_process: at 2019-02-05 20:10:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 20:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 20:10:26 [DEBUG   ] spawn_process: at 2019-02-05 20:10:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 20:10:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 20:10:26 [DEBUG   ] spawn_process: at 2019-02-05 20:10:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 20:10:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 20:10:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 20:11:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2019-02-05 20:11:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:11:04 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-02-05 20:11:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2019-02-05 20:11:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-02-05 20:11:04 [WARNING ] (13, 1, 'bot')
2019-02-05 20:11:04 [WARNING ] (13, 1, 'bot')
2019-02-05 20:11:04 [WARNING ] (13, 1, 'bot')
2019-02-05 20:11:04 [WARNING ] (13, 1, 'bot')
2019-02-05 20:11:04 [WARNING ] (25, 5, 'bot')
2019-02-05 20:11:04 [WARNING ] (25, 5, 'bot')
2019-02-05 20:11:04 [WARNING ] (25, 5, 'bot')
2019-02-05 20:11:04 [WARNING ] (25, 5, 'bot')
2019-02-05 20:11:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:11:04 [DEBUG   ] Finished updating board flags in 1.014 seconds
2019-02-05 20:11:12 [DEBUG   ] Got command RPT from MCS: ref #1412814
2019-02-05 20:11:12 [DEBUG   ] summary = ERROR
2019-02-05 20:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412814  13 58519 72672025 A  ERRORERROR'
2019-02-05 20:11:12 [DEBUG   ] Got command RPT from MCS: ref #1412815
2019-02-05 20:11:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 20:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412815  77 58519 72672026 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 20:11:12 [DEBUG   ] Got command BAM from MCS: ref #1412813
2019-02-05 20:11:12 [INFO    ] Finished processing BAM request
2019-02-05 20:11:12 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412813   8 58519 72672029 A  ERROR'
2019-02-05 20:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-02-05 20:11:12 [DEBUG   ] spawn_process: at 2019-02-05 20:11:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-02-05 20:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-02-05 20:11:12 [DEBUG   ] spawn_process: at 2019-02-05 20:11:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-02-05 20:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-02-05 20:11:12 [DEBUG   ] spawn_process: at 2019-02-05 20:11:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-02-05 20:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-02-05 20:11:12 [DEBUG   ] spawn_process: at 2019-02-05 20:11:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-02-05 20:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-02-05 20:11:12 [DEBUG   ] spawn_process: at 2019-02-05 20:11:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-02-05 20:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-02-05 20:11:12 [DEBUG   ] spawn_process: at 2019-02-05 20:11:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-02-05 20:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-02-05 20:11:12 [DEBUG   ] spawn_process: at 2019-02-05 20:11:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-02-05 20:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-02-05 20:11:12 [DEBUG   ] spawn_process: at 2019-02-05 20:11:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-02-05 20:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-02-05 20:11:12 [DEBUG   ] spawn_process: at 2019-02-05 20:11:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-02-05 20:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-02-05 20:11:12 [DEBUG   ] spawn_process: at 2019-02-05 20:11:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-02-05 20:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-02-05 20:11:12 [DEBUG   ] spawn_process: at 2019-02-05 20:11:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-02-05 20:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-02-05 20:11:12 [DEBUG   ] spawn_process: at 2019-02-05 20:11:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-02-05 20:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-02-05 20:11:12 [DEBUG   ] spawn_process: at 2019-02-05 20:11:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-02-05 20:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-02-05 20:11:12 [DEBUG   ] spawn_process: at 2019-02-05 20:11:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-02-05 20:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-02-05 20:11:12 [DEBUG   ] spawn_process: at 2019-02-05 20:11:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-02-05 20:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-02-05 20:11:12 [DEBUG   ] spawn_process: at 2019-02-05 20:11:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-02-05 20:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-02-05 20:11:12 [DEBUG   ] spawn_process: at 2019-02-05 20:11:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-02-05 20:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-02-05 20:11:12 [DEBUG   ] spawn_process: at 2019-02-05 20:11:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-02-05 20:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-02-05 20:11:12 [DEBUG   ] spawn_process: at 2019-02-05 20:11:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-02-05 20:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-02-05 20:11:12 [DEBUG   ] spawn_process: at 2019-02-05 20:11:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-02-05 20:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-02-05 20:11:12 [DEBUG   ] spawn_process: at 2019-02-05 20:11:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-02-05 20:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-02-05 20:11:12 [DEBUG   ] spawn_process: at 2019-02-05 20:11:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-02-05 20:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-02-05 20:11:12 [DEBUG   ] spawn_process: at 2019-02-05 20:11:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-02-05 20:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-02-05 20:11:12 [DEBUG   ] spawn_process: at 2019-02-05 20:11:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-02-05 20:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-02-05 20:11:12 [DEBUG   ] spawn_process: at 2019-02-05 20:11:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-02-05 20:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-02-05 20:11:12 [DEBUG   ] spawn_process: at 2019-02-05 20:11:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-02-05 20:11:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 20:11:30 [DEBUG   ] Got command BAM from MCS: ref #1412835
2019-02-05 20:11:30 [INFO    ] Finished processing BAM request
2019-02-05 20:11:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:11:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412835   8 58519 72690033 A  ERROR'
2019-02-05 20:11:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-02-05 20:11:30 [DEBUG   ] spawn_process: at 2019-02-05 20:11:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-02-05 20:11:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-02-05 20:11:30 [DEBUG   ] spawn_process: at 2019-02-05 20:11:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-02-05 20:11:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-02-05 20:11:30 [DEBUG   ] spawn_process: at 2019-02-05 20:11:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-02-05 20:11:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-02-05 20:11:30 [DEBUG   ] spawn_process: at 2019-02-05 20:11:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-02-05 20:11:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-02-05 20:11:30 [DEBUG   ] spawn_process: at 2019-02-05 20:11:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-02-05 20:11:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-02-05 20:11:30 [DEBUG   ] spawn_process: at 2019-02-05 20:11:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-02-05 20:11:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-02-05 20:11:30 [DEBUG   ] spawn_process: at 2019-02-05 20:11:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-02-05 20:11:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-02-05 20:11:30 [DEBUG   ] spawn_process: at 2019-02-05 20:11:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-02-05 20:11:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-02-05 20:11:30 [DEBUG   ] spawn_process: at 2019-02-05 20:11:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-02-05 20:11:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-02-05 20:11:30 [DEBUG   ] spawn_process: at 2019-02-05 20:11:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-02-05 20:11:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-02-05 20:11:30 [DEBUG   ] spawn_process: at 2019-02-05 20:11:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-02-05 20:11:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-02-05 20:11:30 [DEBUG   ] spawn_process: at 2019-02-05 20:11:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-02-05 20:11:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-02-05 20:11:30 [DEBUG   ] spawn_process: at 2019-02-05 20:11:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-02-05 20:11:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-02-05 20:11:30 [DEBUG   ] spawn_process: at 2019-02-05 20:11:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-02-05 20:11:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-02-05 20:11:30 [DEBUG   ] spawn_process: at 2019-02-05 20:11:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-02-05 20:11:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-02-05 20:11:30 [DEBUG   ] spawn_process: at 2019-02-05 20:11:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-02-05 20:11:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-02-05 20:11:30 [DEBUG   ] spawn_process: at 2019-02-05 20:11:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-02-05 20:11:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-02-05 20:11:30 [DEBUG   ] spawn_process: at 2019-02-05 20:11:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-02-05 20:11:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-02-05 20:11:30 [DEBUG   ] spawn_process: at 2019-02-05 20:11:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-02-05 20:11:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-02-05 20:11:30 [DEBUG   ] spawn_process: at 2019-02-05 20:11:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-02-05 20:11:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-02-05 20:11:30 [DEBUG   ] spawn_process: at 2019-02-05 20:11:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-02-05 20:11:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-02-05 20:11:30 [DEBUG   ] spawn_process: at 2019-02-05 20:11:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-02-05 20:11:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-02-05 20:11:30 [DEBUG   ] spawn_process: at 2019-02-05 20:11:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-02-05 20:11:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-02-05 20:11:30 [DEBUG   ] spawn_process: at 2019-02-05 20:11:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-02-05 20:11:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-02-05 20:11:30 [DEBUG   ] spawn_process: at 2019-02-05 20:11:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-02-05 20:11:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-02-05 20:11:30 [DEBUG   ] spawn_process: at 2019-02-05 20:11:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-02-05 20:11:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 20:11:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 20:12:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-02-05 20:12:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:12:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-02-05 20:12:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2019-02-05 20:12:04 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-02-05 20:12:04 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2019-02-05 20:12:04 [WARNING ] (13, 1, 'bot')
2019-02-05 20:12:04 [WARNING ] (13, 1, 'bot')
2019-02-05 20:12:04 [WARNING ] (13, 1, 'bot')
2019-02-05 20:12:04 [WARNING ] (13, 1, 'bot')
2019-02-05 20:12:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:12:04 [DEBUG   ] Finished updating board flags in 1.001 seconds
2019-02-05 20:12:07 [DEBUG   ] Got command BAM from MCS: ref #1412836
2019-02-05 20:12:07 [INFO    ] Finished processing BAM request
2019-02-05 20:12:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:12:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412836   8 58519 72727025 A  ERROR'
2019-02-05 20:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-02-05 20:12:07 [DEBUG   ] spawn_process: at 2019-02-05 20:12:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-02-05 20:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-02-05 20:12:07 [DEBUG   ] spawn_process: at 2019-02-05 20:12:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-02-05 20:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-02-05 20:12:07 [DEBUG   ] spawn_process: at 2019-02-05 20:12:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-02-05 20:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-02-05 20:12:07 [DEBUG   ] spawn_process: at 2019-02-05 20:12:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-02-05 20:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-02-05 20:12:07 [DEBUG   ] spawn_process: at 2019-02-05 20:12:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-02-05 20:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-02-05 20:12:07 [DEBUG   ] spawn_process: at 2019-02-05 20:12:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-02-05 20:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-02-05 20:12:07 [DEBUG   ] spawn_process: at 2019-02-05 20:12:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-02-05 20:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-02-05 20:12:07 [DEBUG   ] spawn_process: at 2019-02-05 20:12:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-02-05 20:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-02-05 20:12:07 [DEBUG   ] spawn_process: at 2019-02-05 20:12:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-02-05 20:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-02-05 20:12:07 [DEBUG   ] spawn_process: at 2019-02-05 20:12:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-02-05 20:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-02-05 20:12:07 [DEBUG   ] spawn_process: at 2019-02-05 20:12:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-02-05 20:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-02-05 20:12:07 [DEBUG   ] spawn_process: at 2019-02-05 20:12:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-02-05 20:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-02-05 20:12:07 [DEBUG   ] spawn_process: at 2019-02-05 20:12:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-02-05 20:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-02-05 20:12:07 [DEBUG   ] spawn_process: at 2019-02-05 20:12:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-02-05 20:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-02-05 20:12:07 [DEBUG   ] spawn_process: at 2019-02-05 20:12:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-02-05 20:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-02-05 20:12:07 [DEBUG   ] spawn_process: at 2019-02-05 20:12:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-02-05 20:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-02-05 20:12:07 [DEBUG   ] spawn_process: at 2019-02-05 20:12:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-02-05 20:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-02-05 20:12:07 [DEBUG   ] spawn_process: at 2019-02-05 20:12:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-02-05 20:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-02-05 20:12:07 [DEBUG   ] spawn_process: at 2019-02-05 20:12:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-02-05 20:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-02-05 20:12:07 [DEBUG   ] spawn_process: at 2019-02-05 20:12:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-02-05 20:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-02-05 20:12:07 [DEBUG   ] spawn_process: at 2019-02-05 20:12:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-02-05 20:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-02-05 20:12:07 [DEBUG   ] spawn_process: at 2019-02-05 20:12:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-02-05 20:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-02-05 20:12:07 [DEBUG   ] spawn_process: at 2019-02-05 20:12:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-02-05 20:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-02-05 20:12:07 [DEBUG   ] spawn_process: at 2019-02-05 20:12:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-02-05 20:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-02-05 20:12:07 [DEBUG   ] spawn_process: at 2019-02-05 20:12:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-02-05 20:12:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-02-05 20:12:07 [DEBUG   ] spawn_process: at 2019-02-05 20:12:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-02-05 20:12:18 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-05 20:12:34 [DEBUG   ] Got command BAM from MCS: ref #1412837
2019-02-05 20:12:34 [INFO    ] Finished processing BAM request
2019-02-05 20:12:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:12:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412837   8 58519 72754029 A  ERROR'
2019-02-05 20:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-02-05 20:12:34 [DEBUG   ] spawn_process: at 2019-02-05 20:12:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-02-05 20:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-02-05 20:12:34 [DEBUG   ] spawn_process: at 2019-02-05 20:12:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-02-05 20:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-02-05 20:12:34 [DEBUG   ] spawn_process: at 2019-02-05 20:12:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-02-05 20:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-02-05 20:12:34 [DEBUG   ] spawn_process: at 2019-02-05 20:12:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-02-05 20:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-02-05 20:12:34 [DEBUG   ] spawn_process: at 2019-02-05 20:12:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-02-05 20:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-02-05 20:12:34 [DEBUG   ] spawn_process: at 2019-02-05 20:12:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-02-05 20:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-02-05 20:12:34 [DEBUG   ] spawn_process: at 2019-02-05 20:12:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-02-05 20:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-02-05 20:12:34 [DEBUG   ] spawn_process: at 2019-02-05 20:12:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-02-05 20:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-02-05 20:12:34 [DEBUG   ] spawn_process: at 2019-02-05 20:12:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-02-05 20:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-02-05 20:12:34 [DEBUG   ] spawn_process: at 2019-02-05 20:12:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-02-05 20:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-02-05 20:12:34 [DEBUG   ] spawn_process: at 2019-02-05 20:12:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-02-05 20:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-02-05 20:12:34 [DEBUG   ] spawn_process: at 2019-02-05 20:12:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-02-05 20:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-02-05 20:12:34 [DEBUG   ] spawn_process: at 2019-02-05 20:12:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-02-05 20:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-02-05 20:12:34 [DEBUG   ] spawn_process: at 2019-02-05 20:12:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-02-05 20:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-02-05 20:12:34 [DEBUG   ] spawn_process: at 2019-02-05 20:12:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-02-05 20:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-02-05 20:12:34 [DEBUG   ] spawn_process: at 2019-02-05 20:12:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-02-05 20:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-02-05 20:12:34 [DEBUG   ] spawn_process: at 2019-02-05 20:12:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-02-05 20:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-02-05 20:12:34 [DEBUG   ] spawn_process: at 2019-02-05 20:12:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-02-05 20:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-02-05 20:12:34 [DEBUG   ] spawn_process: at 2019-02-05 20:12:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-02-05 20:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-02-05 20:12:34 [DEBUG   ] spawn_process: at 2019-02-05 20:12:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-02-05 20:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-02-05 20:12:34 [DEBUG   ] spawn_process: at 2019-02-05 20:12:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-02-05 20:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-02-05 20:12:34 [DEBUG   ] spawn_process: at 2019-02-05 20:12:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-02-05 20:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-02-05 20:12:34 [DEBUG   ] spawn_process: at 2019-02-05 20:12:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-02-05 20:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-02-05 20:12:34 [DEBUG   ] spawn_process: at 2019-02-05 20:12:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-02-05 20:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-02-05 20:12:34 [DEBUG   ] spawn_process: at 2019-02-05 20:12:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-02-05 20:12:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-02-05 20:12:34 [DEBUG   ] spawn_process: at 2019-02-05 20:12:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-02-05 20:12:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 20:12:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 20:13:02 [DEBUG   ] Got command BAM from MCS: ref #1412838
2019-02-05 20:13:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:13:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412838   8 58519 72782029 A  ERROR'
2019-02-05 20:13:02 [INFO    ] Finished processing BAM request
2019-02-05 20:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 20:13:02 [DEBUG   ] spawn_process: at 2019-02-05 20:13:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 20:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 20:13:02 [DEBUG   ] spawn_process: at 2019-02-05 20:13:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 20:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 20:13:02 [DEBUG   ] spawn_process: at 2019-02-05 20:13:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 20:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 20:13:02 [DEBUG   ] spawn_process: at 2019-02-05 20:13:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 20:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 20:13:02 [DEBUG   ] spawn_process: at 2019-02-05 20:13:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 20:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 20:13:02 [DEBUG   ] spawn_process: at 2019-02-05 20:13:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 20:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 20:13:02 [DEBUG   ] spawn_process: at 2019-02-05 20:13:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 20:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 20:13:02 [DEBUG   ] spawn_process: at 2019-02-05 20:13:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 20:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 20:13:02 [DEBUG   ] spawn_process: at 2019-02-05 20:13:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 20:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 20:13:02 [DEBUG   ] spawn_process: at 2019-02-05 20:13:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 20:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 20:13:02 [DEBUG   ] spawn_process: at 2019-02-05 20:13:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 20:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 20:13:02 [DEBUG   ] spawn_process: at 2019-02-05 20:13:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 20:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 20:13:02 [DEBUG   ] spawn_process: at 2019-02-05 20:13:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 20:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 20:13:02 [DEBUG   ] spawn_process: at 2019-02-05 20:13:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 20:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 20:13:02 [DEBUG   ] spawn_process: at 2019-02-05 20:13:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 20:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 20:13:02 [DEBUG   ] spawn_process: at 2019-02-05 20:13:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 20:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 20:13:02 [DEBUG   ] spawn_process: at 2019-02-05 20:13:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 20:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 20:13:02 [DEBUG   ] spawn_process: at 2019-02-05 20:13:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 20:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 20:13:02 [DEBUG   ] spawn_process: at 2019-02-05 20:13:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 20:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 20:13:02 [DEBUG   ] spawn_process: at 2019-02-05 20:13:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 20:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 20:13:02 [DEBUG   ] spawn_process: at 2019-02-05 20:13:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 20:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 20:13:02 [DEBUG   ] spawn_process: at 2019-02-05 20:13:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 20:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 20:13:02 [DEBUG   ] spawn_process: at 2019-02-05 20:13:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 20:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 20:13:02 [DEBUG   ] spawn_process: at 2019-02-05 20:13:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 20:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 20:13:02 [DEBUG   ] spawn_process: at 2019-02-05 20:13:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 20:13:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 20:13:02 [DEBUG   ] spawn_process: at 2019-02-05 20:13:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 20:13:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2019-02-05 20:13:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-02-05 20:13:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:13:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2019-02-05 20:13:04 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-02-05 20:13:04 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2019-02-05 20:13:04 [WARNING ] (13, 1, 'bot')
2019-02-05 20:13:04 [WARNING ] (13, 1, 'bot')
2019-02-05 20:13:04 [WARNING ] (13, 1, 'bot')
2019-02-05 20:13:04 [WARNING ] (13, 1, 'bot')
2019-02-05 20:13:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:13:04 [DEBUG   ] Finished updating board flags in 0.988 seconds
2019-02-05 20:13:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 20:13:38 [DEBUG   ] Got command BAM from MCS: ref #1412839
2019-02-05 20:13:38 [INFO    ] Finished processing BAM request
2019-02-05 20:13:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:13:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412839   8 58519 72818037 A  ERROR'
2019-02-05 20:13:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 20:13:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 20:13:38 [DEBUG   ] spawn_process: at 2019-02-05 20:13:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 20:13:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 20:13:38 [DEBUG   ] spawn_process: at 2019-02-05 20:13:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 20:13:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 20:13:38 [DEBUG   ] spawn_process: at 2019-02-05 20:13:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 20:13:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 20:13:38 [DEBUG   ] spawn_process: at 2019-02-05 20:13:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 20:13:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 20:13:38 [DEBUG   ] spawn_process: at 2019-02-05 20:13:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 20:13:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 20:13:38 [DEBUG   ] spawn_process: at 2019-02-05 20:13:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 20:13:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 20:13:38 [DEBUG   ] spawn_process: at 2019-02-05 20:13:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 20:13:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 20:13:38 [DEBUG   ] spawn_process: at 2019-02-05 20:13:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 20:13:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 20:13:38 [DEBUG   ] spawn_process: at 2019-02-05 20:13:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 20:13:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 20:13:38 [DEBUG   ] spawn_process: at 2019-02-05 20:13:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 20:13:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 20:13:38 [DEBUG   ] spawn_process: at 2019-02-05 20:13:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 20:13:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 20:13:38 [DEBUG   ] spawn_process: at 2019-02-05 20:13:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 20:13:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 20:13:38 [DEBUG   ] spawn_process: at 2019-02-05 20:13:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 20:13:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 20:13:38 [DEBUG   ] spawn_process: at 2019-02-05 20:13:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 20:13:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 20:13:38 [DEBUG   ] spawn_process: at 2019-02-05 20:13:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 20:13:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 20:13:38 [DEBUG   ] spawn_process: at 2019-02-05 20:13:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 20:13:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 20:13:38 [DEBUG   ] spawn_process: at 2019-02-05 20:13:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 20:13:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 20:13:38 [DEBUG   ] spawn_process: at 2019-02-05 20:13:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 20:13:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 20:13:38 [DEBUG   ] spawn_process: at 2019-02-05 20:13:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 20:13:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 20:13:38 [DEBUG   ] spawn_process: at 2019-02-05 20:13:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 20:13:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 20:13:38 [DEBUG   ] spawn_process: at 2019-02-05 20:13:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 20:13:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 20:13:38 [DEBUG   ] spawn_process: at 2019-02-05 20:13:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 20:13:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 20:13:38 [DEBUG   ] spawn_process: at 2019-02-05 20:13:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 20:13:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 20:13:38 [DEBUG   ] spawn_process: at 2019-02-05 20:13:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 20:13:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 20:13:38 [DEBUG   ] spawn_process: at 2019-02-05 20:13:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 20:13:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 20:13:38 [DEBUG   ] spawn_process: at 2019-02-05 20:13:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 20:13:57 [DEBUG   ] Got command BAM from MCS: ref #1412840
2019-02-05 20:13:57 [INFO    ] Finished processing BAM request
2019-02-05 20:13:57 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:13:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412840   8 58519 72837033 A  ERROR'
2019-02-05 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 20:13:57 [DEBUG   ] spawn_process: at 2019-02-05 20:13:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 20:13:57 [DEBUG   ] spawn_process: at 2019-02-05 20:13:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 20:13:57 [DEBUG   ] spawn_process: at 2019-02-05 20:13:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 20:13:57 [DEBUG   ] spawn_process: at 2019-02-05 20:13:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 20:13:57 [DEBUG   ] spawn_process: at 2019-02-05 20:13:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 20:13:57 [DEBUG   ] spawn_process: at 2019-02-05 20:13:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 20:13:57 [DEBUG   ] spawn_process: at 2019-02-05 20:13:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 20:13:57 [DEBUG   ] spawn_process: at 2019-02-05 20:13:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 20:13:57 [DEBUG   ] spawn_process: at 2019-02-05 20:13:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 20:13:57 [DEBUG   ] spawn_process: at 2019-02-05 20:13:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 20:13:57 [DEBUG   ] spawn_process: at 2019-02-05 20:13:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 20:13:57 [DEBUG   ] spawn_process: at 2019-02-05 20:13:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 20:13:57 [DEBUG   ] spawn_process: at 2019-02-05 20:13:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 20:13:57 [DEBUG   ] spawn_process: at 2019-02-05 20:13:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 20:13:57 [DEBUG   ] spawn_process: at 2019-02-05 20:13:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 20:13:57 [DEBUG   ] spawn_process: at 2019-02-05 20:13:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 20:13:57 [DEBUG   ] spawn_process: at 2019-02-05 20:13:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 20:13:57 [DEBUG   ] spawn_process: at 2019-02-05 20:13:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 20:13:57 [DEBUG   ] spawn_process: at 2019-02-05 20:13:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 20:13:57 [DEBUG   ] spawn_process: at 2019-02-05 20:13:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 20:13:57 [DEBUG   ] spawn_process: at 2019-02-05 20:13:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 20:13:57 [DEBUG   ] spawn_process: at 2019-02-05 20:13:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 20:13:57 [DEBUG   ] spawn_process: at 2019-02-05 20:13:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 20:13:57 [DEBUG   ] spawn_process: at 2019-02-05 20:13:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 20:13:57 [DEBUG   ] spawn_process: at 2019-02-05 20:13:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 20:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 20:13:57 [DEBUG   ] spawn_process: at 2019-02-05 20:13:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 20:13:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 20:14:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:14:04 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-02-05 20:14:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-02-05 20:14:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-05 20:14:04 [WARNING ] (13, 1, 'bot')
2019-02-05 20:14:04 [WARNING ] (13, 1, 'bot')
2019-02-05 20:14:04 [WARNING ] (13, 1, 'bot')
2019-02-05 20:14:04 [WARNING ] (13, 1, 'bot')
2019-02-05 20:14:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:14:04 [DEBUG   ] Finished updating board flags in 1.258 seconds
2019-02-05 20:14:18 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-05 20:14:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:14:42 [DEBUG   ] Got command BAM from MCS: ref #1412847
2019-02-05 20:14:42 [INFO    ] Finished processing BAM request
2019-02-05 20:14:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:14:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412847   8 58519 72882033 A  ERROR'
2019-02-05 20:14:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-02-05 20:14:42 [DEBUG   ] spawn_process: at 2019-02-05 20:14:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-02-05 20:14:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-02-05 20:14:42 [DEBUG   ] spawn_process: at 2019-02-05 20:14:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-02-05 20:14:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-02-05 20:14:42 [DEBUG   ] spawn_process: at 2019-02-05 20:14:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-02-05 20:14:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-02-05 20:14:42 [DEBUG   ] spawn_process: at 2019-02-05 20:14:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-02-05 20:14:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-02-05 20:14:42 [DEBUG   ] spawn_process: at 2019-02-05 20:14:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-02-05 20:14:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-02-05 20:14:42 [DEBUG   ] spawn_process: at 2019-02-05 20:14:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-02-05 20:14:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-02-05 20:14:42 [DEBUG   ] spawn_process: at 2019-02-05 20:14:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-02-05 20:14:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-02-05 20:14:42 [DEBUG   ] spawn_process: at 2019-02-05 20:14:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-02-05 20:14:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-02-05 20:14:42 [DEBUG   ] spawn_process: at 2019-02-05 20:14:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-02-05 20:14:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-02-05 20:14:42 [DEBUG   ] spawn_process: at 2019-02-05 20:14:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-02-05 20:14:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-02-05 20:14:42 [DEBUG   ] spawn_process: at 2019-02-05 20:14:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-02-05 20:14:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-02-05 20:14:42 [DEBUG   ] spawn_process: at 2019-02-05 20:14:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-02-05 20:14:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-02-05 20:14:42 [DEBUG   ] spawn_process: at 2019-02-05 20:14:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-02-05 20:14:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-02-05 20:14:42 [DEBUG   ] spawn_process: at 2019-02-05 20:14:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-02-05 20:14:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-02-05 20:14:42 [DEBUG   ] spawn_process: at 2019-02-05 20:14:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-02-05 20:14:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-02-05 20:14:42 [DEBUG   ] spawn_process: at 2019-02-05 20:14:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-02-05 20:14:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-02-05 20:14:42 [DEBUG   ] spawn_process: at 2019-02-05 20:14:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-02-05 20:14:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-02-05 20:14:42 [DEBUG   ] spawn_process: at 2019-02-05 20:14:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-02-05 20:14:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-02-05 20:14:42 [DEBUG   ] spawn_process: at 2019-02-05 20:14:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-02-05 20:14:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-02-05 20:14:42 [DEBUG   ] spawn_process: at 2019-02-05 20:14:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-02-05 20:14:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-02-05 20:14:42 [DEBUG   ] spawn_process: at 2019-02-05 20:14:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-02-05 20:14:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-02-05 20:14:42 [DEBUG   ] spawn_process: at 2019-02-05 20:14:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-02-05 20:14:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-02-05 20:14:42 [DEBUG   ] spawn_process: at 2019-02-05 20:14:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-02-05 20:14:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-02-05 20:14:42 [DEBUG   ] spawn_process: at 2019-02-05 20:14:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-02-05 20:14:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-02-05 20:14:42 [DEBUG   ] spawn_process: at 2019-02-05 20:14:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-02-05 20:14:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-02-05 20:14:42 [DEBUG   ] spawn_process: at 2019-02-05 20:14:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-02-05 20:14:51 [DEBUG   ] Got command BAM from MCS: ref #1412848
2019-02-05 20:14:51 [INFO    ] Finished processing BAM request
2019-02-05 20:14:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:14:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412848   8 58519 72891025 A  ERROR'
2019-02-05 20:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 20:14:51 [DEBUG   ] spawn_process: at 2019-02-05 20:14:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 20:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 20:14:51 [DEBUG   ] spawn_process: at 2019-02-05 20:14:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 20:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 20:14:51 [DEBUG   ] spawn_process: at 2019-02-05 20:14:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 20:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 20:14:51 [DEBUG   ] spawn_process: at 2019-02-05 20:14:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 20:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 20:14:51 [DEBUG   ] spawn_process: at 2019-02-05 20:14:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 20:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 20:14:51 [DEBUG   ] spawn_process: at 2019-02-05 20:14:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 20:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 20:14:51 [DEBUG   ] spawn_process: at 2019-02-05 20:14:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 20:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 20:14:51 [DEBUG   ] spawn_process: at 2019-02-05 20:14:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 20:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 20:14:51 [DEBUG   ] spawn_process: at 2019-02-05 20:14:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 20:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 20:14:51 [DEBUG   ] spawn_process: at 2019-02-05 20:14:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 20:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 20:14:51 [DEBUG   ] spawn_process: at 2019-02-05 20:14:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 20:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 20:14:51 [DEBUG   ] spawn_process: at 2019-02-05 20:14:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 20:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 20:14:51 [DEBUG   ] spawn_process: at 2019-02-05 20:14:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 20:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 20:14:51 [DEBUG   ] spawn_process: at 2019-02-05 20:14:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 20:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 20:14:51 [DEBUG   ] spawn_process: at 2019-02-05 20:14:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 20:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 20:14:51 [DEBUG   ] spawn_process: at 2019-02-05 20:14:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 20:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 20:14:51 [DEBUG   ] spawn_process: at 2019-02-05 20:14:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 20:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 20:14:51 [DEBUG   ] spawn_process: at 2019-02-05 20:14:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 20:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 20:14:51 [DEBUG   ] spawn_process: at 2019-02-05 20:14:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 20:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 20:14:51 [DEBUG   ] spawn_process: at 2019-02-05 20:14:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 20:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 20:14:51 [DEBUG   ] spawn_process: at 2019-02-05 20:14:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 20:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 20:14:51 [DEBUG   ] spawn_process: at 2019-02-05 20:14:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 20:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 20:14:51 [DEBUG   ] spawn_process: at 2019-02-05 20:14:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 20:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 20:14:51 [DEBUG   ] spawn_process: at 2019-02-05 20:14:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 20:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 20:14:51 [DEBUG   ] spawn_process: at 2019-02-05 20:14:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 20:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 20:14:51 [DEBUG   ] spawn_process: at 2019-02-05 20:14:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 20:14:56 [DEBUG   ] Got command RPT from MCS: ref #1412849
2019-02-05 20:14:56 [DEBUG   ] summary = ERROR
2019-02-05 20:14:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412849  13 58519 72896557 A  ERRORERROR'
2019-02-05 20:14:56 [DEBUG   ] Got command RPT from MCS: ref #1412850
2019-02-05 20:14:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 20:14:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412850  77 58519 72896761 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 20:14:56 [DEBUG   ] Got command RPT from MCS: ref #1412851
2019-02-05 20:14:56 [DEBUG   ] summary = ERROR
2019-02-05 20:14:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412851  13 58519 72896953 A  ERRORERROR'
2019-02-05 20:14:57 [DEBUG   ] Got command RPT from MCS: ref #1412853
2019-02-05 20:14:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 20:14:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412853  77 58519 72897157 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 20:14:57 [DEBUG   ] Got command RPT from MCS: ref #1412854
2019-02-05 20:14:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 20:14:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412854  12 58519 72897361 A  ERRORB¤ff'
2019-02-05 20:14:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:15:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 20:15:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-02-05 20:15:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:15:04 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-02-05 20:15:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-02-05 20:15:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-05 20:15:04 [WARNING ] (13, 1, 'bot')
2019-02-05 20:15:04 [WARNING ] (13, 1, 'bot')
2019-02-05 20:15:04 [WARNING ] (13, 1, 'bot')
2019-02-05 20:15:04 [WARNING ] (13, 1, 'bot')
2019-02-05 20:15:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:15:04 [DEBUG   ] Finished updating board flags in 1.214 seconds
2019-02-05 20:15:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:15:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:15:45 [DEBUG   ] Got command BAM from MCS: ref #1412859
2019-02-05 20:15:45 [INFO    ] Finished processing BAM request
2019-02-05 20:15:45 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412859   8 58519 72945025 A  ERROR'
2019-02-05 20:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 20:15:45 [DEBUG   ] spawn_process: at 2019-02-05 20:15:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 20:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 20:15:45 [DEBUG   ] spawn_process: at 2019-02-05 20:15:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 20:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 20:15:45 [DEBUG   ] spawn_process: at 2019-02-05 20:15:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 20:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 20:15:45 [DEBUG   ] spawn_process: at 2019-02-05 20:15:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 20:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 20:15:45 [DEBUG   ] spawn_process: at 2019-02-05 20:15:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 20:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 20:15:45 [DEBUG   ] spawn_process: at 2019-02-05 20:15:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 20:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 20:15:45 [DEBUG   ] spawn_process: at 2019-02-05 20:15:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 20:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 20:15:45 [DEBUG   ] spawn_process: at 2019-02-05 20:15:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 20:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 20:15:45 [DEBUG   ] spawn_process: at 2019-02-05 20:15:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 20:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 20:15:45 [DEBUG   ] spawn_process: at 2019-02-05 20:15:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 20:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 20:15:45 [DEBUG   ] spawn_process: at 2019-02-05 20:15:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 20:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 20:15:45 [DEBUG   ] spawn_process: at 2019-02-05 20:15:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 20:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 20:15:45 [DEBUG   ] spawn_process: at 2019-02-05 20:15:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 20:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 20:15:45 [DEBUG   ] spawn_process: at 2019-02-05 20:15:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 20:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 20:15:45 [DEBUG   ] spawn_process: at 2019-02-05 20:15:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 20:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 20:15:45 [DEBUG   ] spawn_process: at 2019-02-05 20:15:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 20:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 20:15:45 [DEBUG   ] spawn_process: at 2019-02-05 20:15:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 20:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 20:15:45 [DEBUG   ] spawn_process: at 2019-02-05 20:15:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 20:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 20:15:45 [DEBUG   ] spawn_process: at 2019-02-05 20:15:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 20:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 20:15:45 [DEBUG   ] spawn_process: at 2019-02-05 20:15:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 20:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 20:15:45 [DEBUG   ] spawn_process: at 2019-02-05 20:15:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 20:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 20:15:45 [DEBUG   ] spawn_process: at 2019-02-05 20:15:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 20:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 20:15:45 [DEBUG   ] spawn_process: at 2019-02-05 20:15:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 20:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 20:15:45 [DEBUG   ] spawn_process: at 2019-02-05 20:15:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 20:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 20:15:45 [DEBUG   ] spawn_process: at 2019-02-05 20:15:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 20:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 20:15:45 [DEBUG   ] spawn_process: at 2019-02-05 20:15:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 20:15:46 [DEBUG   ] Got command BAM from MCS: ref #1412860
2019-02-05 20:15:46 [INFO    ] Finished processing BAM request
2019-02-05 20:15:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:15:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412860   8 58519 72946029 A  ERROR'
2019-02-05 20:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 20:15:46 [DEBUG   ] spawn_process: at 2019-02-05 20:15:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 20:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 20:15:46 [DEBUG   ] spawn_process: at 2019-02-05 20:15:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 20:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 20:15:46 [DEBUG   ] spawn_process: at 2019-02-05 20:15:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 20:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 20:15:46 [DEBUG   ] spawn_process: at 2019-02-05 20:15:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 20:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 20:15:46 [DEBUG   ] spawn_process: at 2019-02-05 20:15:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 20:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 20:15:46 [DEBUG   ] spawn_process: at 2019-02-05 20:15:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 20:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 20:15:46 [DEBUG   ] spawn_process: at 2019-02-05 20:15:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 20:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 20:15:46 [DEBUG   ] spawn_process: at 2019-02-05 20:15:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 20:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 20:15:46 [DEBUG   ] spawn_process: at 2019-02-05 20:15:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 20:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 20:15:46 [DEBUG   ] spawn_process: at 2019-02-05 20:15:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 20:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 20:15:46 [DEBUG   ] spawn_process: at 2019-02-05 20:15:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 20:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 20:15:46 [DEBUG   ] spawn_process: at 2019-02-05 20:15:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 20:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 20:15:46 [DEBUG   ] spawn_process: at 2019-02-05 20:15:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 20:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 20:15:46 [DEBUG   ] spawn_process: at 2019-02-05 20:15:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 20:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 20:15:46 [DEBUG   ] spawn_process: at 2019-02-05 20:15:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 20:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 20:15:46 [DEBUG   ] spawn_process: at 2019-02-05 20:15:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 20:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 20:15:46 [DEBUG   ] spawn_process: at 2019-02-05 20:15:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 20:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 20:15:46 [DEBUG   ] spawn_process: at 2019-02-05 20:15:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 20:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 20:15:46 [DEBUG   ] spawn_process: at 2019-02-05 20:15:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 20:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 20:15:46 [DEBUG   ] spawn_process: at 2019-02-05 20:15:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 20:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 20:15:46 [DEBUG   ] spawn_process: at 2019-02-05 20:15:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 20:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 20:15:46 [DEBUG   ] spawn_process: at 2019-02-05 20:15:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 20:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 20:15:46 [DEBUG   ] spawn_process: at 2019-02-05 20:15:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 20:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 20:15:46 [DEBUG   ] spawn_process: at 2019-02-05 20:15:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 20:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 20:15:46 [DEBUG   ] spawn_process: at 2019-02-05 20:15:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 20:15:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 20:15:46 [DEBUG   ] spawn_process: at 2019-02-05 20:15:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 20:15:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-05 20:16:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:16:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2019-02-05 20:16:04 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-02-05 20:16:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-02-05 20:16:04 [WARNING ] (13, 1, 'bot')
2019-02-05 20:16:04 [WARNING ] (13, 1, 'bot')
2019-02-05 20:16:04 [WARNING ] (13, 1, 'bot')
2019-02-05 20:16:04 [WARNING ] (13, 1, 'bot')
2019-02-05 20:16:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:16:04 [DEBUG   ] Finished updating board flags in 1.185 seconds
2019-02-05 20:16:12 [DEBUG   ] Got command RPT from MCS: ref #1412861
2019-02-05 20:16:12 [DEBUG   ] summary = ERROR
2019-02-05 20:16:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412861  13 58519 72972017 A  ERRORERROR'
2019-02-05 20:16:12 [DEBUG   ] Got command RPT from MCS: ref #1412862
2019-02-05 20:16:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 20:16:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412862  77 58519 72972018 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 20:16:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:16:38 [DEBUG   ] Got command BAM from MCS: ref #1412878
2019-02-05 20:16:38 [INFO    ] Finished processing BAM request
2019-02-05 20:16:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:16:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412878   8 58519 72998029 A  ERROR'
2019-02-05 20:16:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-02-05 20:16:38 [DEBUG   ] spawn_process: at 2019-02-05 20:16:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-02-05 20:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-02-05 20:16:38 [DEBUG   ] spawn_process: at 2019-02-05 20:16:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-02-05 20:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-02-05 20:16:38 [DEBUG   ] spawn_process: at 2019-02-05 20:16:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-02-05 20:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-02-05 20:16:38 [DEBUG   ] spawn_process: at 2019-02-05 20:16:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-02-05 20:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-02-05 20:16:38 [DEBUG   ] spawn_process: at 2019-02-05 20:16:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-02-05 20:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-02-05 20:16:38 [DEBUG   ] spawn_process: at 2019-02-05 20:16:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-02-05 20:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-02-05 20:16:38 [DEBUG   ] spawn_process: at 2019-02-05 20:16:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-02-05 20:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-02-05 20:16:38 [DEBUG   ] spawn_process: at 2019-02-05 20:16:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-02-05 20:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-02-05 20:16:38 [DEBUG   ] spawn_process: at 2019-02-05 20:16:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-02-05 20:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-02-05 20:16:38 [DEBUG   ] spawn_process: at 2019-02-05 20:16:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-02-05 20:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-02-05 20:16:38 [DEBUG   ] spawn_process: at 2019-02-05 20:16:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-02-05 20:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-02-05 20:16:38 [DEBUG   ] spawn_process: at 2019-02-05 20:16:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-02-05 20:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-02-05 20:16:38 [DEBUG   ] spawn_process: at 2019-02-05 20:16:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-02-05 20:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-02-05 20:16:38 [DEBUG   ] spawn_process: at 2019-02-05 20:16:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-02-05 20:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-02-05 20:16:38 [DEBUG   ] spawn_process: at 2019-02-05 20:16:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-02-05 20:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-02-05 20:16:38 [DEBUG   ] spawn_process: at 2019-02-05 20:16:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-02-05 20:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-02-05 20:16:38 [DEBUG   ] spawn_process: at 2019-02-05 20:16:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-02-05 20:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-02-05 20:16:38 [DEBUG   ] spawn_process: at 2019-02-05 20:16:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-02-05 20:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-02-05 20:16:38 [DEBUG   ] spawn_process: at 2019-02-05 20:16:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-02-05 20:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-02-05 20:16:38 [DEBUG   ] spawn_process: at 2019-02-05 20:16:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-02-05 20:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-02-05 20:16:38 [DEBUG   ] spawn_process: at 2019-02-05 20:16:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-02-05 20:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-02-05 20:16:38 [DEBUG   ] spawn_process: at 2019-02-05 20:16:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-02-05 20:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-02-05 20:16:38 [DEBUG   ] spawn_process: at 2019-02-05 20:16:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-02-05 20:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-02-05 20:16:38 [DEBUG   ] spawn_process: at 2019-02-05 20:16:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-02-05 20:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-02-05 20:16:38 [DEBUG   ] spawn_process: at 2019-02-05 20:16:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-02-05 20:16:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-02-05 20:16:38 [DEBUG   ] spawn_process: at 2019-02-05 20:16:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-02-05 20:16:50 [DEBUG   ] Got command BAM from MCS: ref #1412879
2019-02-05 20:16:50 [INFO    ] Finished processing BAM request
2019-02-05 20:16:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:16:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412879   8 58519 73010033 A  ERROR'
2019-02-05 20:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 20:16:50 [DEBUG   ] spawn_process: at 2019-02-05 20:16:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 20:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 20:16:50 [DEBUG   ] spawn_process: at 2019-02-05 20:16:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 20:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 20:16:50 [DEBUG   ] spawn_process: at 2019-02-05 20:16:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 20:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 20:16:50 [DEBUG   ] spawn_process: at 2019-02-05 20:16:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 20:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 20:16:50 [DEBUG   ] spawn_process: at 2019-02-05 20:16:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 20:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 20:16:50 [DEBUG   ] spawn_process: at 2019-02-05 20:16:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 20:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 20:16:50 [DEBUG   ] spawn_process: at 2019-02-05 20:16:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 20:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 20:16:50 [DEBUG   ] spawn_process: at 2019-02-05 20:16:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 20:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 20:16:50 [DEBUG   ] spawn_process: at 2019-02-05 20:16:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 20:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 20:16:50 [DEBUG   ] spawn_process: at 2019-02-05 20:16:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 20:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 20:16:50 [DEBUG   ] spawn_process: at 2019-02-05 20:16:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 20:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 20:16:50 [DEBUG   ] spawn_process: at 2019-02-05 20:16:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 20:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 20:16:50 [DEBUG   ] spawn_process: at 2019-02-05 20:16:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 20:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 20:16:50 [DEBUG   ] spawn_process: at 2019-02-05 20:16:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 20:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 20:16:50 [DEBUG   ] spawn_process: at 2019-02-05 20:16:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 20:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 20:16:50 [DEBUG   ] spawn_process: at 2019-02-05 20:16:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 20:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 20:16:50 [DEBUG   ] spawn_process: at 2019-02-05 20:16:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 20:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 20:16:50 [DEBUG   ] spawn_process: at 2019-02-05 20:16:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 20:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 20:16:50 [DEBUG   ] spawn_process: at 2019-02-05 20:16:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 20:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 20:16:50 [DEBUG   ] spawn_process: at 2019-02-05 20:16:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 20:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 20:16:50 [DEBUG   ] spawn_process: at 2019-02-05 20:16:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 20:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 20:16:50 [DEBUG   ] spawn_process: at 2019-02-05 20:16:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 20:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 20:16:50 [DEBUG   ] spawn_process: at 2019-02-05 20:16:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 20:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 20:16:50 [DEBUG   ] spawn_process: at 2019-02-05 20:16:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 20:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 20:16:50 [DEBUG   ] spawn_process: at 2019-02-05 20:16:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 20:16:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 20:16:50 [DEBUG   ] spawn_process: at 2019-02-05 20:16:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 20:16:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:17:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2019-02-05 20:17:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:17:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-02-05 20:17:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-02-05 20:17:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-05 20:17:04 [WARNING ] (13, 1, 'bot')
2019-02-05 20:17:04 [WARNING ] (13, 1, 'bot')
2019-02-05 20:17:04 [WARNING ] (13, 1, 'bot')
2019-02-05 20:17:04 [WARNING ] (13, 1, 'bot')
2019-02-05 20:17:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:17:04 [DEBUG   ] Finished updating board flags in 0.995 seconds
2019-02-05 20:17:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:17:31 [DEBUG   ] Got command BAM from MCS: ref #1412884
2019-02-05 20:17:31 [INFO    ] Finished processing BAM request
2019-02-05 20:17:31 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:17:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412884   8 58519 73051029 A  ERROR'
2019-02-05 20:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-02-05 20:17:31 [DEBUG   ] spawn_process: at 2019-02-05 20:17:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-02-05 20:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-02-05 20:17:31 [DEBUG   ] spawn_process: at 2019-02-05 20:17:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-02-05 20:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-02-05 20:17:31 [DEBUG   ] spawn_process: at 2019-02-05 20:17:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-02-05 20:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-02-05 20:17:31 [DEBUG   ] spawn_process: at 2019-02-05 20:17:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-02-05 20:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-02-05 20:17:31 [DEBUG   ] spawn_process: at 2019-02-05 20:17:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-02-05 20:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-02-05 20:17:31 [DEBUG   ] spawn_process: at 2019-02-05 20:17:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-02-05 20:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-02-05 20:17:31 [DEBUG   ] spawn_process: at 2019-02-05 20:17:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-02-05 20:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-02-05 20:17:31 [DEBUG   ] spawn_process: at 2019-02-05 20:17:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-02-05 20:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-02-05 20:17:31 [DEBUG   ] spawn_process: at 2019-02-05 20:17:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-02-05 20:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-02-05 20:17:31 [DEBUG   ] spawn_process: at 2019-02-05 20:17:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-02-05 20:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-02-05 20:17:31 [DEBUG   ] spawn_process: at 2019-02-05 20:17:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-02-05 20:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-02-05 20:17:31 [DEBUG   ] spawn_process: at 2019-02-05 20:17:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-02-05 20:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-02-05 20:17:31 [DEBUG   ] spawn_process: at 2019-02-05 20:17:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-02-05 20:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-02-05 20:17:31 [DEBUG   ] spawn_process: at 2019-02-05 20:17:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-02-05 20:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-02-05 20:17:31 [DEBUG   ] spawn_process: at 2019-02-05 20:17:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-02-05 20:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-02-05 20:17:31 [DEBUG   ] spawn_process: at 2019-02-05 20:17:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-02-05 20:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-02-05 20:17:31 [DEBUG   ] spawn_process: at 2019-02-05 20:17:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-02-05 20:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-02-05 20:17:31 [DEBUG   ] spawn_process: at 2019-02-05 20:17:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-02-05 20:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-02-05 20:17:31 [DEBUG   ] spawn_process: at 2019-02-05 20:17:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-02-05 20:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-02-05 20:17:31 [DEBUG   ] spawn_process: at 2019-02-05 20:17:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-02-05 20:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-02-05 20:17:31 [DEBUG   ] spawn_process: at 2019-02-05 20:17:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-02-05 20:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-02-05 20:17:31 [DEBUG   ] spawn_process: at 2019-02-05 20:17:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-02-05 20:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-02-05 20:17:31 [DEBUG   ] spawn_process: at 2019-02-05 20:17:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-02-05 20:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-02-05 20:17:31 [DEBUG   ] spawn_process: at 2019-02-05 20:17:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-02-05 20:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-02-05 20:17:31 [DEBUG   ] spawn_process: at 2019-02-05 20:17:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-02-05 20:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-02-05 20:17:31 [DEBUG   ] spawn_process: at 2019-02-05 20:17:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-02-05 20:17:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:17:54 [DEBUG   ] Got command BAM from MCS: ref #1412885
2019-02-05 20:17:54 [INFO    ] Finished processing BAM request
2019-02-05 20:17:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:17:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412885   8 58519 73074025 A  ERROR'
2019-02-05 20:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 20:17:54 [DEBUG   ] spawn_process: at 2019-02-05 20:17:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 20:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 20:17:54 [DEBUG   ] spawn_process: at 2019-02-05 20:17:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 20:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 20:17:54 [DEBUG   ] spawn_process: at 2019-02-05 20:17:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 20:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 20:17:54 [DEBUG   ] spawn_process: at 2019-02-05 20:17:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 20:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 20:17:54 [DEBUG   ] spawn_process: at 2019-02-05 20:17:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 20:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 20:17:54 [DEBUG   ] spawn_process: at 2019-02-05 20:17:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 20:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 20:17:54 [DEBUG   ] spawn_process: at 2019-02-05 20:17:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 20:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 20:17:54 [DEBUG   ] spawn_process: at 2019-02-05 20:17:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 20:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 20:17:54 [DEBUG   ] spawn_process: at 2019-02-05 20:17:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 20:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 20:17:54 [DEBUG   ] spawn_process: at 2019-02-05 20:17:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 20:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 20:17:54 [DEBUG   ] spawn_process: at 2019-02-05 20:17:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 20:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 20:17:54 [DEBUG   ] spawn_process: at 2019-02-05 20:17:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 20:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 20:17:54 [DEBUG   ] spawn_process: at 2019-02-05 20:17:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 20:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 20:17:54 [DEBUG   ] spawn_process: at 2019-02-05 20:17:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 20:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 20:17:54 [DEBUG   ] spawn_process: at 2019-02-05 20:17:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 20:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 20:17:54 [DEBUG   ] spawn_process: at 2019-02-05 20:17:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 20:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 20:17:54 [DEBUG   ] spawn_process: at 2019-02-05 20:17:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 20:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 20:17:54 [DEBUG   ] spawn_process: at 2019-02-05 20:17:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 20:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 20:17:54 [DEBUG   ] spawn_process: at 2019-02-05 20:17:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 20:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 20:17:54 [DEBUG   ] spawn_process: at 2019-02-05 20:17:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 20:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 20:17:54 [DEBUG   ] spawn_process: at 2019-02-05 20:17:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 20:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 20:17:54 [DEBUG   ] spawn_process: at 2019-02-05 20:17:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 20:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 20:17:54 [DEBUG   ] spawn_process: at 2019-02-05 20:17:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 20:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 20:17:54 [DEBUG   ] spawn_process: at 2019-02-05 20:17:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 20:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 20:17:54 [DEBUG   ] spawn_process: at 2019-02-05 20:17:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 20:17:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 20:17:54 [DEBUG   ] spawn_process: at 2019-02-05 20:17:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 20:17:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:18:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-02-05 20:18:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:18:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-02-05 20:18:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-02-05 20:18:05 [WARNING ] (13, 1, 'bot')
2019-02-05 20:18:05 [WARNING ] (13, 1, 'bot')
2019-02-05 20:18:05 [WARNING ] (13, 1, 'bot')
2019-02-05 20:18:05 [WARNING ] (13, 1, 'bot')
2019-02-05 20:18:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:18:05 [DEBUG   ] Finished updating board flags in 1.365 seconds
2019-02-05 20:18:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:18:24 [DEBUG   ] Got command BAM from MCS: ref #1412886
2019-02-05 20:18:24 [INFO    ] Finished processing BAM request
2019-02-05 20:18:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:18:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412886   8 58519 73104029 A  ERROR'
2019-02-05 20:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 20:18:24 [DEBUG   ] spawn_process: at 2019-02-05 20:18:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 20:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 20:18:24 [DEBUG   ] spawn_process: at 2019-02-05 20:18:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 20:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 20:18:24 [DEBUG   ] spawn_process: at 2019-02-05 20:18:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 20:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 20:18:24 [DEBUG   ] spawn_process: at 2019-02-05 20:18:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 20:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 20:18:24 [DEBUG   ] spawn_process: at 2019-02-05 20:18:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 20:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 20:18:24 [DEBUG   ] spawn_process: at 2019-02-05 20:18:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 20:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 20:18:24 [DEBUG   ] spawn_process: at 2019-02-05 20:18:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 20:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 20:18:24 [DEBUG   ] spawn_process: at 2019-02-05 20:18:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 20:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 20:18:24 [DEBUG   ] spawn_process: at 2019-02-05 20:18:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 20:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 20:18:24 [DEBUG   ] spawn_process: at 2019-02-05 20:18:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 20:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 20:18:24 [DEBUG   ] spawn_process: at 2019-02-05 20:18:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 20:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 20:18:24 [DEBUG   ] spawn_process: at 2019-02-05 20:18:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 20:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 20:18:24 [DEBUG   ] spawn_process: at 2019-02-05 20:18:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 20:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 20:18:24 [DEBUG   ] spawn_process: at 2019-02-05 20:18:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 20:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 20:18:24 [DEBUG   ] spawn_process: at 2019-02-05 20:18:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 20:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 20:18:24 [DEBUG   ] spawn_process: at 2019-02-05 20:18:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 20:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 20:18:24 [DEBUG   ] spawn_process: at 2019-02-05 20:18:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 20:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 20:18:24 [DEBUG   ] spawn_process: at 2019-02-05 20:18:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 20:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 20:18:24 [DEBUG   ] spawn_process: at 2019-02-05 20:18:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 20:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 20:18:24 [DEBUG   ] spawn_process: at 2019-02-05 20:18:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 20:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 20:18:24 [DEBUG   ] spawn_process: at 2019-02-05 20:18:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 20:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 20:18:24 [DEBUG   ] spawn_process: at 2019-02-05 20:18:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 20:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 20:18:24 [DEBUG   ] spawn_process: at 2019-02-05 20:18:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 20:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 20:18:24 [DEBUG   ] spawn_process: at 2019-02-05 20:18:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 20:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 20:18:24 [DEBUG   ] spawn_process: at 2019-02-05 20:18:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 20:18:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 20:18:24 [DEBUG   ] spawn_process: at 2019-02-05 20:18:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 20:18:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:18:58 [DEBUG   ] Got command BAM from MCS: ref #1412887
2019-02-05 20:18:58 [INFO    ] Finished processing BAM request
2019-02-05 20:18:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:18:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412887   8 58519 73138033 A  ERROR'
2019-02-05 20:18:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 20:18:58 [DEBUG   ] spawn_process: at 2019-02-05 20:18:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 20:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 20:18:58 [DEBUG   ] spawn_process: at 2019-02-05 20:18:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 20:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 20:18:58 [DEBUG   ] spawn_process: at 2019-02-05 20:18:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 20:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 20:18:58 [DEBUG   ] spawn_process: at 2019-02-05 20:18:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 20:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 20:18:58 [DEBUG   ] spawn_process: at 2019-02-05 20:18:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 20:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 20:18:58 [DEBUG   ] spawn_process: at 2019-02-05 20:18:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 20:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 20:18:58 [DEBUG   ] spawn_process: at 2019-02-05 20:18:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 20:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 20:18:58 [DEBUG   ] spawn_process: at 2019-02-05 20:18:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 20:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 20:18:58 [DEBUG   ] spawn_process: at 2019-02-05 20:18:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 20:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 20:18:58 [DEBUG   ] spawn_process: at 2019-02-05 20:18:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 20:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 20:18:58 [DEBUG   ] spawn_process: at 2019-02-05 20:18:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 20:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 20:18:58 [DEBUG   ] spawn_process: at 2019-02-05 20:18:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 20:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 20:18:58 [DEBUG   ] spawn_process: at 2019-02-05 20:18:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 20:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 20:18:58 [DEBUG   ] spawn_process: at 2019-02-05 20:18:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 20:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 20:18:58 [DEBUG   ] spawn_process: at 2019-02-05 20:18:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 20:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 20:18:58 [DEBUG   ] spawn_process: at 2019-02-05 20:18:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 20:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 20:18:58 [DEBUG   ] spawn_process: at 2019-02-05 20:18:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 20:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 20:18:58 [DEBUG   ] spawn_process: at 2019-02-05 20:18:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 20:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 20:18:58 [DEBUG   ] spawn_process: at 2019-02-05 20:18:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 20:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 20:18:58 [DEBUG   ] spawn_process: at 2019-02-05 20:18:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 20:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 20:18:58 [DEBUG   ] spawn_process: at 2019-02-05 20:18:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 20:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 20:18:58 [DEBUG   ] spawn_process: at 2019-02-05 20:18:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 20:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 20:18:58 [DEBUG   ] spawn_process: at 2019-02-05 20:18:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 20:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 20:18:58 [DEBUG   ] spawn_process: at 2019-02-05 20:18:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 20:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 20:18:58 [DEBUG   ] spawn_process: at 2019-02-05 20:18:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 20:18:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 20:18:58 [DEBUG   ] spawn_process: at 2019-02-05 20:18:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 20:19:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 20:19:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-02-05 20:19:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:19:05 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-02-05 20:19:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-02-05 20:19:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-05 20:19:05 [WARNING ] (13, 1, 'bot')
2019-02-05 20:19:05 [WARNING ] (13, 1, 'bot')
2019-02-05 20:19:05 [WARNING ] (13, 1, 'bot')
2019-02-05 20:19:05 [WARNING ] (13, 1, 'bot')
2019-02-05 20:19:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:19:05 [DEBUG   ] Finished updating board flags in 1.197 seconds
2019-02-05 20:19:16 [DEBUG   ] Got command BAM from MCS: ref #1412888
2019-02-05 20:19:16 [INFO    ] Finished processing BAM request
2019-02-05 20:19:16 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:19:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412888   8 58519 73156029 A  ERROR'
2019-02-05 20:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-02-05 20:19:16 [DEBUG   ] spawn_process: at 2019-02-05 20:19:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-02-05 20:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-02-05 20:19:16 [DEBUG   ] spawn_process: at 2019-02-05 20:19:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-02-05 20:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-02-05 20:19:16 [DEBUG   ] spawn_process: at 2019-02-05 20:19:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-02-05 20:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-02-05 20:19:16 [DEBUG   ] spawn_process: at 2019-02-05 20:19:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-02-05 20:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-02-05 20:19:16 [DEBUG   ] spawn_process: at 2019-02-05 20:19:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-02-05 20:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-02-05 20:19:16 [DEBUG   ] spawn_process: at 2019-02-05 20:19:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-02-05 20:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-02-05 20:19:16 [DEBUG   ] spawn_process: at 2019-02-05 20:19:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-02-05 20:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-02-05 20:19:16 [DEBUG   ] spawn_process: at 2019-02-05 20:19:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-02-05 20:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-02-05 20:19:16 [DEBUG   ] spawn_process: at 2019-02-05 20:19:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-02-05 20:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-02-05 20:19:16 [DEBUG   ] spawn_process: at 2019-02-05 20:19:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-02-05 20:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-02-05 20:19:16 [DEBUG   ] spawn_process: at 2019-02-05 20:19:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-02-05 20:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-02-05 20:19:16 [DEBUG   ] spawn_process: at 2019-02-05 20:19:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-02-05 20:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-02-05 20:19:16 [DEBUG   ] spawn_process: at 2019-02-05 20:19:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-02-05 20:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-02-05 20:19:16 [DEBUG   ] spawn_process: at 2019-02-05 20:19:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-02-05 20:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-02-05 20:19:16 [DEBUG   ] spawn_process: at 2019-02-05 20:19:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-02-05 20:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-02-05 20:19:16 [DEBUG   ] spawn_process: at 2019-02-05 20:19:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-02-05 20:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-02-05 20:19:16 [DEBUG   ] spawn_process: at 2019-02-05 20:19:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-02-05 20:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-02-05 20:19:16 [DEBUG   ] spawn_process: at 2019-02-05 20:19:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-02-05 20:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-02-05 20:19:16 [DEBUG   ] spawn_process: at 2019-02-05 20:19:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-02-05 20:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-02-05 20:19:16 [DEBUG   ] spawn_process: at 2019-02-05 20:19:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-02-05 20:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-02-05 20:19:16 [DEBUG   ] spawn_process: at 2019-02-05 20:19:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-02-05 20:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-02-05 20:19:16 [DEBUG   ] spawn_process: at 2019-02-05 20:19:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-02-05 20:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-02-05 20:19:16 [DEBUG   ] spawn_process: at 2019-02-05 20:19:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-02-05 20:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-02-05 20:19:16 [DEBUG   ] spawn_process: at 2019-02-05 20:19:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-02-05 20:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-02-05 20:19:16 [DEBUG   ] spawn_process: at 2019-02-05 20:19:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-02-05 20:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-02-05 20:19:16 [DEBUG   ] spawn_process: at 2019-02-05 20:19:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-02-05 20:19:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-05 20:19:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:19:56 [DEBUG   ] Got command RPT from MCS: ref #1412889
2019-02-05 20:19:56 [DEBUG   ] summary = ERROR
2019-02-05 20:19:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412889  13 58519 73196637 A  ERRORERROR'
2019-02-05 20:19:56 [DEBUG   ] Got command RPT from MCS: ref #1412890
2019-02-05 20:19:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 20:19:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412890  77 58519 73196841 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 20:19:57 [DEBUG   ] Got command RPT from MCS: ref #1412891
2019-02-05 20:19:57 [DEBUG   ] summary = ERROR
2019-02-05 20:19:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412891  13 58519 73197045 A  ERRORERROR'
2019-02-05 20:19:57 [DEBUG   ] Got command RPT from MCS: ref #1412892
2019-02-05 20:19:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 20:19:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412892  77 58519 73197249 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 20:19:57 [DEBUG   ] Got command RPT from MCS: ref #1412893
2019-02-05 20:19:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 20:19:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412893  12 58519 73197441 A  ERRORB¤ff'
2019-02-05 20:19:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:20:02 [DEBUG   ] Got command BAM from MCS: ref #1412894
2019-02-05 20:20:02 [INFO    ] Finished processing BAM request
2019-02-05 20:20:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:20:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412894   8 58519 73202025 A  ERROR'
2019-02-05 20:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 20:20:02 [DEBUG   ] spawn_process: at 2019-02-05 20:20:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 20:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 20:20:02 [DEBUG   ] spawn_process: at 2019-02-05 20:20:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 20:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 20:20:02 [DEBUG   ] spawn_process: at 2019-02-05 20:20:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 20:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 20:20:02 [DEBUG   ] spawn_process: at 2019-02-05 20:20:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 20:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 20:20:02 [DEBUG   ] spawn_process: at 2019-02-05 20:20:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 20:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 20:20:02 [DEBUG   ] spawn_process: at 2019-02-05 20:20:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 20:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 20:20:02 [DEBUG   ] spawn_process: at 2019-02-05 20:20:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 20:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 20:20:02 [DEBUG   ] spawn_process: at 2019-02-05 20:20:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 20:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 20:20:02 [DEBUG   ] spawn_process: at 2019-02-05 20:20:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 20:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 20:20:02 [DEBUG   ] spawn_process: at 2019-02-05 20:20:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 20:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 20:20:02 [DEBUG   ] spawn_process: at 2019-02-05 20:20:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 20:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 20:20:02 [DEBUG   ] spawn_process: at 2019-02-05 20:20:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 20:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 20:20:02 [DEBUG   ] spawn_process: at 2019-02-05 20:20:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 20:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 20:20:02 [DEBUG   ] spawn_process: at 2019-02-05 20:20:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 20:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 20:20:02 [DEBUG   ] spawn_process: at 2019-02-05 20:20:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 20:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 20:20:02 [DEBUG   ] spawn_process: at 2019-02-05 20:20:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 20:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 20:20:02 [DEBUG   ] spawn_process: at 2019-02-05 20:20:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 20:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 20:20:02 [DEBUG   ] spawn_process: at 2019-02-05 20:20:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 20:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 20:20:02 [DEBUG   ] spawn_process: at 2019-02-05 20:20:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 20:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 20:20:02 [DEBUG   ] spawn_process: at 2019-02-05 20:20:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 20:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 20:20:02 [DEBUG   ] spawn_process: at 2019-02-05 20:20:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 20:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 20:20:02 [DEBUG   ] spawn_process: at 2019-02-05 20:20:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 20:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 20:20:02 [DEBUG   ] spawn_process: at 2019-02-05 20:20:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 20:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 20:20:02 [DEBUG   ] spawn_process: at 2019-02-05 20:20:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 20:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 20:20:02 [DEBUG   ] spawn_process: at 2019-02-05 20:20:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 20:20:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 20:20:02 [DEBUG   ] spawn_process: at 2019-02-05 20:20:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 20:20:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-02-05 20:20:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:20:05 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-02-05 20:20:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-05 20:20:05 [WARNING ] (13, 1, 'bot')
2019-02-05 20:20:05 [WARNING ] (13, 1, 'bot')
2019-02-05 20:20:05 [WARNING ] (13, 1, 'bot')
2019-02-05 20:20:05 [WARNING ] (13, 1, 'bot')
2019-02-05 20:20:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:20:05 [DEBUG   ] Finished updating board flags in 1.004 seconds
2019-02-05 20:20:08 [DEBUG   ] Got command BAM from MCS: ref #1412895
2019-02-05 20:20:08 [INFO    ] Finished processing BAM request
2019-02-05 20:20:08 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:20:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412895   8 58519 73208037 A  ERROR'
2019-02-05 20:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-02-05 20:20:08 [DEBUG   ] spawn_process: at 2019-02-05 20:20:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-02-05 20:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-02-05 20:20:08 [DEBUG   ] spawn_process: at 2019-02-05 20:20:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-02-05 20:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-02-05 20:20:08 [DEBUG   ] spawn_process: at 2019-02-05 20:20:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-02-05 20:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-02-05 20:20:08 [DEBUG   ] spawn_process: at 2019-02-05 20:20:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-02-05 20:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-02-05 20:20:08 [DEBUG   ] spawn_process: at 2019-02-05 20:20:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-02-05 20:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-02-05 20:20:08 [DEBUG   ] spawn_process: at 2019-02-05 20:20:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-02-05 20:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-02-05 20:20:08 [DEBUG   ] spawn_process: at 2019-02-05 20:20:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-02-05 20:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-02-05 20:20:08 [DEBUG   ] spawn_process: at 2019-02-05 20:20:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-02-05 20:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-02-05 20:20:08 [DEBUG   ] spawn_process: at 2019-02-05 20:20:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-02-05 20:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-02-05 20:20:08 [DEBUG   ] spawn_process: at 2019-02-05 20:20:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-02-05 20:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-02-05 20:20:08 [DEBUG   ] spawn_process: at 2019-02-05 20:20:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-02-05 20:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-02-05 20:20:08 [DEBUG   ] spawn_process: at 2019-02-05 20:20:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-02-05 20:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-02-05 20:20:08 [DEBUG   ] spawn_process: at 2019-02-05 20:20:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-02-05 20:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-02-05 20:20:08 [DEBUG   ] spawn_process: at 2019-02-05 20:20:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-02-05 20:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-02-05 20:20:08 [DEBUG   ] spawn_process: at 2019-02-05 20:20:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-02-05 20:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-02-05 20:20:08 [DEBUG   ] spawn_process: at 2019-02-05 20:20:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-02-05 20:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-02-05 20:20:08 [DEBUG   ] spawn_process: at 2019-02-05 20:20:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-02-05 20:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-02-05 20:20:08 [DEBUG   ] spawn_process: at 2019-02-05 20:20:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-02-05 20:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-02-05 20:20:08 [DEBUG   ] spawn_process: at 2019-02-05 20:20:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-02-05 20:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-02-05 20:20:08 [DEBUG   ] spawn_process: at 2019-02-05 20:20:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-02-05 20:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-02-05 20:20:08 [DEBUG   ] spawn_process: at 2019-02-05 20:20:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-02-05 20:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-02-05 20:20:08 [DEBUG   ] spawn_process: at 2019-02-05 20:20:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-02-05 20:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-02-05 20:20:08 [DEBUG   ] spawn_process: at 2019-02-05 20:20:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-02-05 20:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-02-05 20:20:08 [DEBUG   ] spawn_process: at 2019-02-05 20:20:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-02-05 20:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-02-05 20:20:08 [DEBUG   ] spawn_process: at 2019-02-05 20:20:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-02-05 20:20:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-02-05 20:20:08 [DEBUG   ] spawn_process: at 2019-02-05 20:20:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-02-05 20:20:18 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-05 20:20:38 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 20:20:58 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 20:21:00 [DEBUG   ] Got command BAM from MCS: ref #1412900
2019-02-05 20:21:00 [INFO    ] Finished processing BAM request
2019-02-05 20:21:00 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:21:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412900   8 58519 73260029 A  ERROR'
2019-02-05 20:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 20:21:00 [DEBUG   ] spawn_process: at 2019-02-05 20:21:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 20:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 20:21:00 [DEBUG   ] spawn_process: at 2019-02-05 20:21:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 20:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 20:21:00 [DEBUG   ] spawn_process: at 2019-02-05 20:21:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 20:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 20:21:00 [DEBUG   ] spawn_process: at 2019-02-05 20:21:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 20:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 20:21:00 [DEBUG   ] spawn_process: at 2019-02-05 20:21:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 20:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 20:21:00 [DEBUG   ] spawn_process: at 2019-02-05 20:21:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 20:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 20:21:00 [DEBUG   ] spawn_process: at 2019-02-05 20:21:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 20:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 20:21:00 [DEBUG   ] spawn_process: at 2019-02-05 20:21:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 20:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 20:21:00 [DEBUG   ] spawn_process: at 2019-02-05 20:21:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 20:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 20:21:00 [DEBUG   ] spawn_process: at 2019-02-05 20:21:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 20:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 20:21:00 [DEBUG   ] spawn_process: at 2019-02-05 20:21:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 20:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 20:21:00 [DEBUG   ] spawn_process: at 2019-02-05 20:21:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 20:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 20:21:00 [DEBUG   ] spawn_process: at 2019-02-05 20:21:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 20:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 20:21:00 [DEBUG   ] spawn_process: at 2019-02-05 20:21:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 20:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 20:21:00 [DEBUG   ] spawn_process: at 2019-02-05 20:21:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 20:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 20:21:00 [DEBUG   ] spawn_process: at 2019-02-05 20:21:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 20:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 20:21:00 [DEBUG   ] spawn_process: at 2019-02-05 20:21:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 20:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 20:21:00 [DEBUG   ] spawn_process: at 2019-02-05 20:21:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 20:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 20:21:00 [DEBUG   ] spawn_process: at 2019-02-05 20:21:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 20:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 20:21:00 [DEBUG   ] spawn_process: at 2019-02-05 20:21:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 20:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 20:21:00 [DEBUG   ] spawn_process: at 2019-02-05 20:21:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 20:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 20:21:00 [DEBUG   ] spawn_process: at 2019-02-05 20:21:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 20:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 20:21:00 [DEBUG   ] spawn_process: at 2019-02-05 20:21:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 20:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 20:21:00 [DEBUG   ] spawn_process: at 2019-02-05 20:21:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 20:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 20:21:00 [DEBUG   ] spawn_process: at 2019-02-05 20:21:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 20:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 20:21:00 [DEBUG   ] spawn_process: at 2019-02-05 20:21:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 20:21:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 20:21:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-02-05 20:21:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:21:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-02-05 20:21:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-05 20:21:05 [WARNING ] (13, 1, 'bot')
2019-02-05 20:21:05 [WARNING ] (13, 1, 'bot')
2019-02-05 20:21:05 [WARNING ] (13, 1, 'bot')
2019-02-05 20:21:05 [WARNING ] (13, 1, 'bot')
2019-02-05 20:21:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:21:05 [DEBUG   ] Finished updating board flags in 1.078 seconds
2019-02-05 20:21:06 [DEBUG   ] Got command BAM from MCS: ref #1412901
2019-02-05 20:21:06 [INFO    ] Finished processing BAM request
2019-02-05 20:21:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:21:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412901   8 58519 73266033 A  ERROR'
2019-02-05 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 20:21:06 [DEBUG   ] spawn_process: at 2019-02-05 20:21:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 20:21:06 [DEBUG   ] spawn_process: at 2019-02-05 20:21:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 20:21:06 [DEBUG   ] spawn_process: at 2019-02-05 20:21:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 20:21:06 [DEBUG   ] spawn_process: at 2019-02-05 20:21:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 20:21:06 [DEBUG   ] spawn_process: at 2019-02-05 20:21:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 20:21:06 [DEBUG   ] spawn_process: at 2019-02-05 20:21:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 20:21:06 [DEBUG   ] spawn_process: at 2019-02-05 20:21:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 20:21:06 [DEBUG   ] spawn_process: at 2019-02-05 20:21:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 20:21:06 [DEBUG   ] spawn_process: at 2019-02-05 20:21:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 20:21:06 [DEBUG   ] spawn_process: at 2019-02-05 20:21:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 20:21:06 [DEBUG   ] spawn_process: at 2019-02-05 20:21:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 20:21:06 [DEBUG   ] spawn_process: at 2019-02-05 20:21:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 20:21:06 [DEBUG   ] spawn_process: at 2019-02-05 20:21:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 20:21:06 [DEBUG   ] spawn_process: at 2019-02-05 20:21:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 20:21:06 [DEBUG   ] spawn_process: at 2019-02-05 20:21:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 20:21:06 [DEBUG   ] spawn_process: at 2019-02-05 20:21:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 20:21:06 [DEBUG   ] spawn_process: at 2019-02-05 20:21:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 20:21:06 [DEBUG   ] spawn_process: at 2019-02-05 20:21:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 20:21:06 [DEBUG   ] spawn_process: at 2019-02-05 20:21:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 20:21:06 [DEBUG   ] spawn_process: at 2019-02-05 20:21:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 20:21:06 [DEBUG   ] spawn_process: at 2019-02-05 20:21:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 20:21:06 [DEBUG   ] spawn_process: at 2019-02-05 20:21:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 20:21:06 [DEBUG   ] spawn_process: at 2019-02-05 20:21:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 20:21:06 [DEBUG   ] spawn_process: at 2019-02-05 20:21:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 20:21:06 [DEBUG   ] spawn_process: at 2019-02-05 20:21:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 20:21:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 20:21:06 [DEBUG   ] spawn_process: at 2019-02-05 20:21:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 20:21:12 [DEBUG   ] Got command RPT from MCS: ref #1412902
2019-02-05 20:21:12 [DEBUG   ] summary = ERROR
2019-02-05 20:21:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412902  13 58519 73272025 A  ERRORERROR'
2019-02-05 20:21:12 [DEBUG   ] Got command RPT from MCS: ref #1412903
2019-02-05 20:21:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 20:21:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412903  77 58519 73272026 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 20:21:18 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 20:21:38 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 20:21:51 [DEBUG   ] Got command BAM from MCS: ref #1412919
2019-02-05 20:21:51 [INFO    ] Finished processing BAM request
2019-02-05 20:21:51 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:21:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412919   8 58519 73311033 A  ERROR'
2019-02-05 20:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-02-05 20:21:51 [DEBUG   ] spawn_process: at 2019-02-05 20:21:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-02-05 20:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-02-05 20:21:51 [DEBUG   ] spawn_process: at 2019-02-05 20:21:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-02-05 20:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-02-05 20:21:51 [DEBUG   ] spawn_process: at 2019-02-05 20:21:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-02-05 20:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-02-05 20:21:51 [DEBUG   ] spawn_process: at 2019-02-05 20:21:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-02-05 20:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-02-05 20:21:51 [DEBUG   ] spawn_process: at 2019-02-05 20:21:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-02-05 20:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-02-05 20:21:51 [DEBUG   ] spawn_process: at 2019-02-05 20:21:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-02-05 20:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-02-05 20:21:51 [DEBUG   ] spawn_process: at 2019-02-05 20:21:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-02-05 20:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-02-05 20:21:51 [DEBUG   ] spawn_process: at 2019-02-05 20:21:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-02-05 20:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-02-05 20:21:51 [DEBUG   ] spawn_process: at 2019-02-05 20:21:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-02-05 20:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-02-05 20:21:51 [DEBUG   ] spawn_process: at 2019-02-05 20:21:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-02-05 20:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-02-05 20:21:51 [DEBUG   ] spawn_process: at 2019-02-05 20:21:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-02-05 20:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-02-05 20:21:51 [DEBUG   ] spawn_process: at 2019-02-05 20:21:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-02-05 20:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-02-05 20:21:51 [DEBUG   ] spawn_process: at 2019-02-05 20:21:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-02-05 20:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-02-05 20:21:51 [DEBUG   ] spawn_process: at 2019-02-05 20:21:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-02-05 20:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-02-05 20:21:51 [DEBUG   ] spawn_process: at 2019-02-05 20:21:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-02-05 20:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-02-05 20:21:51 [DEBUG   ] spawn_process: at 2019-02-05 20:21:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-02-05 20:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-02-05 20:21:51 [DEBUG   ] spawn_process: at 2019-02-05 20:21:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-02-05 20:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-02-05 20:21:51 [DEBUG   ] spawn_process: at 2019-02-05 20:21:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-02-05 20:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-02-05 20:21:51 [DEBUG   ] spawn_process: at 2019-02-05 20:21:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-02-05 20:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-02-05 20:21:51 [DEBUG   ] spawn_process: at 2019-02-05 20:21:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-02-05 20:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-02-05 20:21:51 [DEBUG   ] spawn_process: at 2019-02-05 20:21:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-02-05 20:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-02-05 20:21:51 [DEBUG   ] spawn_process: at 2019-02-05 20:21:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-02-05 20:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-02-05 20:21:51 [DEBUG   ] spawn_process: at 2019-02-05 20:21:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-02-05 20:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-02-05 20:21:51 [DEBUG   ] spawn_process: at 2019-02-05 20:21:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-02-05 20:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-02-05 20:21:51 [DEBUG   ] spawn_process: at 2019-02-05 20:21:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-02-05 20:21:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-02-05 20:21:51 [DEBUG   ] spawn_process: at 2019-02-05 20:21:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-02-05 20:21:58 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 20:22:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:22:06 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-02-05 20:22:06 [WARNING ] (13, 1, 'bot')
2019-02-05 20:22:06 [WARNING ] (13, 1, 'bot')
2019-02-05 20:22:06 [WARNING ] (13, 1, 'bot')
2019-02-05 20:22:06 [WARNING ] (13, 1, 'bot')
2019-02-05 20:22:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:22:06 [DEBUG   ] Finished updating board flags in 2.016 seconds
2019-02-05 20:22:10 [DEBUG   ] Got command BAM from MCS: ref #1412920
2019-02-05 20:22:10 [INFO    ] Finished processing BAM request
2019-02-05 20:22:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:22:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412920   8 58519 73330025 A  ERROR'
2019-02-05 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 20:22:10 [DEBUG   ] spawn_process: at 2019-02-05 20:22:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 20:22:10 [DEBUG   ] spawn_process: at 2019-02-05 20:22:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 20:22:10 [DEBUG   ] spawn_process: at 2019-02-05 20:22:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 20:22:10 [DEBUG   ] spawn_process: at 2019-02-05 20:22:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 20:22:10 [DEBUG   ] spawn_process: at 2019-02-05 20:22:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 20:22:10 [DEBUG   ] spawn_process: at 2019-02-05 20:22:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 20:22:10 [DEBUG   ] spawn_process: at 2019-02-05 20:22:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 20:22:10 [DEBUG   ] spawn_process: at 2019-02-05 20:22:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 20:22:10 [DEBUG   ] spawn_process: at 2019-02-05 20:22:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 20:22:10 [DEBUG   ] spawn_process: at 2019-02-05 20:22:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 20:22:10 [DEBUG   ] spawn_process: at 2019-02-05 20:22:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 20:22:10 [DEBUG   ] spawn_process: at 2019-02-05 20:22:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 20:22:10 [DEBUG   ] spawn_process: at 2019-02-05 20:22:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 20:22:10 [DEBUG   ] spawn_process: at 2019-02-05 20:22:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 20:22:10 [DEBUG   ] spawn_process: at 2019-02-05 20:22:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 20:22:10 [DEBUG   ] spawn_process: at 2019-02-05 20:22:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 20:22:10 [DEBUG   ] spawn_process: at 2019-02-05 20:22:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 20:22:10 [DEBUG   ] spawn_process: at 2019-02-05 20:22:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 20:22:10 [DEBUG   ] spawn_process: at 2019-02-05 20:22:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 20:22:10 [DEBUG   ] spawn_process: at 2019-02-05 20:22:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 20:22:10 [DEBUG   ] spawn_process: at 2019-02-05 20:22:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 20:22:10 [DEBUG   ] spawn_process: at 2019-02-05 20:22:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 20:22:10 [DEBUG   ] spawn_process: at 2019-02-05 20:22:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 20:22:10 [DEBUG   ] spawn_process: at 2019-02-05 20:22:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 20:22:10 [DEBUG   ] spawn_process: at 2019-02-05 20:22:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 20:22:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 20:22:10 [DEBUG   ] spawn_process: at 2019-02-05 20:22:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 20:22:18 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 20:22:38 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 20:22:42 [DEBUG   ] Got command BAM from MCS: ref #1412921
2019-02-05 20:22:42 [INFO    ] Finished processing BAM request
2019-02-05 20:22:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:22:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412921   8 58519 73362033 A  ERROR'
2019-02-05 20:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-02-05 20:22:42 [DEBUG   ] spawn_process: at 2019-02-05 20:22:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-02-05 20:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-02-05 20:22:42 [DEBUG   ] spawn_process: at 2019-02-05 20:22:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-02-05 20:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-02-05 20:22:42 [DEBUG   ] spawn_process: at 2019-02-05 20:22:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-02-05 20:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-02-05 20:22:42 [DEBUG   ] spawn_process: at 2019-02-05 20:22:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-02-05 20:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-02-05 20:22:42 [DEBUG   ] spawn_process: at 2019-02-05 20:22:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-02-05 20:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-02-05 20:22:42 [DEBUG   ] spawn_process: at 2019-02-05 20:22:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-02-05 20:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-02-05 20:22:42 [DEBUG   ] spawn_process: at 2019-02-05 20:22:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-02-05 20:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-02-05 20:22:42 [DEBUG   ] spawn_process: at 2019-02-05 20:22:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-02-05 20:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-02-05 20:22:42 [DEBUG   ] spawn_process: at 2019-02-05 20:22:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-02-05 20:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-02-05 20:22:42 [DEBUG   ] spawn_process: at 2019-02-05 20:22:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-02-05 20:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-02-05 20:22:42 [DEBUG   ] spawn_process: at 2019-02-05 20:22:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-02-05 20:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-02-05 20:22:42 [DEBUG   ] spawn_process: at 2019-02-05 20:22:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-02-05 20:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-02-05 20:22:42 [DEBUG   ] spawn_process: at 2019-02-05 20:22:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-02-05 20:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-02-05 20:22:42 [DEBUG   ] spawn_process: at 2019-02-05 20:22:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-02-05 20:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-02-05 20:22:42 [DEBUG   ] spawn_process: at 2019-02-05 20:22:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-02-05 20:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-02-05 20:22:42 [DEBUG   ] spawn_process: at 2019-02-05 20:22:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-02-05 20:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-02-05 20:22:42 [DEBUG   ] spawn_process: at 2019-02-05 20:22:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-02-05 20:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-02-05 20:22:42 [DEBUG   ] spawn_process: at 2019-02-05 20:22:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-02-05 20:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-02-05 20:22:42 [DEBUG   ] spawn_process: at 2019-02-05 20:22:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-02-05 20:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-02-05 20:22:42 [DEBUG   ] spawn_process: at 2019-02-05 20:22:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-02-05 20:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-02-05 20:22:42 [DEBUG   ] spawn_process: at 2019-02-05 20:22:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-02-05 20:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-02-05 20:22:42 [DEBUG   ] spawn_process: at 2019-02-05 20:22:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-02-05 20:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-02-05 20:22:42 [DEBUG   ] spawn_process: at 2019-02-05 20:22:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-02-05 20:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-02-05 20:22:42 [DEBUG   ] spawn_process: at 2019-02-05 20:22:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-02-05 20:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-02-05 20:22:42 [DEBUG   ] spawn_process: at 2019-02-05 20:22:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-02-05 20:22:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-02-05 20:22:42 [DEBUG   ] spawn_process: at 2019-02-05 20:22:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-02-05 20:22:58 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 20:23:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-02-05 20:23:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:23:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 20:23:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-02-05 20:23:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-05 20:23:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-02-05 20:23:05 [WARNING ] (13, 1, 'bot')
2019-02-05 20:23:05 [WARNING ] (13, 1, 'bot')
2019-02-05 20:23:05 [WARNING ] (13, 1, 'bot')
2019-02-05 20:23:05 [WARNING ] (13, 1, 'bot')
2019-02-05 20:23:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:23:05 [DEBUG   ] Finished updating board flags in 1.349 seconds
2019-02-05 20:23:14 [DEBUG   ] Got command BAM from MCS: ref #1412922
2019-02-05 20:23:14 [INFO    ] Finished processing BAM request
2019-02-05 20:23:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:23:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412922   8 58519 73394029 A  ERROR'
2019-02-05 20:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 20:23:14 [DEBUG   ] spawn_process: at 2019-02-05 20:23:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 20:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 20:23:14 [DEBUG   ] spawn_process: at 2019-02-05 20:23:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 20:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 20:23:14 [DEBUG   ] spawn_process: at 2019-02-05 20:23:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 20:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 20:23:14 [DEBUG   ] spawn_process: at 2019-02-05 20:23:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 20:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 20:23:14 [DEBUG   ] spawn_process: at 2019-02-05 20:23:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 20:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 20:23:14 [DEBUG   ] spawn_process: at 2019-02-05 20:23:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 20:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 20:23:14 [DEBUG   ] spawn_process: at 2019-02-05 20:23:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 20:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 20:23:14 [DEBUG   ] spawn_process: at 2019-02-05 20:23:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 20:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 20:23:14 [DEBUG   ] spawn_process: at 2019-02-05 20:23:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 20:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 20:23:14 [DEBUG   ] spawn_process: at 2019-02-05 20:23:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 20:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 20:23:14 [DEBUG   ] spawn_process: at 2019-02-05 20:23:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 20:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 20:23:14 [DEBUG   ] spawn_process: at 2019-02-05 20:23:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 20:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 20:23:14 [DEBUG   ] spawn_process: at 2019-02-05 20:23:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 20:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 20:23:14 [DEBUG   ] spawn_process: at 2019-02-05 20:23:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 20:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 20:23:14 [DEBUG   ] spawn_process: at 2019-02-05 20:23:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 20:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 20:23:14 [DEBUG   ] spawn_process: at 2019-02-05 20:23:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 20:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 20:23:14 [DEBUG   ] spawn_process: at 2019-02-05 20:23:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 20:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 20:23:14 [DEBUG   ] spawn_process: at 2019-02-05 20:23:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 20:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 20:23:14 [DEBUG   ] spawn_process: at 2019-02-05 20:23:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 20:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 20:23:14 [DEBUG   ] spawn_process: at 2019-02-05 20:23:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 20:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 20:23:14 [DEBUG   ] spawn_process: at 2019-02-05 20:23:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 20:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 20:23:14 [DEBUG   ] spawn_process: at 2019-02-05 20:23:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 20:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 20:23:14 [DEBUG   ] spawn_process: at 2019-02-05 20:23:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 20:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 20:23:14 [DEBUG   ] spawn_process: at 2019-02-05 20:23:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 20:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 20:23:14 [DEBUG   ] spawn_process: at 2019-02-05 20:23:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 20:23:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 20:23:14 [DEBUG   ] spawn_process: at 2019-02-05 20:23:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 20:23:18 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 20:23:33 [DEBUG   ] Got command BAM from MCS: ref #1412927
2019-02-05 20:23:33 [INFO    ] Finished processing BAM request
2019-02-05 20:23:33 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:23:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412927   8 58519 73413033 A  ERROR'
2019-02-05 20:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 20:23:33 [DEBUG   ] spawn_process: at 2019-02-05 20:23:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 20:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 20:23:33 [DEBUG   ] spawn_process: at 2019-02-05 20:23:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 20:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 20:23:33 [DEBUG   ] spawn_process: at 2019-02-05 20:23:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 20:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 20:23:33 [DEBUG   ] spawn_process: at 2019-02-05 20:23:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 20:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 20:23:33 [DEBUG   ] spawn_process: at 2019-02-05 20:23:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 20:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 20:23:33 [DEBUG   ] spawn_process: at 2019-02-05 20:23:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 20:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 20:23:33 [DEBUG   ] spawn_process: at 2019-02-05 20:23:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 20:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 20:23:33 [DEBUG   ] spawn_process: at 2019-02-05 20:23:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 20:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 20:23:33 [DEBUG   ] spawn_process: at 2019-02-05 20:23:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 20:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 20:23:33 [DEBUG   ] spawn_process: at 2019-02-05 20:23:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 20:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 20:23:33 [DEBUG   ] spawn_process: at 2019-02-05 20:23:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 20:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 20:23:33 [DEBUG   ] spawn_process: at 2019-02-05 20:23:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 20:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 20:23:33 [DEBUG   ] spawn_process: at 2019-02-05 20:23:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 20:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 20:23:33 [DEBUG   ] spawn_process: at 2019-02-05 20:23:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 20:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 20:23:33 [DEBUG   ] spawn_process: at 2019-02-05 20:23:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 20:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 20:23:33 [DEBUG   ] spawn_process: at 2019-02-05 20:23:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 20:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 20:23:33 [DEBUG   ] spawn_process: at 2019-02-05 20:23:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 20:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 20:23:33 [DEBUG   ] spawn_process: at 2019-02-05 20:23:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 20:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 20:23:33 [DEBUG   ] spawn_process: at 2019-02-05 20:23:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 20:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 20:23:33 [DEBUG   ] spawn_process: at 2019-02-05 20:23:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 20:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 20:23:33 [DEBUG   ] spawn_process: at 2019-02-05 20:23:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 20:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 20:23:33 [DEBUG   ] spawn_process: at 2019-02-05 20:23:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 20:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 20:23:33 [DEBUG   ] spawn_process: at 2019-02-05 20:23:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 20:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 20:23:33 [DEBUG   ] spawn_process: at 2019-02-05 20:23:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 20:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 20:23:33 [DEBUG   ] spawn_process: at 2019-02-05 20:23:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 20:23:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 20:23:33 [DEBUG   ] spawn_process: at 2019-02-05 20:23:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 20:23:38 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 20:23:58 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 20:24:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-02-05 20:24:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:24:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-02-05 20:24:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 20:24:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-02-05 20:24:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-02-05 20:24:05 [WARNING ] (13, 1, 'bot')
2019-02-05 20:24:05 [WARNING ] (13, 1, 'bot')
2019-02-05 20:24:05 [WARNING ] (13, 1, 'bot')
2019-02-05 20:24:05 [WARNING ] (13, 1, 'bot')
2019-02-05 20:24:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:24:05 [DEBUG   ] Finished updating board flags in 1.224 seconds
2019-02-05 20:24:18 [DEBUG   ] Got command BAM from MCS: ref #1412928
2019-02-05 20:24:18 [INFO    ] Finished processing BAM request
2019-02-05 20:24:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:24:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412928   8 58519 73458025 A  ERROR'
2019-02-05 20:24:18 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 20:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 20:24:18 [DEBUG   ] spawn_process: at 2019-02-05 20:24:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 20:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 20:24:18 [DEBUG   ] spawn_process: at 2019-02-05 20:24:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 20:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 20:24:18 [DEBUG   ] spawn_process: at 2019-02-05 20:24:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 20:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 20:24:18 [DEBUG   ] spawn_process: at 2019-02-05 20:24:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 20:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 20:24:18 [DEBUG   ] spawn_process: at 2019-02-05 20:24:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 20:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 20:24:18 [DEBUG   ] spawn_process: at 2019-02-05 20:24:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 20:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 20:24:18 [DEBUG   ] spawn_process: at 2019-02-05 20:24:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 20:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 20:24:18 [DEBUG   ] spawn_process: at 2019-02-05 20:24:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 20:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 20:24:18 [DEBUG   ] spawn_process: at 2019-02-05 20:24:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 20:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 20:24:18 [DEBUG   ] spawn_process: at 2019-02-05 20:24:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 20:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 20:24:18 [DEBUG   ] spawn_process: at 2019-02-05 20:24:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 20:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 20:24:18 [DEBUG   ] spawn_process: at 2019-02-05 20:24:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 20:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 20:24:18 [DEBUG   ] spawn_process: at 2019-02-05 20:24:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 20:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 20:24:18 [DEBUG   ] spawn_process: at 2019-02-05 20:24:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 20:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 20:24:18 [DEBUG   ] spawn_process: at 2019-02-05 20:24:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 20:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 20:24:18 [DEBUG   ] spawn_process: at 2019-02-05 20:24:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 20:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 20:24:18 [DEBUG   ] spawn_process: at 2019-02-05 20:24:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 20:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 20:24:18 [DEBUG   ] spawn_process: at 2019-02-05 20:24:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 20:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 20:24:18 [DEBUG   ] spawn_process: at 2019-02-05 20:24:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 20:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 20:24:18 [DEBUG   ] spawn_process: at 2019-02-05 20:24:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 20:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 20:24:18 [DEBUG   ] spawn_process: at 2019-02-05 20:24:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 20:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 20:24:18 [DEBUG   ] spawn_process: at 2019-02-05 20:24:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 20:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 20:24:18 [DEBUG   ] spawn_process: at 2019-02-05 20:24:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 20:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 20:24:18 [DEBUG   ] spawn_process: at 2019-02-05 20:24:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 20:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 20:24:18 [DEBUG   ] spawn_process: at 2019-02-05 20:24:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 20:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 20:24:18 [DEBUG   ] spawn_process: at 2019-02-05 20:24:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 20:24:24 [DEBUG   ] Got command BAM from MCS: ref #1412929
2019-02-05 20:24:24 [INFO    ] Finished processing BAM request
2019-02-05 20:24:24 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:24:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412929   8 58519 73464029 A  ERROR'
2019-02-05 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-02-05 20:24:24 [DEBUG   ] spawn_process: at 2019-02-05 20:24:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-02-05 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-02-05 20:24:24 [DEBUG   ] spawn_process: at 2019-02-05 20:24:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-02-05 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-02-05 20:24:24 [DEBUG   ] spawn_process: at 2019-02-05 20:24:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-02-05 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-02-05 20:24:24 [DEBUG   ] spawn_process: at 2019-02-05 20:24:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-02-05 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-02-05 20:24:24 [DEBUG   ] spawn_process: at 2019-02-05 20:24:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-02-05 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-02-05 20:24:24 [DEBUG   ] spawn_process: at 2019-02-05 20:24:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-02-05 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-02-05 20:24:24 [DEBUG   ] spawn_process: at 2019-02-05 20:24:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-02-05 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-02-05 20:24:24 [DEBUG   ] spawn_process: at 2019-02-05 20:24:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-02-05 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-02-05 20:24:24 [DEBUG   ] spawn_process: at 2019-02-05 20:24:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-02-05 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-02-05 20:24:24 [DEBUG   ] spawn_process: at 2019-02-05 20:24:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-02-05 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-02-05 20:24:24 [DEBUG   ] spawn_process: at 2019-02-05 20:24:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-02-05 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-02-05 20:24:24 [DEBUG   ] spawn_process: at 2019-02-05 20:24:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-02-05 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-02-05 20:24:24 [DEBUG   ] spawn_process: at 2019-02-05 20:24:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-02-05 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-02-05 20:24:24 [DEBUG   ] spawn_process: at 2019-02-05 20:24:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-02-05 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-02-05 20:24:24 [DEBUG   ] spawn_process: at 2019-02-05 20:24:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-02-05 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-02-05 20:24:24 [DEBUG   ] spawn_process: at 2019-02-05 20:24:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-02-05 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-02-05 20:24:24 [DEBUG   ] spawn_process: at 2019-02-05 20:24:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-02-05 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-02-05 20:24:24 [DEBUG   ] spawn_process: at 2019-02-05 20:24:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-02-05 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-02-05 20:24:24 [DEBUG   ] spawn_process: at 2019-02-05 20:24:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-02-05 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-02-05 20:24:24 [DEBUG   ] spawn_process: at 2019-02-05 20:24:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-02-05 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-02-05 20:24:24 [DEBUG   ] spawn_process: at 2019-02-05 20:24:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-02-05 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-02-05 20:24:24 [DEBUG   ] spawn_process: at 2019-02-05 20:24:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-02-05 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-02-05 20:24:24 [DEBUG   ] spawn_process: at 2019-02-05 20:24:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-02-05 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-02-05 20:24:24 [DEBUG   ] spawn_process: at 2019-02-05 20:24:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-02-05 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-02-05 20:24:24 [DEBUG   ] spawn_process: at 2019-02-05 20:24:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-02-05 20:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-02-05 20:24:24 [DEBUG   ] spawn_process: at 2019-02-05 20:24:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-02-05 20:24:38 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 20:24:56 [DEBUG   ] Got command RPT from MCS: ref #1412932
2019-02-05 20:24:56 [DEBUG   ] summary = ERROR
2019-02-05 20:24:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412932  13 58519 73496729 A  ERRORERROR'
2019-02-05 20:24:56 [DEBUG   ] Got command RPT from MCS: ref #1412933
2019-02-05 20:24:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 20:24:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412933  77 58519 73496933 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 20:24:57 [DEBUG   ] Got command RPT from MCS: ref #1412934
2019-02-05 20:24:57 [DEBUG   ] summary = ERROR
2019-02-05 20:24:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412934  13 58519 73497125 A  ERRORERROR'
2019-02-05 20:24:57 [DEBUG   ] Got command RPT from MCS: ref #1412936
2019-02-05 20:24:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 20:24:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412936  77 58519 73497329 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 20:24:57 [DEBUG   ] Got command RPT from MCS: ref #1412937
2019-02-05 20:24:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 20:24:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412937  12 58519 73497533 A  ERRORB£ff'
2019-02-05 20:24:58 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 20:25:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 20:25:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:25:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 20:25:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-02-05 20:25:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-02-05 20:25:05 [WARNING ] (13, 1, 'bot')
2019-02-05 20:25:05 [WARNING ] (13, 1, 'bot')
2019-02-05 20:25:05 [WARNING ] (13, 1, 'bot')
2019-02-05 20:25:05 [WARNING ] (13, 1, 'bot')
2019-02-05 20:25:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:25:05 [DEBUG   ] Finished updating board flags in 1.185 seconds
2019-02-05 20:25:14 [DEBUG   ] Got command BAM from MCS: ref #1412942
2019-02-05 20:25:14 [INFO    ] Finished processing BAM request
2019-02-05 20:25:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:25:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412942   8 58519 73514029 A  ERROR'
2019-02-05 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-02-05 20:25:14 [DEBUG   ] spawn_process: at 2019-02-05 20:25:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-02-05 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-02-05 20:25:14 [DEBUG   ] spawn_process: at 2019-02-05 20:25:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-02-05 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-02-05 20:25:14 [DEBUG   ] spawn_process: at 2019-02-05 20:25:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-02-05 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-02-05 20:25:14 [DEBUG   ] spawn_process: at 2019-02-05 20:25:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-02-05 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-02-05 20:25:14 [DEBUG   ] spawn_process: at 2019-02-05 20:25:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-02-05 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-02-05 20:25:14 [DEBUG   ] spawn_process: at 2019-02-05 20:25:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-02-05 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-02-05 20:25:14 [DEBUG   ] spawn_process: at 2019-02-05 20:25:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-02-05 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-02-05 20:25:14 [DEBUG   ] spawn_process: at 2019-02-05 20:25:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-02-05 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-02-05 20:25:14 [DEBUG   ] spawn_process: at 2019-02-05 20:25:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-02-05 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-02-05 20:25:14 [DEBUG   ] spawn_process: at 2019-02-05 20:25:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-02-05 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-02-05 20:25:14 [DEBUG   ] spawn_process: at 2019-02-05 20:25:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-02-05 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-02-05 20:25:14 [DEBUG   ] spawn_process: at 2019-02-05 20:25:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-02-05 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-02-05 20:25:14 [DEBUG   ] spawn_process: at 2019-02-05 20:25:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-02-05 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-02-05 20:25:14 [DEBUG   ] spawn_process: at 2019-02-05 20:25:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-02-05 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-02-05 20:25:14 [DEBUG   ] spawn_process: at 2019-02-05 20:25:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-02-05 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-02-05 20:25:14 [DEBUG   ] spawn_process: at 2019-02-05 20:25:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-02-05 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-02-05 20:25:14 [DEBUG   ] spawn_process: at 2019-02-05 20:25:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-02-05 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-02-05 20:25:14 [DEBUG   ] spawn_process: at 2019-02-05 20:25:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-02-05 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-02-05 20:25:14 [DEBUG   ] spawn_process: at 2019-02-05 20:25:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-02-05 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-02-05 20:25:14 [DEBUG   ] spawn_process: at 2019-02-05 20:25:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-02-05 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-02-05 20:25:14 [DEBUG   ] spawn_process: at 2019-02-05 20:25:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-02-05 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-02-05 20:25:14 [DEBUG   ] spawn_process: at 2019-02-05 20:25:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-02-05 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-02-05 20:25:14 [DEBUG   ] spawn_process: at 2019-02-05 20:25:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-02-05 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-02-05 20:25:14 [DEBUG   ] spawn_process: at 2019-02-05 20:25:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-02-05 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-02-05 20:25:14 [DEBUG   ] spawn_process: at 2019-02-05 20:25:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-02-05 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-02-05 20:25:14 [DEBUG   ] spawn_process: at 2019-02-05 20:25:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-02-05 20:25:18 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-02-05 20:25:22 [DEBUG   ] Got command BAM from MCS: ref #1412943
2019-02-05 20:25:22 [INFO    ] Finished processing BAM request
2019-02-05 20:25:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:25:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412943   8 58519 73522029 A  ERROR'
2019-02-05 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 20:25:22 [DEBUG   ] spawn_process: at 2019-02-05 20:25:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 20:25:22 [DEBUG   ] spawn_process: at 2019-02-05 20:25:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 20:25:22 [DEBUG   ] spawn_process: at 2019-02-05 20:25:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 20:25:22 [DEBUG   ] spawn_process: at 2019-02-05 20:25:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 20:25:22 [DEBUG   ] spawn_process: at 2019-02-05 20:25:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 20:25:22 [DEBUG   ] spawn_process: at 2019-02-05 20:25:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 20:25:22 [DEBUG   ] spawn_process: at 2019-02-05 20:25:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 20:25:22 [DEBUG   ] spawn_process: at 2019-02-05 20:25:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 20:25:22 [DEBUG   ] spawn_process: at 2019-02-05 20:25:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 20:25:22 [DEBUG   ] spawn_process: at 2019-02-05 20:25:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 20:25:22 [DEBUG   ] spawn_process: at 2019-02-05 20:25:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 20:25:22 [DEBUG   ] spawn_process: at 2019-02-05 20:25:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 20:25:22 [DEBUG   ] spawn_process: at 2019-02-05 20:25:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 20:25:22 [DEBUG   ] spawn_process: at 2019-02-05 20:25:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 20:25:22 [DEBUG   ] spawn_process: at 2019-02-05 20:25:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 20:25:22 [DEBUG   ] spawn_process: at 2019-02-05 20:25:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 20:25:22 [DEBUG   ] spawn_process: at 2019-02-05 20:25:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 20:25:22 [DEBUG   ] spawn_process: at 2019-02-05 20:25:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 20:25:22 [DEBUG   ] spawn_process: at 2019-02-05 20:25:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 20:25:22 [DEBUG   ] spawn_process: at 2019-02-05 20:25:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 20:25:22 [DEBUG   ] spawn_process: at 2019-02-05 20:25:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 20:25:22 [DEBUG   ] spawn_process: at 2019-02-05 20:25:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 20:25:22 [DEBUG   ] spawn_process: at 2019-02-05 20:25:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 20:25:22 [DEBUG   ] spawn_process: at 2019-02-05 20:25:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 20:25:22 [DEBUG   ] spawn_process: at 2019-02-05 20:25:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 20:25:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 20:25:22 [DEBUG   ] spawn_process: at 2019-02-05 20:25:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 20:25:38 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 20:25:58 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-02-05 20:26:04 [DEBUG   ] Got command BAM from MCS: ref #1412944
2019-02-05 20:26:04 [INFO    ] Finished processing BAM request
2019-02-05 20:26:04 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:26:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412944   8 58519 73564029 A  ERROR'
2019-02-05 20:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-02-05 20:26:04 [DEBUG   ] spawn_process: at 2019-02-05 20:26:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-02-05 20:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-02-05 20:26:04 [DEBUG   ] spawn_process: at 2019-02-05 20:26:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-02-05 20:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-02-05 20:26:04 [DEBUG   ] spawn_process: at 2019-02-05 20:26:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-02-05 20:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-02-05 20:26:04 [DEBUG   ] spawn_process: at 2019-02-05 20:26:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-02-05 20:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-02-05 20:26:04 [DEBUG   ] spawn_process: at 2019-02-05 20:26:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-02-05 20:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-02-05 20:26:04 [DEBUG   ] spawn_process: at 2019-02-05 20:26:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-02-05 20:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-02-05 20:26:04 [DEBUG   ] spawn_process: at 2019-02-05 20:26:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-02-05 20:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-02-05 20:26:04 [DEBUG   ] spawn_process: at 2019-02-05 20:26:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-02-05 20:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-02-05 20:26:04 [DEBUG   ] spawn_process: at 2019-02-05 20:26:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-02-05 20:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-02-05 20:26:04 [DEBUG   ] spawn_process: at 2019-02-05 20:26:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-02-05 20:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-02-05 20:26:04 [DEBUG   ] spawn_process: at 2019-02-05 20:26:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-02-05 20:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-02-05 20:26:04 [DEBUG   ] spawn_process: at 2019-02-05 20:26:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-02-05 20:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-02-05 20:26:04 [DEBUG   ] spawn_process: at 2019-02-05 20:26:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-02-05 20:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-02-05 20:26:04 [DEBUG   ] spawn_process: at 2019-02-05 20:26:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-02-05 20:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-02-05 20:26:04 [DEBUG   ] spawn_process: at 2019-02-05 20:26:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-02-05 20:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-02-05 20:26:04 [DEBUG   ] spawn_process: at 2019-02-05 20:26:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-02-05 20:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-02-05 20:26:04 [DEBUG   ] spawn_process: at 2019-02-05 20:26:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-02-05 20:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-02-05 20:26:04 [DEBUG   ] spawn_process: at 2019-02-05 20:26:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-02-05 20:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-02-05 20:26:04 [DEBUG   ] spawn_process: at 2019-02-05 20:26:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-02-05 20:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-02-05 20:26:04 [DEBUG   ] spawn_process: at 2019-02-05 20:26:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-02-05 20:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-02-05 20:26:04 [DEBUG   ] spawn_process: at 2019-02-05 20:26:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-02-05 20:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-02-05 20:26:04 [DEBUG   ] spawn_process: at 2019-02-05 20:26:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-02-05 20:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-02-05 20:26:04 [DEBUG   ] spawn_process: at 2019-02-05 20:26:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-02-05 20:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-02-05 20:26:04 [DEBUG   ] spawn_process: at 2019-02-05 20:26:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-02-05 20:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-02-05 20:26:04 [DEBUG   ] spawn_process: at 2019-02-05 20:26:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-02-05 20:26:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-02-05 20:26:04 [DEBUG   ] spawn_process: at 2019-02-05 20:26:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-02-05 20:26:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:26:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-02-05 20:26:05 [WARNING ] (13, 1, 'bot')
2019-02-05 20:26:05 [WARNING ] (13, 1, 'bot')
2019-02-05 20:26:05 [WARNING ] (13, 1, 'bot')
2019-02-05 20:26:05 [WARNING ] (13, 1, 'bot')
2019-02-05 20:26:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:26:05 [DEBUG   ] Finished updating board flags in 0.997 seconds
2019-02-05 20:26:12 [DEBUG   ] Got command RPT from MCS: ref #1412945
2019-02-05 20:26:12 [DEBUG   ] summary = ERROR
2019-02-05 20:26:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412945  13 58519 73572025 A  ERRORERROR'
2019-02-05 20:26:12 [DEBUG   ] Got command RPT from MCS: ref #1412946
2019-02-05 20:26:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 20:26:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412946  77 58519 73572026 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 20:26:18 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-02-05 20:26:26 [DEBUG   ] Got command BAM from MCS: ref #1412966
2019-02-05 20:26:26 [INFO    ] Finished processing BAM request
2019-02-05 20:26:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:26:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412966   8 58519 73586033 A  ERROR'
2019-02-05 20:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 20:26:26 [DEBUG   ] spawn_process: at 2019-02-05 20:26:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 20:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 20:26:26 [DEBUG   ] spawn_process: at 2019-02-05 20:26:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 20:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 20:26:26 [DEBUG   ] spawn_process: at 2019-02-05 20:26:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 20:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 20:26:26 [DEBUG   ] spawn_process: at 2019-02-05 20:26:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 20:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 20:26:26 [DEBUG   ] spawn_process: at 2019-02-05 20:26:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 20:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 20:26:26 [DEBUG   ] spawn_process: at 2019-02-05 20:26:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 20:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 20:26:26 [DEBUG   ] spawn_process: at 2019-02-05 20:26:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 20:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 20:26:26 [DEBUG   ] spawn_process: at 2019-02-05 20:26:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 20:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 20:26:26 [DEBUG   ] spawn_process: at 2019-02-05 20:26:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 20:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 20:26:26 [DEBUG   ] spawn_process: at 2019-02-05 20:26:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 20:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 20:26:26 [DEBUG   ] spawn_process: at 2019-02-05 20:26:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 20:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 20:26:26 [DEBUG   ] spawn_process: at 2019-02-05 20:26:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 20:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 20:26:26 [DEBUG   ] spawn_process: at 2019-02-05 20:26:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 20:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 20:26:26 [DEBUG   ] spawn_process: at 2019-02-05 20:26:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 20:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 20:26:26 [DEBUG   ] spawn_process: at 2019-02-05 20:26:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 20:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 20:26:26 [DEBUG   ] spawn_process: at 2019-02-05 20:26:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 20:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 20:26:26 [DEBUG   ] spawn_process: at 2019-02-05 20:26:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 20:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 20:26:26 [DEBUG   ] spawn_process: at 2019-02-05 20:26:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 20:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 20:26:26 [DEBUG   ] spawn_process: at 2019-02-05 20:26:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 20:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 20:26:26 [DEBUG   ] spawn_process: at 2019-02-05 20:26:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 20:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 20:26:26 [DEBUG   ] spawn_process: at 2019-02-05 20:26:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 20:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 20:26:26 [DEBUG   ] spawn_process: at 2019-02-05 20:26:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 20:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 20:26:26 [DEBUG   ] spawn_process: at 2019-02-05 20:26:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 20:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 20:26:26 [DEBUG   ] spawn_process: at 2019-02-05 20:26:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 20:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 20:26:26 [DEBUG   ] spawn_process: at 2019-02-05 20:26:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 20:26:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 20:26:26 [DEBUG   ] spawn_process: at 2019-02-05 20:26:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 20:26:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 20:26:54 [DEBUG   ] Got command BAM from MCS: ref #1412967
2019-02-05 20:26:54 [INFO    ] Finished processing BAM request
2019-02-05 20:26:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:26:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412967   8 58519 73614025 A  ERROR'
2019-02-05 20:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 20:26:54 [DEBUG   ] spawn_process: at 2019-02-05 20:26:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 20:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 20:26:54 [DEBUG   ] spawn_process: at 2019-02-05 20:26:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 20:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 20:26:54 [DEBUG   ] spawn_process: at 2019-02-05 20:26:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 20:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 20:26:54 [DEBUG   ] spawn_process: at 2019-02-05 20:26:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 20:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 20:26:54 [DEBUG   ] spawn_process: at 2019-02-05 20:26:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 20:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 20:26:54 [DEBUG   ] spawn_process: at 2019-02-05 20:26:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 20:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 20:26:54 [DEBUG   ] spawn_process: at 2019-02-05 20:26:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 20:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 20:26:54 [DEBUG   ] spawn_process: at 2019-02-05 20:26:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 20:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 20:26:54 [DEBUG   ] spawn_process: at 2019-02-05 20:26:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 20:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 20:26:54 [DEBUG   ] spawn_process: at 2019-02-05 20:26:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 20:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 20:26:54 [DEBUG   ] spawn_process: at 2019-02-05 20:26:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 20:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 20:26:54 [DEBUG   ] spawn_process: at 2019-02-05 20:26:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 20:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 20:26:54 [DEBUG   ] spawn_process: at 2019-02-05 20:26:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 20:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 20:26:54 [DEBUG   ] spawn_process: at 2019-02-05 20:26:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 20:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 20:26:54 [DEBUG   ] spawn_process: at 2019-02-05 20:26:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 20:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 20:26:54 [DEBUG   ] spawn_process: at 2019-02-05 20:26:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 20:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 20:26:54 [DEBUG   ] spawn_process: at 2019-02-05 20:26:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 20:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 20:26:54 [DEBUG   ] spawn_process: at 2019-02-05 20:26:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 20:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 20:26:54 [DEBUG   ] spawn_process: at 2019-02-05 20:26:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 20:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 20:26:54 [DEBUG   ] spawn_process: at 2019-02-05 20:26:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 20:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 20:26:54 [DEBUG   ] spawn_process: at 2019-02-05 20:26:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 20:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 20:26:54 [DEBUG   ] spawn_process: at 2019-02-05 20:26:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 20:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 20:26:54 [DEBUG   ] spawn_process: at 2019-02-05 20:26:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 20:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 20:26:54 [DEBUG   ] spawn_process: at 2019-02-05 20:26:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 20:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 20:26:54 [DEBUG   ] spawn_process: at 2019-02-05 20:26:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 20:26:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 20:26:54 [DEBUG   ] spawn_process: at 2019-02-05 20:26:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 20:26:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 20:27:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 20:27:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:27:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-02-05 20:27:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-02-05 20:27:06 [WARNING ] (13, 1, 'bot')
2019-02-05 20:27:06 [WARNING ] (13, 1, 'bot')
2019-02-05 20:27:06 [WARNING ] (13, 1, 'bot')
2019-02-05 20:27:06 [WARNING ] (13, 1, 'bot')
2019-02-05 20:27:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:27:06 [DEBUG   ] Finished updating board flags in 1.383 seconds
2019-02-05 20:27:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 20:27:30 [DEBUG   ] Got command BAM from MCS: ref #1412968
2019-02-05 20:27:30 [INFO    ] Finished processing BAM request
2019-02-05 20:27:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:27:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412968   8 58519 73650029 A  ERROR'
2019-02-05 20:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 20:27:30 [DEBUG   ] spawn_process: at 2019-02-05 20:27:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 20:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 20:27:30 [DEBUG   ] spawn_process: at 2019-02-05 20:27:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 20:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 20:27:30 [DEBUG   ] spawn_process: at 2019-02-05 20:27:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 20:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 20:27:30 [DEBUG   ] spawn_process: at 2019-02-05 20:27:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 20:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 20:27:30 [DEBUG   ] spawn_process: at 2019-02-05 20:27:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 20:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 20:27:30 [DEBUG   ] spawn_process: at 2019-02-05 20:27:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 20:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 20:27:30 [DEBUG   ] spawn_process: at 2019-02-05 20:27:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 20:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 20:27:30 [DEBUG   ] spawn_process: at 2019-02-05 20:27:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 20:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 20:27:30 [DEBUG   ] spawn_process: at 2019-02-05 20:27:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 20:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 20:27:30 [DEBUG   ] spawn_process: at 2019-02-05 20:27:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 20:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 20:27:30 [DEBUG   ] spawn_process: at 2019-02-05 20:27:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 20:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 20:27:30 [DEBUG   ] spawn_process: at 2019-02-05 20:27:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 20:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 20:27:30 [DEBUG   ] spawn_process: at 2019-02-05 20:27:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 20:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 20:27:30 [DEBUG   ] spawn_process: at 2019-02-05 20:27:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 20:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 20:27:30 [DEBUG   ] spawn_process: at 2019-02-05 20:27:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 20:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 20:27:30 [DEBUG   ] spawn_process: at 2019-02-05 20:27:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 20:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 20:27:30 [DEBUG   ] spawn_process: at 2019-02-05 20:27:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 20:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 20:27:30 [DEBUG   ] spawn_process: at 2019-02-05 20:27:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 20:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 20:27:30 [DEBUG   ] spawn_process: at 2019-02-05 20:27:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 20:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 20:27:30 [DEBUG   ] spawn_process: at 2019-02-05 20:27:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 20:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 20:27:30 [DEBUG   ] spawn_process: at 2019-02-05 20:27:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 20:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 20:27:30 [DEBUG   ] spawn_process: at 2019-02-05 20:27:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 20:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 20:27:30 [DEBUG   ] spawn_process: at 2019-02-05 20:27:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 20:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 20:27:30 [DEBUG   ] spawn_process: at 2019-02-05 20:27:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 20:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 20:27:30 [DEBUG   ] spawn_process: at 2019-02-05 20:27:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 20:27:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 20:27:30 [DEBUG   ] spawn_process: at 2019-02-05 20:27:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 20:27:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 20:27:43 [DEBUG   ] Got command BAM from MCS: ref #1412969
2019-02-05 20:27:43 [INFO    ] Finished processing BAM request
2019-02-05 20:27:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:27:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412969   8 58519 73663025 A  ERROR'
2019-02-05 20:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 20:27:43 [DEBUG   ] spawn_process: at 2019-02-05 20:27:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 20:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 20:27:43 [DEBUG   ] spawn_process: at 2019-02-05 20:27:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 20:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 20:27:43 [DEBUG   ] spawn_process: at 2019-02-05 20:27:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 20:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 20:27:43 [DEBUG   ] spawn_process: at 2019-02-05 20:27:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 20:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 20:27:43 [DEBUG   ] spawn_process: at 2019-02-05 20:27:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 20:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 20:27:43 [DEBUG   ] spawn_process: at 2019-02-05 20:27:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 20:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 20:27:43 [DEBUG   ] spawn_process: at 2019-02-05 20:27:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 20:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 20:27:43 [DEBUG   ] spawn_process: at 2019-02-05 20:27:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 20:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 20:27:43 [DEBUG   ] spawn_process: at 2019-02-05 20:27:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 20:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 20:27:43 [DEBUG   ] spawn_process: at 2019-02-05 20:27:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 20:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 20:27:43 [DEBUG   ] spawn_process: at 2019-02-05 20:27:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 20:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 20:27:43 [DEBUG   ] spawn_process: at 2019-02-05 20:27:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 20:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 20:27:43 [DEBUG   ] spawn_process: at 2019-02-05 20:27:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 20:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 20:27:43 [DEBUG   ] spawn_process: at 2019-02-05 20:27:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 20:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 20:27:43 [DEBUG   ] spawn_process: at 2019-02-05 20:27:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 20:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 20:27:43 [DEBUG   ] spawn_process: at 2019-02-05 20:27:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 20:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 20:27:43 [DEBUG   ] spawn_process: at 2019-02-05 20:27:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 20:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 20:27:43 [DEBUG   ] spawn_process: at 2019-02-05 20:27:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 20:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 20:27:43 [DEBUG   ] spawn_process: at 2019-02-05 20:27:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 20:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 20:27:43 [DEBUG   ] spawn_process: at 2019-02-05 20:27:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 20:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 20:27:43 [DEBUG   ] spawn_process: at 2019-02-05 20:27:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 20:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 20:27:43 [DEBUG   ] spawn_process: at 2019-02-05 20:27:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 20:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 20:27:43 [DEBUG   ] spawn_process: at 2019-02-05 20:27:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 20:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 20:27:43 [DEBUG   ] spawn_process: at 2019-02-05 20:27:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 20:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 20:27:43 [DEBUG   ] spawn_process: at 2019-02-05 20:27:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 20:27:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 20:27:43 [DEBUG   ] spawn_process: at 2019-02-05 20:27:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 20:27:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 20:28:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-02-05 20:28:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:28:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 20:28:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-02-05 20:28:06 [WARNING ] (13, 1, 'bot')
2019-02-05 20:28:06 [WARNING ] (13, 1, 'bot')
2019-02-05 20:28:06 [WARNING ] (13, 1, 'bot')
2019-02-05 20:28:06 [WARNING ] (13, 1, 'bot')
2019-02-05 20:28:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:28:06 [DEBUG   ] Finished updating board flags in 1.194 seconds
2019-02-05 20:28:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 20:28:32 [DEBUG   ] Got command BAM from MCS: ref #1412970
2019-02-05 20:28:32 [INFO    ] Finished processing BAM request
2019-02-05 20:28:32 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:28:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412970   8 58519 73712029 A  ERROR'
2019-02-05 20:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-02-05 20:28:32 [DEBUG   ] spawn_process: at 2019-02-05 20:28:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-02-05 20:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-02-05 20:28:32 [DEBUG   ] spawn_process: at 2019-02-05 20:28:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-02-05 20:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-02-05 20:28:32 [DEBUG   ] spawn_process: at 2019-02-05 20:28:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-02-05 20:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-02-05 20:28:32 [DEBUG   ] spawn_process: at 2019-02-05 20:28:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-02-05 20:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-02-05 20:28:32 [DEBUG   ] spawn_process: at 2019-02-05 20:28:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-02-05 20:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-02-05 20:28:32 [DEBUG   ] spawn_process: at 2019-02-05 20:28:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-02-05 20:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-02-05 20:28:32 [DEBUG   ] spawn_process: at 2019-02-05 20:28:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-02-05 20:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-02-05 20:28:32 [DEBUG   ] spawn_process: at 2019-02-05 20:28:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-02-05 20:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-02-05 20:28:32 [DEBUG   ] spawn_process: at 2019-02-05 20:28:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-02-05 20:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-02-05 20:28:32 [DEBUG   ] spawn_process: at 2019-02-05 20:28:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-02-05 20:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-02-05 20:28:32 [DEBUG   ] spawn_process: at 2019-02-05 20:28:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-02-05 20:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-02-05 20:28:32 [DEBUG   ] spawn_process: at 2019-02-05 20:28:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-02-05 20:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-02-05 20:28:32 [DEBUG   ] spawn_process: at 2019-02-05 20:28:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-02-05 20:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-02-05 20:28:32 [DEBUG   ] spawn_process: at 2019-02-05 20:28:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-02-05 20:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-02-05 20:28:32 [DEBUG   ] spawn_process: at 2019-02-05 20:28:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-02-05 20:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-02-05 20:28:32 [DEBUG   ] spawn_process: at 2019-02-05 20:28:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-02-05 20:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-02-05 20:28:32 [DEBUG   ] spawn_process: at 2019-02-05 20:28:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-02-05 20:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-02-05 20:28:32 [DEBUG   ] spawn_process: at 2019-02-05 20:28:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-02-05 20:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-02-05 20:28:32 [DEBUG   ] spawn_process: at 2019-02-05 20:28:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-02-05 20:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-02-05 20:28:32 [DEBUG   ] spawn_process: at 2019-02-05 20:28:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-02-05 20:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-02-05 20:28:32 [DEBUG   ] spawn_process: at 2019-02-05 20:28:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-02-05 20:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-02-05 20:28:32 [DEBUG   ] spawn_process: at 2019-02-05 20:28:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-02-05 20:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-02-05 20:28:32 [DEBUG   ] spawn_process: at 2019-02-05 20:28:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-02-05 20:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-02-05 20:28:32 [DEBUG   ] spawn_process: at 2019-02-05 20:28:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-02-05 20:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-02-05 20:28:32 [DEBUG   ] spawn_process: at 2019-02-05 20:28:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-02-05 20:28:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-02-05 20:28:32 [DEBUG   ] spawn_process: at 2019-02-05 20:28:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-02-05 20:28:34 [DEBUG   ] Got command BAM from MCS: ref #1412971
2019-02-05 20:28:34 [INFO    ] Finished processing BAM request
2019-02-05 20:28:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:28:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412971   8 58519 73714029 A  ERROR'
2019-02-05 20:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 20:28:34 [DEBUG   ] spawn_process: at 2019-02-05 20:28:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 20:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 20:28:34 [DEBUG   ] spawn_process: at 2019-02-05 20:28:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 20:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 20:28:34 [DEBUG   ] spawn_process: at 2019-02-05 20:28:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 20:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 20:28:34 [DEBUG   ] spawn_process: at 2019-02-05 20:28:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 20:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 20:28:34 [DEBUG   ] spawn_process: at 2019-02-05 20:28:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 20:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 20:28:34 [DEBUG   ] spawn_process: at 2019-02-05 20:28:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 20:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 20:28:34 [DEBUG   ] spawn_process: at 2019-02-05 20:28:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 20:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 20:28:34 [DEBUG   ] spawn_process: at 2019-02-05 20:28:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 20:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 20:28:34 [DEBUG   ] spawn_process: at 2019-02-05 20:28:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 20:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 20:28:34 [DEBUG   ] spawn_process: at 2019-02-05 20:28:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 20:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 20:28:34 [DEBUG   ] spawn_process: at 2019-02-05 20:28:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 20:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 20:28:34 [DEBUG   ] spawn_process: at 2019-02-05 20:28:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 20:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 20:28:34 [DEBUG   ] spawn_process: at 2019-02-05 20:28:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 20:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 20:28:34 [DEBUG   ] spawn_process: at 2019-02-05 20:28:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 20:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 20:28:34 [DEBUG   ] spawn_process: at 2019-02-05 20:28:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 20:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 20:28:34 [DEBUG   ] spawn_process: at 2019-02-05 20:28:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 20:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 20:28:34 [DEBUG   ] spawn_process: at 2019-02-05 20:28:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 20:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 20:28:34 [DEBUG   ] spawn_process: at 2019-02-05 20:28:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 20:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 20:28:34 [DEBUG   ] spawn_process: at 2019-02-05 20:28:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 20:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 20:28:34 [DEBUG   ] spawn_process: at 2019-02-05 20:28:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 20:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 20:28:34 [DEBUG   ] spawn_process: at 2019-02-05 20:28:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 20:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 20:28:34 [DEBUG   ] spawn_process: at 2019-02-05 20:28:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 20:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 20:28:34 [DEBUG   ] spawn_process: at 2019-02-05 20:28:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 20:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 20:28:34 [DEBUG   ] spawn_process: at 2019-02-05 20:28:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 20:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 20:28:34 [DEBUG   ] spawn_process: at 2019-02-05 20:28:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 20:28:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 20:28:34 [DEBUG   ] spawn_process: at 2019-02-05 20:28:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 20:28:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 20:28:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 20:29:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:29:07 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-02-05 20:29:07 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-02-05 20:29:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:29:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:29:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:29:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:29:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:29:07 [DEBUG   ] Finished updating board flags in 2.425 seconds
2019-02-05 20:29:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 20:29:21 [DEBUG   ] Got command BAM from MCS: ref #1412976
2019-02-05 20:29:21 [INFO    ] Finished processing BAM request
2019-02-05 20:29:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:29:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412976   8 58519 73761029 A  ERROR'
2019-02-05 20:29:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-02-05 20:29:21 [DEBUG   ] spawn_process: at 2019-02-05 20:29:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-02-05 20:29:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-02-05 20:29:21 [DEBUG   ] spawn_process: at 2019-02-05 20:29:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-02-05 20:29:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-02-05 20:29:21 [DEBUG   ] spawn_process: at 2019-02-05 20:29:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-02-05 20:29:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-02-05 20:29:21 [DEBUG   ] spawn_process: at 2019-02-05 20:29:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-02-05 20:29:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-02-05 20:29:21 [DEBUG   ] spawn_process: at 2019-02-05 20:29:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-02-05 20:29:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-02-05 20:29:21 [DEBUG   ] spawn_process: at 2019-02-05 20:29:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-02-05 20:29:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-02-05 20:29:21 [DEBUG   ] spawn_process: at 2019-02-05 20:29:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-02-05 20:29:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-02-05 20:29:21 [DEBUG   ] spawn_process: at 2019-02-05 20:29:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-02-05 20:29:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-02-05 20:29:21 [DEBUG   ] spawn_process: at 2019-02-05 20:29:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-02-05 20:29:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-02-05 20:29:21 [DEBUG   ] spawn_process: at 2019-02-05 20:29:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-02-05 20:29:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-02-05 20:29:21 [DEBUG   ] spawn_process: at 2019-02-05 20:29:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-02-05 20:29:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-02-05 20:29:21 [DEBUG   ] spawn_process: at 2019-02-05 20:29:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-02-05 20:29:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-02-05 20:29:21 [DEBUG   ] spawn_process: at 2019-02-05 20:29:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-02-05 20:29:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-02-05 20:29:21 [DEBUG   ] spawn_process: at 2019-02-05 20:29:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-02-05 20:29:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-02-05 20:29:21 [DEBUG   ] spawn_process: at 2019-02-05 20:29:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-02-05 20:29:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-02-05 20:29:21 [DEBUG   ] spawn_process: at 2019-02-05 20:29:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-02-05 20:29:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-02-05 20:29:21 [DEBUG   ] spawn_process: at 2019-02-05 20:29:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-02-05 20:29:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-02-05 20:29:21 [DEBUG   ] spawn_process: at 2019-02-05 20:29:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-02-05 20:29:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-02-05 20:29:21 [DEBUG   ] spawn_process: at 2019-02-05 20:29:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-02-05 20:29:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-02-05 20:29:21 [DEBUG   ] spawn_process: at 2019-02-05 20:29:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-02-05 20:29:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-02-05 20:29:21 [DEBUG   ] spawn_process: at 2019-02-05 20:29:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-02-05 20:29:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-02-05 20:29:21 [DEBUG   ] spawn_process: at 2019-02-05 20:29:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-02-05 20:29:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-02-05 20:29:21 [DEBUG   ] spawn_process: at 2019-02-05 20:29:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-02-05 20:29:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-02-05 20:29:21 [DEBUG   ] spawn_process: at 2019-02-05 20:29:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-02-05 20:29:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-02-05 20:29:21 [DEBUG   ] spawn_process: at 2019-02-05 20:29:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-02-05 20:29:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-02-05 20:29:21 [DEBUG   ] spawn_process: at 2019-02-05 20:29:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-02-05 20:29:38 [DEBUG   ] Got command BAM from MCS: ref #1412977
2019-02-05 20:29:38 [INFO    ] Finished processing BAM request
2019-02-05 20:29:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:29:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412977   8 58519 73778025 A  ERROR'
2019-02-05 20:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 20:29:38 [DEBUG   ] spawn_process: at 2019-02-05 20:29:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 20:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 20:29:38 [DEBUG   ] spawn_process: at 2019-02-05 20:29:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 20:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 20:29:38 [DEBUG   ] spawn_process: at 2019-02-05 20:29:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 20:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 20:29:38 [DEBUG   ] spawn_process: at 2019-02-05 20:29:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 20:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 20:29:38 [DEBUG   ] spawn_process: at 2019-02-05 20:29:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 20:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 20:29:38 [DEBUG   ] spawn_process: at 2019-02-05 20:29:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 20:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 20:29:38 [DEBUG   ] spawn_process: at 2019-02-05 20:29:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 20:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 20:29:38 [DEBUG   ] spawn_process: at 2019-02-05 20:29:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 20:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 20:29:38 [DEBUG   ] spawn_process: at 2019-02-05 20:29:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 20:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 20:29:38 [DEBUG   ] spawn_process: at 2019-02-05 20:29:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 20:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 20:29:38 [DEBUG   ] spawn_process: at 2019-02-05 20:29:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 20:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 20:29:38 [DEBUG   ] spawn_process: at 2019-02-05 20:29:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 20:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 20:29:38 [DEBUG   ] spawn_process: at 2019-02-05 20:29:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 20:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 20:29:38 [DEBUG   ] spawn_process: at 2019-02-05 20:29:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 20:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 20:29:38 [DEBUG   ] spawn_process: at 2019-02-05 20:29:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 20:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 20:29:38 [DEBUG   ] spawn_process: at 2019-02-05 20:29:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 20:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 20:29:38 [DEBUG   ] spawn_process: at 2019-02-05 20:29:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 20:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 20:29:38 [DEBUG   ] spawn_process: at 2019-02-05 20:29:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 20:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 20:29:38 [DEBUG   ] spawn_process: at 2019-02-05 20:29:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 20:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 20:29:38 [DEBUG   ] spawn_process: at 2019-02-05 20:29:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 20:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 20:29:38 [DEBUG   ] spawn_process: at 2019-02-05 20:29:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 20:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 20:29:38 [DEBUG   ] spawn_process: at 2019-02-05 20:29:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 20:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 20:29:38 [DEBUG   ] spawn_process: at 2019-02-05 20:29:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 20:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 20:29:38 [DEBUG   ] spawn_process: at 2019-02-05 20:29:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 20:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 20:29:38 [DEBUG   ] spawn_process: at 2019-02-05 20:29:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 20:29:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 20:29:38 [DEBUG   ] spawn_process: at 2019-02-05 20:29:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 20:29:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 20:29:56 [DEBUG   ] Got command RPT from MCS: ref #1412978
2019-02-05 20:29:56 [DEBUG   ] summary = ERROR
2019-02-05 20:29:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412978  13 58519 73796809 A  ERRORERROR'
2019-02-05 20:29:57 [DEBUG   ] Got command RPT from MCS: ref #1412979
2019-02-05 20:29:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 20:29:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412979  77 58519 73797013 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 20:29:57 [DEBUG   ] Got command RPT from MCS: ref #1412980
2019-02-05 20:29:57 [DEBUG   ] summary = ERROR
2019-02-05 20:29:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412980  13 58519 73797217 A  ERRORERROR'
2019-02-05 20:29:57 [DEBUG   ] Got command RPT from MCS: ref #1412981
2019-02-05 20:29:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 20:29:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412981  77 58519 73797421 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 20:29:57 [DEBUG   ] Got command RPT from MCS: ref #1412982
2019-02-05 20:29:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 20:29:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412982  12 58519 73797613 A  ERRORB¤ff'
2019-02-05 20:29:59 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 20:30:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2019-02-05 20:30:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:30:06 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-02-05 20:30:06 [WARNING ] (13, 1, 'bot')
2019-02-05 20:30:06 [WARNING ] (13, 1, 'bot')
2019-02-05 20:30:06 [WARNING ] (13, 1, 'bot')
2019-02-05 20:30:06 [WARNING ] (13, 1, 'bot')
2019-02-05 20:30:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:30:06 [DEBUG   ] Finished updating board flags in 1.421 seconds
2019-02-05 20:30:10 [DEBUG   ] Got command BAM from MCS: ref #1412983
2019-02-05 20:30:10 [INFO    ] Finished processing BAM request
2019-02-05 20:30:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:30:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412983   8 58519 73810025 A  ERROR'
2019-02-05 20:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-02-05 20:30:10 [DEBUG   ] spawn_process: at 2019-02-05 20:30:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-02-05 20:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-02-05 20:30:10 [DEBUG   ] spawn_process: at 2019-02-05 20:30:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-02-05 20:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-02-05 20:30:10 [DEBUG   ] spawn_process: at 2019-02-05 20:30:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-02-05 20:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-02-05 20:30:10 [DEBUG   ] spawn_process: at 2019-02-05 20:30:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-02-05 20:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-02-05 20:30:10 [DEBUG   ] spawn_process: at 2019-02-05 20:30:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-02-05 20:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-02-05 20:30:10 [DEBUG   ] spawn_process: at 2019-02-05 20:30:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-02-05 20:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-02-05 20:30:10 [DEBUG   ] spawn_process: at 2019-02-05 20:30:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-02-05 20:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-02-05 20:30:10 [DEBUG   ] spawn_process: at 2019-02-05 20:30:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-02-05 20:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-02-05 20:30:10 [DEBUG   ] spawn_process: at 2019-02-05 20:30:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-02-05 20:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-02-05 20:30:10 [DEBUG   ] spawn_process: at 2019-02-05 20:30:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-02-05 20:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-02-05 20:30:10 [DEBUG   ] spawn_process: at 2019-02-05 20:30:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-02-05 20:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-02-05 20:30:10 [DEBUG   ] spawn_process: at 2019-02-05 20:30:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-02-05 20:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-02-05 20:30:10 [DEBUG   ] spawn_process: at 2019-02-05 20:30:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-02-05 20:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-02-05 20:30:10 [DEBUG   ] spawn_process: at 2019-02-05 20:30:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-02-05 20:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-02-05 20:30:10 [DEBUG   ] spawn_process: at 2019-02-05 20:30:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-02-05 20:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-02-05 20:30:10 [DEBUG   ] spawn_process: at 2019-02-05 20:30:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-02-05 20:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-02-05 20:30:10 [DEBUG   ] spawn_process: at 2019-02-05 20:30:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-02-05 20:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-02-05 20:30:10 [DEBUG   ] spawn_process: at 2019-02-05 20:30:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-02-05 20:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-02-05 20:30:10 [DEBUG   ] spawn_process: at 2019-02-05 20:30:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-02-05 20:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-02-05 20:30:10 [DEBUG   ] spawn_process: at 2019-02-05 20:30:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-02-05 20:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-02-05 20:30:10 [DEBUG   ] spawn_process: at 2019-02-05 20:30:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-02-05 20:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-02-05 20:30:10 [DEBUG   ] spawn_process: at 2019-02-05 20:30:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-02-05 20:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-02-05 20:30:10 [DEBUG   ] spawn_process: at 2019-02-05 20:30:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-02-05 20:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-02-05 20:30:10 [DEBUG   ] spawn_process: at 2019-02-05 20:30:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-02-05 20:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-02-05 20:30:10 [DEBUG   ] spawn_process: at 2019-02-05 20:30:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-02-05 20:30:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-02-05 20:30:10 [DEBUG   ] spawn_process: at 2019-02-05 20:30:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-02-05 20:30:19 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-05 20:30:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 20:30:42 [DEBUG   ] Got command BAM from MCS: ref #1412984
2019-02-05 20:30:42 [INFO    ] Finished processing BAM request
2019-02-05 20:30:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:30:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412984   8 58519 73842033 A  ERROR'
2019-02-05 20:30:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-02-05 20:30:42 [DEBUG   ] spawn_process: at 2019-02-05 20:30:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-02-05 20:30:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-02-05 20:30:42 [DEBUG   ] spawn_process: at 2019-02-05 20:30:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-02-05 20:30:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-02-05 20:30:42 [DEBUG   ] spawn_process: at 2019-02-05 20:30:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-02-05 20:30:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-02-05 20:30:42 [DEBUG   ] spawn_process: at 2019-02-05 20:30:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-02-05 20:30:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-02-05 20:30:42 [DEBUG   ] spawn_process: at 2019-02-05 20:30:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-02-05 20:30:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-02-05 20:30:42 [DEBUG   ] spawn_process: at 2019-02-05 20:30:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-02-05 20:30:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-02-05 20:30:42 [DEBUG   ] spawn_process: at 2019-02-05 20:30:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-02-05 20:30:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-02-05 20:30:42 [DEBUG   ] spawn_process: at 2019-02-05 20:30:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-02-05 20:30:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-02-05 20:30:42 [DEBUG   ] spawn_process: at 2019-02-05 20:30:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-02-05 20:30:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-02-05 20:30:42 [DEBUG   ] spawn_process: at 2019-02-05 20:30:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-02-05 20:30:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-02-05 20:30:42 [DEBUG   ] spawn_process: at 2019-02-05 20:30:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-02-05 20:30:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-02-05 20:30:42 [DEBUG   ] spawn_process: at 2019-02-05 20:30:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-02-05 20:30:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-02-05 20:30:42 [DEBUG   ] spawn_process: at 2019-02-05 20:30:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-02-05 20:30:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-02-05 20:30:42 [DEBUG   ] spawn_process: at 2019-02-05 20:30:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-02-05 20:30:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-02-05 20:30:42 [DEBUG   ] spawn_process: at 2019-02-05 20:30:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-02-05 20:30:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-02-05 20:30:42 [DEBUG   ] spawn_process: at 2019-02-05 20:30:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-02-05 20:30:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-02-05 20:30:42 [DEBUG   ] spawn_process: at 2019-02-05 20:30:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-02-05 20:30:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-02-05 20:30:42 [DEBUG   ] spawn_process: at 2019-02-05 20:30:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-02-05 20:30:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-02-05 20:30:42 [DEBUG   ] spawn_process: at 2019-02-05 20:30:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-02-05 20:30:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-02-05 20:30:42 [DEBUG   ] spawn_process: at 2019-02-05 20:30:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-02-05 20:30:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-02-05 20:30:42 [DEBUG   ] spawn_process: at 2019-02-05 20:30:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-02-05 20:30:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-02-05 20:30:42 [DEBUG   ] spawn_process: at 2019-02-05 20:30:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-02-05 20:30:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-02-05 20:30:42 [DEBUG   ] spawn_process: at 2019-02-05 20:30:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-02-05 20:30:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-02-05 20:30:42 [DEBUG   ] spawn_process: at 2019-02-05 20:30:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-02-05 20:30:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-02-05 20:30:42 [DEBUG   ] spawn_process: at 2019-02-05 20:30:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-02-05 20:30:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-02-05 20:30:42 [DEBUG   ] spawn_process: at 2019-02-05 20:30:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-02-05 20:30:58 [DEBUG   ] Got command BAM from MCS: ref #1412985
2019-02-05 20:30:58 [INFO    ] Finished processing BAM request
2019-02-05 20:30:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:30:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1412985   8 58519 73858029 A  ERROR'
2019-02-05 20:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 20:30:58 [DEBUG   ] spawn_process: at 2019-02-05 20:30:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 20:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 20:30:58 [DEBUG   ] spawn_process: at 2019-02-05 20:30:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 20:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 20:30:58 [DEBUG   ] spawn_process: at 2019-02-05 20:30:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 20:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 20:30:58 [DEBUG   ] spawn_process: at 2019-02-05 20:30:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 20:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 20:30:58 [DEBUG   ] spawn_process: at 2019-02-05 20:30:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 20:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 20:30:58 [DEBUG   ] spawn_process: at 2019-02-05 20:30:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 20:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 20:30:58 [DEBUG   ] spawn_process: at 2019-02-05 20:30:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 20:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 20:30:58 [DEBUG   ] spawn_process: at 2019-02-05 20:30:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 20:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 20:30:58 [DEBUG   ] spawn_process: at 2019-02-05 20:30:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 20:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 20:30:58 [DEBUG   ] spawn_process: at 2019-02-05 20:30:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 20:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 20:30:58 [DEBUG   ] spawn_process: at 2019-02-05 20:30:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 20:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 20:30:58 [DEBUG   ] spawn_process: at 2019-02-05 20:30:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 20:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 20:30:58 [DEBUG   ] spawn_process: at 2019-02-05 20:30:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 20:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 20:30:58 [DEBUG   ] spawn_process: at 2019-02-05 20:30:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 20:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 20:30:58 [DEBUG   ] spawn_process: at 2019-02-05 20:30:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 20:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 20:30:58 [DEBUG   ] spawn_process: at 2019-02-05 20:30:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 20:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 20:30:58 [DEBUG   ] spawn_process: at 2019-02-05 20:30:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 20:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 20:30:58 [DEBUG   ] spawn_process: at 2019-02-05 20:30:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 20:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 20:30:58 [DEBUG   ] spawn_process: at 2019-02-05 20:30:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 20:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 20:30:58 [DEBUG   ] spawn_process: at 2019-02-05 20:30:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 20:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 20:30:58 [DEBUG   ] spawn_process: at 2019-02-05 20:30:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 20:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 20:30:58 [DEBUG   ] spawn_process: at 2019-02-05 20:30:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 20:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 20:30:58 [DEBUG   ] spawn_process: at 2019-02-05 20:30:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 20:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 20:30:58 [DEBUG   ] spawn_process: at 2019-02-05 20:30:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 20:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 20:30:58 [DEBUG   ] spawn_process: at 2019-02-05 20:30:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 20:30:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 20:30:58 [DEBUG   ] spawn_process: at 2019-02-05 20:30:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 20:30:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 20:31:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2019-02-05 20:31:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:31:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-02-05 20:31:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2019-02-05 20:31:07 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-02-05 20:31:07 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-02-05 20:31:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-05 20:31:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-02-05 20:31:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:31:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:31:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:31:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:31:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:31:07 [DEBUG   ] Finished updating board flags in 2.394 seconds
2019-02-05 20:31:12 [DEBUG   ] Got command RPT from MCS: ref #1412986
2019-02-05 20:31:12 [DEBUG   ] summary = ERROR
2019-02-05 20:31:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412986  13 58519 73872025 A  ERRORERROR'
2019-02-05 20:31:12 [DEBUG   ] Got command RPT from MCS: ref #1412987
2019-02-05 20:31:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 20:31:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1412987  77 58519 73872026 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 20:31:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 20:31:39 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 20:31:46 [DEBUG   ] Got command BAM from MCS: ref #1413003
2019-02-05 20:31:46 [INFO    ] Finished processing BAM request
2019-02-05 20:31:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:31:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1413003   8 58519 73906033 A  ERROR'
2019-02-05 20:31:46 [DEBUG   ] Got command BAM from MCS: ref #1413004
2019-02-05 20:31:46 [INFO    ] Finished processing BAM request
2019-02-05 20:31:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:31:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1413004   8 58519 73906037 A  ERROR'
2019-02-05 20:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-02-05 20:31:46 [DEBUG   ] spawn_process: at 2019-02-05 20:31:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-02-05 20:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-02-05 20:31:46 [DEBUG   ] spawn_process: at 2019-02-05 20:31:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-02-05 20:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-02-05 20:31:46 [DEBUG   ] spawn_process: at 2019-02-05 20:31:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-02-05 20:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-02-05 20:31:46 [DEBUG   ] spawn_process: at 2019-02-05 20:31:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-02-05 20:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-02-05 20:31:46 [DEBUG   ] spawn_process: at 2019-02-05 20:31:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-02-05 20:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-02-05 20:31:46 [DEBUG   ] spawn_process: at 2019-02-05 20:31:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-02-05 20:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-02-05 20:31:46 [DEBUG   ] spawn_process: at 2019-02-05 20:31:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-02-05 20:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-02-05 20:31:46 [DEBUG   ] spawn_process: at 2019-02-05 20:31:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-02-05 20:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-02-05 20:31:46 [DEBUG   ] spawn_process: at 2019-02-05 20:31:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-02-05 20:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-02-05 20:31:46 [DEBUG   ] spawn_process: at 2019-02-05 20:31:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-02-05 20:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-02-05 20:31:46 [DEBUG   ] spawn_process: at 2019-02-05 20:31:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-02-05 20:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-02-05 20:31:46 [DEBUG   ] spawn_process: at 2019-02-05 20:31:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-02-05 20:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-02-05 20:31:46 [DEBUG   ] spawn_process: at 2019-02-05 20:31:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-02-05 20:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-02-05 20:31:46 [DEBUG   ] spawn_process: at 2019-02-05 20:31:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-02-05 20:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-02-05 20:31:46 [DEBUG   ] spawn_process: at 2019-02-05 20:31:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-02-05 20:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-02-05 20:31:46 [DEBUG   ] spawn_process: at 2019-02-05 20:31:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-02-05 20:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-02-05 20:31:46 [DEBUG   ] spawn_process: at 2019-02-05 20:31:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-02-05 20:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-02-05 20:31:46 [DEBUG   ] spawn_process: at 2019-02-05 20:31:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-02-05 20:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-02-05 20:31:46 [DEBUG   ] spawn_process: at 2019-02-05 20:31:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-02-05 20:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-02-05 20:31:46 [DEBUG   ] spawn_process: at 2019-02-05 20:31:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-02-05 20:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-02-05 20:31:46 [DEBUG   ] spawn_process: at 2019-02-05 20:31:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-02-05 20:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-02-05 20:31:46 [DEBUG   ] spawn_process: at 2019-02-05 20:31:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-02-05 20:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-02-05 20:31:46 [DEBUG   ] spawn_process: at 2019-02-05 20:31:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-02-05 20:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-02-05 20:31:46 [DEBUG   ] spawn_process: at 2019-02-05 20:31:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-02-05 20:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-02-05 20:31:46 [DEBUG   ] spawn_process: at 2019-02-05 20:31:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-02-05 20:31:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-02-05 20:31:46 [DEBUG   ] spawn_process: at 2019-02-05 20:31:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-02-05 20:31:59 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-05 20:32:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:32:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2019-02-05 20:32:06 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-02-05 20:32:06 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-02-05 20:32:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-02-05 20:32:06 [WARNING ] (13, 1, 'bot')
2019-02-05 20:32:06 [WARNING ] (13, 1, 'bot')
2019-02-05 20:32:06 [WARNING ] (13, 1, 'bot')
2019-02-05 20:32:06 [WARNING ] (13, 1, 'bot')
2019-02-05 20:32:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:32:06 [DEBUG   ] Finished updating board flags in 1.215 seconds
2019-02-05 20:32:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 20:32:34 [DEBUG   ] Got command BAM from MCS: ref #1413009
2019-02-05 20:32:34 [INFO    ] Finished processing BAM request
2019-02-05 20:32:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:32:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1413009   8 58519 73954033 A  ERROR'
2019-02-05 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-02-05 20:32:34 [DEBUG   ] spawn_process: at 2019-02-05 20:32:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-02-05 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-02-05 20:32:34 [DEBUG   ] spawn_process: at 2019-02-05 20:32:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-02-05 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-02-05 20:32:34 [DEBUG   ] spawn_process: at 2019-02-05 20:32:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-02-05 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-02-05 20:32:34 [DEBUG   ] spawn_process: at 2019-02-05 20:32:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-02-05 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-02-05 20:32:34 [DEBUG   ] spawn_process: at 2019-02-05 20:32:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-02-05 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-02-05 20:32:34 [DEBUG   ] spawn_process: at 2019-02-05 20:32:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-02-05 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-02-05 20:32:34 [DEBUG   ] spawn_process: at 2019-02-05 20:32:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-02-05 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-02-05 20:32:34 [DEBUG   ] spawn_process: at 2019-02-05 20:32:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-02-05 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-02-05 20:32:34 [DEBUG   ] spawn_process: at 2019-02-05 20:32:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-02-05 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-02-05 20:32:34 [DEBUG   ] spawn_process: at 2019-02-05 20:32:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-02-05 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-02-05 20:32:34 [DEBUG   ] spawn_process: at 2019-02-05 20:32:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-02-05 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-02-05 20:32:34 [DEBUG   ] spawn_process: at 2019-02-05 20:32:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-02-05 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-02-05 20:32:34 [DEBUG   ] spawn_process: at 2019-02-05 20:32:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-02-05 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-02-05 20:32:34 [DEBUG   ] spawn_process: at 2019-02-05 20:32:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-02-05 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-02-05 20:32:34 [DEBUG   ] spawn_process: at 2019-02-05 20:32:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-02-05 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-02-05 20:32:34 [DEBUG   ] spawn_process: at 2019-02-05 20:32:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-02-05 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-02-05 20:32:34 [DEBUG   ] spawn_process: at 2019-02-05 20:32:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-02-05 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-02-05 20:32:34 [DEBUG   ] spawn_process: at 2019-02-05 20:32:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-02-05 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-02-05 20:32:34 [DEBUG   ] spawn_process: at 2019-02-05 20:32:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-02-05 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-02-05 20:32:34 [DEBUG   ] spawn_process: at 2019-02-05 20:32:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-02-05 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-02-05 20:32:34 [DEBUG   ] spawn_process: at 2019-02-05 20:32:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-02-05 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-02-05 20:32:34 [DEBUG   ] spawn_process: at 2019-02-05 20:32:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-02-05 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-02-05 20:32:34 [DEBUG   ] spawn_process: at 2019-02-05 20:32:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-02-05 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-02-05 20:32:34 [DEBUG   ] spawn_process: at 2019-02-05 20:32:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-02-05 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-02-05 20:32:34 [DEBUG   ] spawn_process: at 2019-02-05 20:32:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-02-05 20:32:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-02-05 20:32:34 [DEBUG   ] spawn_process: at 2019-02-05 20:32:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-02-05 20:32:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 20:32:50 [DEBUG   ] Got command BAM from MCS: ref #1413010
2019-02-05 20:32:50 [INFO    ] Finished processing BAM request
2019-02-05 20:32:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:32:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1413010   8 58519 73970033 A  ERROR'
2019-02-05 20:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-02-05 20:32:50 [DEBUG   ] spawn_process: at 2019-02-05 20:32:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-02-05 20:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-02-05 20:32:50 [DEBUG   ] spawn_process: at 2019-02-05 20:32:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-02-05 20:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-02-05 20:32:50 [DEBUG   ] spawn_process: at 2019-02-05 20:32:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-02-05 20:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-02-05 20:32:50 [DEBUG   ] spawn_process: at 2019-02-05 20:32:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-02-05 20:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-02-05 20:32:50 [DEBUG   ] spawn_process: at 2019-02-05 20:32:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-02-05 20:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-02-05 20:32:50 [DEBUG   ] spawn_process: at 2019-02-05 20:32:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-02-05 20:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-02-05 20:32:50 [DEBUG   ] spawn_process: at 2019-02-05 20:32:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-02-05 20:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-02-05 20:32:50 [DEBUG   ] spawn_process: at 2019-02-05 20:32:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-02-05 20:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-02-05 20:32:50 [DEBUG   ] spawn_process: at 2019-02-05 20:32:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-02-05 20:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-02-05 20:32:50 [DEBUG   ] spawn_process: at 2019-02-05 20:32:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-02-05 20:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-02-05 20:32:50 [DEBUG   ] spawn_process: at 2019-02-05 20:32:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-02-05 20:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-02-05 20:32:50 [DEBUG   ] spawn_process: at 2019-02-05 20:32:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-02-05 20:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-02-05 20:32:50 [DEBUG   ] spawn_process: at 2019-02-05 20:32:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-02-05 20:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-02-05 20:32:50 [DEBUG   ] spawn_process: at 2019-02-05 20:32:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-02-05 20:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-02-05 20:32:50 [DEBUG   ] spawn_process: at 2019-02-05 20:32:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-02-05 20:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-02-05 20:32:50 [DEBUG   ] spawn_process: at 2019-02-05 20:32:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-02-05 20:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-02-05 20:32:50 [DEBUG   ] spawn_process: at 2019-02-05 20:32:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-02-05 20:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-02-05 20:32:50 [DEBUG   ] spawn_process: at 2019-02-05 20:32:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-02-05 20:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-02-05 20:32:50 [DEBUG   ] spawn_process: at 2019-02-05 20:32:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-02-05 20:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-02-05 20:32:50 [DEBUG   ] spawn_process: at 2019-02-05 20:32:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-02-05 20:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-02-05 20:32:50 [DEBUG   ] spawn_process: at 2019-02-05 20:32:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-02-05 20:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-02-05 20:32:50 [DEBUG   ] spawn_process: at 2019-02-05 20:32:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-02-05 20:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-02-05 20:32:50 [DEBUG   ] spawn_process: at 2019-02-05 20:32:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-02-05 20:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-02-05 20:32:50 [DEBUG   ] spawn_process: at 2019-02-05 20:32:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-02-05 20:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-02-05 20:32:50 [DEBUG   ] spawn_process: at 2019-02-05 20:32:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-02-05 20:32:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-02-05 20:32:50 [DEBUG   ] spawn_process: at 2019-02-05 20:32:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-02-05 20:32:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 20:33:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:33:07 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-02-05 20:33:07 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-02-05 20:33:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-02-05 20:33:08 [WARNING ] (13, 1, 'bot')
2019-02-05 20:33:08 [WARNING ] (13, 1, 'bot')
2019-02-05 20:33:08 [WARNING ] (13, 1, 'bot')
2019-02-05 20:33:08 [WARNING ] (13, 1, 'bot')
2019-02-05 20:33:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:33:08 [DEBUG   ] Finished updating board flags in 2.380 seconds
2019-02-05 20:33:19 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-05 20:33:22 [DEBUG   ] Got command BAM from MCS: ref #1413011
2019-02-05 20:33:22 [INFO    ] Finished processing BAM request
2019-02-05 20:33:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:33:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1413011   8 58519 74002025 A  ERROR'
2019-02-05 20:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 20:33:22 [DEBUG   ] spawn_process: at 2019-02-05 20:33:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 20:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 20:33:22 [DEBUG   ] spawn_process: at 2019-02-05 20:33:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 20:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 20:33:22 [DEBUG   ] spawn_process: at 2019-02-05 20:33:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 20:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 20:33:22 [DEBUG   ] spawn_process: at 2019-02-05 20:33:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 20:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 20:33:22 [DEBUG   ] spawn_process: at 2019-02-05 20:33:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 20:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 20:33:22 [DEBUG   ] spawn_process: at 2019-02-05 20:33:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 20:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 20:33:22 [DEBUG   ] spawn_process: at 2019-02-05 20:33:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 20:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 20:33:22 [DEBUG   ] spawn_process: at 2019-02-05 20:33:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 20:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 20:33:22 [DEBUG   ] spawn_process: at 2019-02-05 20:33:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 20:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 20:33:22 [DEBUG   ] spawn_process: at 2019-02-05 20:33:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 20:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 20:33:22 [DEBUG   ] spawn_process: at 2019-02-05 20:33:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 20:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 20:33:22 [DEBUG   ] spawn_process: at 2019-02-05 20:33:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 20:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 20:33:22 [DEBUG   ] spawn_process: at 2019-02-05 20:33:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 20:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 20:33:22 [DEBUG   ] spawn_process: at 2019-02-05 20:33:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 20:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 20:33:22 [DEBUG   ] spawn_process: at 2019-02-05 20:33:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 20:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 20:33:22 [DEBUG   ] spawn_process: at 2019-02-05 20:33:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 20:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 20:33:22 [DEBUG   ] spawn_process: at 2019-02-05 20:33:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 20:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 20:33:22 [DEBUG   ] spawn_process: at 2019-02-05 20:33:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 20:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 20:33:22 [DEBUG   ] spawn_process: at 2019-02-05 20:33:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 20:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 20:33:22 [DEBUG   ] spawn_process: at 2019-02-05 20:33:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 20:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 20:33:22 [DEBUG   ] spawn_process: at 2019-02-05 20:33:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 20:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 20:33:22 [DEBUG   ] spawn_process: at 2019-02-05 20:33:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 20:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 20:33:22 [DEBUG   ] spawn_process: at 2019-02-05 20:33:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 20:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 20:33:22 [DEBUG   ] spawn_process: at 2019-02-05 20:33:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 20:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 20:33:22 [DEBUG   ] spawn_process: at 2019-02-05 20:33:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 20:33:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 20:33:22 [DEBUG   ] spawn_process: at 2019-02-05 20:33:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 20:33:39 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-05 20:33:54 [DEBUG   ] Got command BAM from MCS: ref #1413012
2019-02-05 20:33:54 [INFO    ] Finished processing BAM request
2019-02-05 20:33:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:33:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1413012   8 58519 74034033 A  ERROR'
2019-02-05 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-02-05 20:33:54 [DEBUG   ] spawn_process: at 2019-02-05 20:33:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-02-05 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-02-05 20:33:54 [DEBUG   ] spawn_process: at 2019-02-05 20:33:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-02-05 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-02-05 20:33:54 [DEBUG   ] spawn_process: at 2019-02-05 20:33:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-02-05 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-02-05 20:33:54 [DEBUG   ] spawn_process: at 2019-02-05 20:33:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-02-05 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-02-05 20:33:54 [DEBUG   ] spawn_process: at 2019-02-05 20:33:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-02-05 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-02-05 20:33:54 [DEBUG   ] spawn_process: at 2019-02-05 20:33:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-02-05 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-02-05 20:33:54 [DEBUG   ] spawn_process: at 2019-02-05 20:33:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-02-05 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-02-05 20:33:54 [DEBUG   ] spawn_process: at 2019-02-05 20:33:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-02-05 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-02-05 20:33:54 [DEBUG   ] spawn_process: at 2019-02-05 20:33:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-02-05 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-02-05 20:33:54 [DEBUG   ] spawn_process: at 2019-02-05 20:33:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-02-05 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-02-05 20:33:54 [DEBUG   ] spawn_process: at 2019-02-05 20:33:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-02-05 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-02-05 20:33:54 [DEBUG   ] spawn_process: at 2019-02-05 20:33:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-02-05 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-02-05 20:33:54 [DEBUG   ] spawn_process: at 2019-02-05 20:33:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-02-05 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-02-05 20:33:54 [DEBUG   ] spawn_process: at 2019-02-05 20:33:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-02-05 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-02-05 20:33:54 [DEBUG   ] spawn_process: at 2019-02-05 20:33:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-02-05 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-02-05 20:33:54 [DEBUG   ] spawn_process: at 2019-02-05 20:33:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-02-05 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-02-05 20:33:54 [DEBUG   ] spawn_process: at 2019-02-05 20:33:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-02-05 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-02-05 20:33:54 [DEBUG   ] spawn_process: at 2019-02-05 20:33:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-02-05 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-02-05 20:33:54 [DEBUG   ] spawn_process: at 2019-02-05 20:33:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-02-05 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-02-05 20:33:54 [DEBUG   ] spawn_process: at 2019-02-05 20:33:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-02-05 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-02-05 20:33:54 [DEBUG   ] spawn_process: at 2019-02-05 20:33:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-02-05 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-02-05 20:33:54 [DEBUG   ] spawn_process: at 2019-02-05 20:33:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-02-05 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-02-05 20:33:54 [DEBUG   ] spawn_process: at 2019-02-05 20:33:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-02-05 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-02-05 20:33:54 [DEBUG   ] spawn_process: at 2019-02-05 20:33:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-02-05 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-02-05 20:33:54 [DEBUG   ] spawn_process: at 2019-02-05 20:33:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-02-05 20:33:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-02-05 20:33:54 [DEBUG   ] spawn_process: at 2019-02-05 20:33:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-02-05 20:33:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:34:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 2
2019-02-05 20:34:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:34:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2019-02-05 20:34:06 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2019-02-05 20:34:06 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-02-05 20:34:06 [WARNING ] (13, 1, 'bot')
2019-02-05 20:34:06 [WARNING ] (13, 1, 'bot')
2019-02-05 20:34:06 [WARNING ] (13, 1, 'bot')
2019-02-05 20:34:06 [WARNING ] (13, 1, 'bot')
2019-02-05 20:34:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:34:06 [DEBUG   ] Finished updating board flags in 1.011 seconds
2019-02-05 20:34:09 [DEBUG   ] Got command BAM from MCS: ref #1413013
2019-02-05 20:34:09 [INFO    ] Finished processing BAM request
2019-02-05 20:34:09 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:34:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1413013   8 58519 74049025 A  ERROR'
2019-02-05 20:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-02-05 20:34:09 [DEBUG   ] spawn_process: at 2019-02-05 20:34:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-02-05 20:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-02-05 20:34:09 [DEBUG   ] spawn_process: at 2019-02-05 20:34:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-02-05 20:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-02-05 20:34:09 [DEBUG   ] spawn_process: at 2019-02-05 20:34:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-02-05 20:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-02-05 20:34:09 [DEBUG   ] spawn_process: at 2019-02-05 20:34:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-02-05 20:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-02-05 20:34:09 [DEBUG   ] spawn_process: at 2019-02-05 20:34:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-02-05 20:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-02-05 20:34:09 [DEBUG   ] spawn_process: at 2019-02-05 20:34:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-02-05 20:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-02-05 20:34:09 [DEBUG   ] spawn_process: at 2019-02-05 20:34:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-02-05 20:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-02-05 20:34:09 [DEBUG   ] spawn_process: at 2019-02-05 20:34:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-02-05 20:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-02-05 20:34:09 [DEBUG   ] spawn_process: at 2019-02-05 20:34:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-02-05 20:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-02-05 20:34:09 [DEBUG   ] spawn_process: at 2019-02-05 20:34:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-02-05 20:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-02-05 20:34:09 [DEBUG   ] spawn_process: at 2019-02-05 20:34:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-02-05 20:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-02-05 20:34:09 [DEBUG   ] spawn_process: at 2019-02-05 20:34:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-02-05 20:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-02-05 20:34:09 [DEBUG   ] spawn_process: at 2019-02-05 20:34:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-02-05 20:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-02-05 20:34:09 [DEBUG   ] spawn_process: at 2019-02-05 20:34:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-02-05 20:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-02-05 20:34:09 [DEBUG   ] spawn_process: at 2019-02-05 20:34:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-02-05 20:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-02-05 20:34:09 [DEBUG   ] spawn_process: at 2019-02-05 20:34:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-02-05 20:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-02-05 20:34:09 [DEBUG   ] spawn_process: at 2019-02-05 20:34:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-02-05 20:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-02-05 20:34:09 [DEBUG   ] spawn_process: at 2019-02-05 20:34:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-02-05 20:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-02-05 20:34:09 [DEBUG   ] spawn_process: at 2019-02-05 20:34:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-02-05 20:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-02-05 20:34:09 [DEBUG   ] spawn_process: at 2019-02-05 20:34:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-02-05 20:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-02-05 20:34:09 [DEBUG   ] spawn_process: at 2019-02-05 20:34:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-02-05 20:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-02-05 20:34:09 [DEBUG   ] spawn_process: at 2019-02-05 20:34:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-02-05 20:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-02-05 20:34:09 [DEBUG   ] spawn_process: at 2019-02-05 20:34:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-02-05 20:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-02-05 20:34:09 [DEBUG   ] spawn_process: at 2019-02-05 20:34:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-02-05 20:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-02-05 20:34:09 [DEBUG   ] spawn_process: at 2019-02-05 20:34:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-02-05 20:34:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-02-05 20:34:09 [DEBUG   ] spawn_process: at 2019-02-05 20:34:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-02-05 20:34:19 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:34:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:34:56 [DEBUG   ] Got command BAM from MCS: ref #1413016
2019-02-05 20:34:56 [INFO    ] Finished processing BAM request
2019-02-05 20:34:56 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:34:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1413016   8 58519 74096033 A  ERROR'
2019-02-05 20:34:56 [DEBUG   ] Got command RPT from MCS: ref #1413017
2019-02-05 20:34:56 [DEBUG   ] summary = ERROR
2019-02-05 20:34:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413017  13 58519 74096897 A  ERRORERROR'
2019-02-05 20:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 20:34:56 [DEBUG   ] spawn_process: at 2019-02-05 20:34:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 20:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 20:34:56 [DEBUG   ] spawn_process: at 2019-02-05 20:34:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 20:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 20:34:56 [DEBUG   ] spawn_process: at 2019-02-05 20:34:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 20:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 20:34:56 [DEBUG   ] spawn_process: at 2019-02-05 20:34:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 20:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 20:34:56 [DEBUG   ] spawn_process: at 2019-02-05 20:34:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 20:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 20:34:56 [DEBUG   ] spawn_process: at 2019-02-05 20:34:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 20:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 20:34:56 [DEBUG   ] spawn_process: at 2019-02-05 20:34:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 20:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 20:34:56 [DEBUG   ] spawn_process: at 2019-02-05 20:34:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 20:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 20:34:56 [DEBUG   ] spawn_process: at 2019-02-05 20:34:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 20:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 20:34:56 [DEBUG   ] spawn_process: at 2019-02-05 20:34:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 20:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 20:34:56 [DEBUG   ] spawn_process: at 2019-02-05 20:34:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 20:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 20:34:56 [DEBUG   ] spawn_process: at 2019-02-05 20:34:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 20:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 20:34:56 [DEBUG   ] spawn_process: at 2019-02-05 20:34:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 20:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 20:34:56 [DEBUG   ] spawn_process: at 2019-02-05 20:34:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 20:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 20:34:56 [DEBUG   ] spawn_process: at 2019-02-05 20:34:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 20:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 20:34:56 [DEBUG   ] spawn_process: at 2019-02-05 20:34:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 20:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 20:34:56 [DEBUG   ] spawn_process: at 2019-02-05 20:34:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 20:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 20:34:56 [DEBUG   ] spawn_process: at 2019-02-05 20:34:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 20:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 20:34:56 [DEBUG   ] spawn_process: at 2019-02-05 20:34:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 20:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 20:34:56 [DEBUG   ] spawn_process: at 2019-02-05 20:34:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 20:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 20:34:56 [DEBUG   ] spawn_process: at 2019-02-05 20:34:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 20:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 20:34:56 [DEBUG   ] spawn_process: at 2019-02-05 20:34:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 20:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 20:34:56 [DEBUG   ] spawn_process: at 2019-02-05 20:34:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 20:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 20:34:56 [DEBUG   ] spawn_process: at 2019-02-05 20:34:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 20:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 20:34:56 [DEBUG   ] spawn_process: at 2019-02-05 20:34:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 20:34:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 20:34:56 [DEBUG   ] spawn_process: at 2019-02-05 20:34:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 20:34:57 [DEBUG   ] Got command RPT from MCS: ref #1413019
2019-02-05 20:34:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 20:34:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413019  77 58519 74097101 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 20:34:57 [DEBUG   ] Got command RPT from MCS: ref #1413020
2019-02-05 20:34:57 [DEBUG   ] summary = ERROR
2019-02-05 20:34:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413020  13 58519 74097305 A  ERRORERROR'
2019-02-05 20:34:57 [DEBUG   ] Got command RPT from MCS: ref #1413022
2019-02-05 20:34:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 20:34:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413022  77 58519 74097509 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 20:34:57 [DEBUG   ] Got command RPT from MCS: ref #1413023
2019-02-05 20:34:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 20:34:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413023  12 58519 74097701 A  ERRORB¥ff'
2019-02-05 20:34:58 [DEBUG   ] Got command BAM from MCS: ref #1413018
2019-02-05 20:34:58 [INFO    ] Finished processing BAM request
2019-02-05 20:34:58 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:34:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1413018   8 58519 74098029 A  ERROR'
2019-02-05 20:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-02-05 20:34:58 [DEBUG   ] spawn_process: at 2019-02-05 20:34:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-02-05 20:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-02-05 20:34:58 [DEBUG   ] spawn_process: at 2019-02-05 20:34:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-02-05 20:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-02-05 20:34:58 [DEBUG   ] spawn_process: at 2019-02-05 20:34:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-02-05 20:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-02-05 20:34:58 [DEBUG   ] spawn_process: at 2019-02-05 20:34:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-02-05 20:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-02-05 20:34:58 [DEBUG   ] spawn_process: at 2019-02-05 20:34:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-02-05 20:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-02-05 20:34:58 [DEBUG   ] spawn_process: at 2019-02-05 20:34:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-02-05 20:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-02-05 20:34:58 [DEBUG   ] spawn_process: at 2019-02-05 20:34:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-02-05 20:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-02-05 20:34:58 [DEBUG   ] spawn_process: at 2019-02-05 20:34:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-02-05 20:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-02-05 20:34:58 [DEBUG   ] spawn_process: at 2019-02-05 20:34:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-02-05 20:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-02-05 20:34:58 [DEBUG   ] spawn_process: at 2019-02-05 20:34:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-02-05 20:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-02-05 20:34:58 [DEBUG   ] spawn_process: at 2019-02-05 20:34:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-02-05 20:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-02-05 20:34:58 [DEBUG   ] spawn_process: at 2019-02-05 20:34:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-02-05 20:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-02-05 20:34:58 [DEBUG   ] spawn_process: at 2019-02-05 20:34:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-02-05 20:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-02-05 20:34:58 [DEBUG   ] spawn_process: at 2019-02-05 20:34:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-02-05 20:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-02-05 20:34:58 [DEBUG   ] spawn_process: at 2019-02-05 20:34:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-02-05 20:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-02-05 20:34:58 [DEBUG   ] spawn_process: at 2019-02-05 20:34:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-02-05 20:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-02-05 20:34:58 [DEBUG   ] spawn_process: at 2019-02-05 20:34:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-02-05 20:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-02-05 20:34:58 [DEBUG   ] spawn_process: at 2019-02-05 20:34:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-02-05 20:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-02-05 20:34:58 [DEBUG   ] spawn_process: at 2019-02-05 20:34:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-02-05 20:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-02-05 20:34:58 [DEBUG   ] spawn_process: at 2019-02-05 20:34:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-02-05 20:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-02-05 20:34:58 [DEBUG   ] spawn_process: at 2019-02-05 20:34:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-02-05 20:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-02-05 20:34:58 [DEBUG   ] spawn_process: at 2019-02-05 20:34:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-02-05 20:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-02-05 20:34:58 [DEBUG   ] spawn_process: at 2019-02-05 20:34:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-02-05 20:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-02-05 20:34:58 [DEBUG   ] spawn_process: at 2019-02-05 20:34:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-02-05 20:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-02-05 20:34:58 [DEBUG   ] spawn_process: at 2019-02-05 20:34:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-02-05 20:34:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-02-05 20:34:58 [DEBUG   ] spawn_process: at 2019-02-05 20:34:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-02-05 20:34:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:35:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2019-02-05 20:35:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:35:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-02-05 20:35:06 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2019-02-05 20:35:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2019-02-05 20:35:06 [WARNING ] (13, 1, 'bot')
2019-02-05 20:35:06 [WARNING ] (13, 1, 'bot')
2019-02-05 20:35:06 [WARNING ] (13, 1, 'bot')
2019-02-05 20:35:06 [WARNING ] (13, 1, 'bot')
2019-02-05 20:35:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:35:06 [DEBUG   ] Finished updating board flags in 1.000 seconds
2019-02-05 20:35:19 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:35:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:35:43 [DEBUG   ] Got command BAM from MCS: ref #1413032
2019-02-05 20:35:43 [INFO    ] Finished processing BAM request
2019-02-05 20:35:43 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:35:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1413032   8 58519 74143029 A  ERROR'
2019-02-05 20:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-02-05 20:35:43 [DEBUG   ] spawn_process: at 2019-02-05 20:35:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-02-05 20:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-02-05 20:35:43 [DEBUG   ] spawn_process: at 2019-02-05 20:35:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-02-05 20:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-02-05 20:35:43 [DEBUG   ] spawn_process: at 2019-02-05 20:35:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-02-05 20:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-02-05 20:35:43 [DEBUG   ] spawn_process: at 2019-02-05 20:35:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-02-05 20:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-02-05 20:35:43 [DEBUG   ] spawn_process: at 2019-02-05 20:35:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-02-05 20:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-02-05 20:35:43 [DEBUG   ] spawn_process: at 2019-02-05 20:35:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-02-05 20:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-02-05 20:35:43 [DEBUG   ] spawn_process: at 2019-02-05 20:35:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-02-05 20:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-02-05 20:35:43 [DEBUG   ] spawn_process: at 2019-02-05 20:35:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-02-05 20:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-02-05 20:35:43 [DEBUG   ] spawn_process: at 2019-02-05 20:35:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-02-05 20:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-02-05 20:35:43 [DEBUG   ] spawn_process: at 2019-02-05 20:35:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-02-05 20:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-02-05 20:35:43 [DEBUG   ] spawn_process: at 2019-02-05 20:35:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-02-05 20:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-02-05 20:35:43 [DEBUG   ] spawn_process: at 2019-02-05 20:35:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-02-05 20:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-02-05 20:35:43 [DEBUG   ] spawn_process: at 2019-02-05 20:35:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-02-05 20:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-02-05 20:35:43 [DEBUG   ] spawn_process: at 2019-02-05 20:35:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-02-05 20:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-02-05 20:35:43 [DEBUG   ] spawn_process: at 2019-02-05 20:35:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-02-05 20:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-02-05 20:35:43 [DEBUG   ] spawn_process: at 2019-02-05 20:35:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-02-05 20:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-02-05 20:35:43 [DEBUG   ] spawn_process: at 2019-02-05 20:35:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-02-05 20:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-02-05 20:35:43 [DEBUG   ] spawn_process: at 2019-02-05 20:35:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-02-05 20:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-02-05 20:35:43 [DEBUG   ] spawn_process: at 2019-02-05 20:35:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-02-05 20:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-02-05 20:35:43 [DEBUG   ] spawn_process: at 2019-02-05 20:35:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-02-05 20:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-02-05 20:35:43 [DEBUG   ] spawn_process: at 2019-02-05 20:35:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-02-05 20:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-02-05 20:35:43 [DEBUG   ] spawn_process: at 2019-02-05 20:35:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-02-05 20:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-02-05 20:35:43 [DEBUG   ] spawn_process: at 2019-02-05 20:35:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-02-05 20:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-02-05 20:35:43 [DEBUG   ] spawn_process: at 2019-02-05 20:35:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-02-05 20:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-02-05 20:35:43 [DEBUG   ] spawn_process: at 2019-02-05 20:35:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-02-05 20:35:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-02-05 20:35:43 [DEBUG   ] spawn_process: at 2019-02-05 20:35:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-02-05 20:35:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:36:02 [DEBUG   ] Got command BAM from MCS: ref #1413033
2019-02-05 20:36:02 [INFO    ] Finished processing BAM request
2019-02-05 20:36:02 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:36:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1413033   8 58519 74162033 A  ERROR'
2019-02-05 20:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 20:36:02 [DEBUG   ] spawn_process: at 2019-02-05 20:36:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 20:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 20:36:02 [DEBUG   ] spawn_process: at 2019-02-05 20:36:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 20:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 20:36:02 [DEBUG   ] spawn_process: at 2019-02-05 20:36:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 20:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 20:36:02 [DEBUG   ] spawn_process: at 2019-02-05 20:36:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 20:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 20:36:02 [DEBUG   ] spawn_process: at 2019-02-05 20:36:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 20:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 20:36:02 [DEBUG   ] spawn_process: at 2019-02-05 20:36:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 20:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 20:36:02 [DEBUG   ] spawn_process: at 2019-02-05 20:36:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 20:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 20:36:02 [DEBUG   ] spawn_process: at 2019-02-05 20:36:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 20:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 20:36:02 [DEBUG   ] spawn_process: at 2019-02-05 20:36:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 20:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 20:36:02 [DEBUG   ] spawn_process: at 2019-02-05 20:36:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 20:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 20:36:02 [DEBUG   ] spawn_process: at 2019-02-05 20:36:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 20:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 20:36:02 [DEBUG   ] spawn_process: at 2019-02-05 20:36:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 20:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 20:36:02 [DEBUG   ] spawn_process: at 2019-02-05 20:36:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 20:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 20:36:02 [DEBUG   ] spawn_process: at 2019-02-05 20:36:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 20:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 20:36:02 [DEBUG   ] spawn_process: at 2019-02-05 20:36:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 20:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 20:36:02 [DEBUG   ] spawn_process: at 2019-02-05 20:36:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 20:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 20:36:02 [DEBUG   ] spawn_process: at 2019-02-05 20:36:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 20:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 20:36:02 [DEBUG   ] spawn_process: at 2019-02-05 20:36:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 20:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 20:36:02 [DEBUG   ] spawn_process: at 2019-02-05 20:36:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 20:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 20:36:02 [DEBUG   ] spawn_process: at 2019-02-05 20:36:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 20:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 20:36:02 [DEBUG   ] spawn_process: at 2019-02-05 20:36:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 20:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 20:36:02 [DEBUG   ] spawn_process: at 2019-02-05 20:36:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 20:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 20:36:02 [DEBUG   ] spawn_process: at 2019-02-05 20:36:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 20:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 20:36:02 [DEBUG   ] spawn_process: at 2019-02-05 20:36:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 20:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 20:36:02 [DEBUG   ] spawn_process: at 2019-02-05 20:36:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 20:36:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 20:36:02 [DEBUG   ] spawn_process: at 2019-02-05 20:36:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 20:36:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 20:36:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-02-05 20:36:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:36:06 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-02-05 20:36:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2019-02-05 20:36:06 [WARNING ] (13, 1, 'bot')
2019-02-05 20:36:06 [WARNING ] (13, 1, 'bot')
2019-02-05 20:36:06 [WARNING ] (13, 1, 'bot')
2019-02-05 20:36:06 [WARNING ] (13, 1, 'bot')
2019-02-05 20:36:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:36:06 [DEBUG   ] Finished updating board flags in 1.019 seconds
2019-02-05 20:36:12 [DEBUG   ] Got command RPT from MCS: ref #1413034
2019-02-05 20:36:12 [DEBUG   ] summary = ERROR
2019-02-05 20:36:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413034  13 58519 74172033 A  ERRORERROR'
2019-02-05 20:36:12 [DEBUG   ] Got command RPT from MCS: ref #1413035
2019-02-05 20:36:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 20:36:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413035  77 58519 74172034 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 20:36:19 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:36:30 [DEBUG   ] Got command BAM from MCS: ref #1413051
2019-02-05 20:36:30 [INFO    ] Finished processing BAM request
2019-02-05 20:36:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:36:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1413051   8 58519 74190033 A  ERROR'
2019-02-05 20:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-02-05 20:36:30 [DEBUG   ] spawn_process: at 2019-02-05 20:36:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-02-05 20:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-02-05 20:36:30 [DEBUG   ] spawn_process: at 2019-02-05 20:36:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-02-05 20:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-02-05 20:36:30 [DEBUG   ] spawn_process: at 2019-02-05 20:36:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-02-05 20:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-02-05 20:36:30 [DEBUG   ] spawn_process: at 2019-02-05 20:36:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-02-05 20:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-02-05 20:36:30 [DEBUG   ] spawn_process: at 2019-02-05 20:36:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-02-05 20:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-02-05 20:36:30 [DEBUG   ] spawn_process: at 2019-02-05 20:36:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-02-05 20:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-02-05 20:36:30 [DEBUG   ] spawn_process: at 2019-02-05 20:36:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-02-05 20:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-02-05 20:36:30 [DEBUG   ] spawn_process: at 2019-02-05 20:36:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-02-05 20:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-02-05 20:36:30 [DEBUG   ] spawn_process: at 2019-02-05 20:36:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-02-05 20:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-02-05 20:36:30 [DEBUG   ] spawn_process: at 2019-02-05 20:36:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-02-05 20:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-02-05 20:36:30 [DEBUG   ] spawn_process: at 2019-02-05 20:36:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-02-05 20:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-02-05 20:36:30 [DEBUG   ] spawn_process: at 2019-02-05 20:36:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-02-05 20:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-02-05 20:36:30 [DEBUG   ] spawn_process: at 2019-02-05 20:36:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-02-05 20:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-02-05 20:36:30 [DEBUG   ] spawn_process: at 2019-02-05 20:36:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-02-05 20:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-02-05 20:36:30 [DEBUG   ] spawn_process: at 2019-02-05 20:36:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-02-05 20:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-02-05 20:36:30 [DEBUG   ] spawn_process: at 2019-02-05 20:36:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-02-05 20:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-02-05 20:36:30 [DEBUG   ] spawn_process: at 2019-02-05 20:36:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-02-05 20:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-02-05 20:36:30 [DEBUG   ] spawn_process: at 2019-02-05 20:36:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-02-05 20:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-02-05 20:36:30 [DEBUG   ] spawn_process: at 2019-02-05 20:36:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-02-05 20:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-02-05 20:36:30 [DEBUG   ] spawn_process: at 2019-02-05 20:36:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-02-05 20:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-02-05 20:36:30 [DEBUG   ] spawn_process: at 2019-02-05 20:36:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-02-05 20:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-02-05 20:36:30 [DEBUG   ] spawn_process: at 2019-02-05 20:36:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-02-05 20:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-02-05 20:36:30 [DEBUG   ] spawn_process: at 2019-02-05 20:36:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-02-05 20:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-02-05 20:36:30 [DEBUG   ] spawn_process: at 2019-02-05 20:36:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-02-05 20:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-02-05 20:36:30 [DEBUG   ] spawn_process: at 2019-02-05 20:36:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-02-05 20:36:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-02-05 20:36:30 [DEBUG   ] spawn_process: at 2019-02-05 20:36:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-02-05 20:36:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:36:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:37:06 [DEBUG   ] Got command BAM from MCS: ref #1413052
2019-02-05 20:37:06 [INFO    ] Finished processing BAM request
2019-02-05 20:37:06 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:37:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1413052   8 58519 74226029 A  ERROR'
2019-02-05 20:37:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-02-05 20:37:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-02-05 20:37:06 [DEBUG   ] spawn_process: at 2019-02-05 20:37:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-02-05 20:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-02-05 20:37:06 [DEBUG   ] spawn_process: at 2019-02-05 20:37:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-02-05 20:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-02-05 20:37:06 [DEBUG   ] spawn_process: at 2019-02-05 20:37:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-02-05 20:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-02-05 20:37:06 [DEBUG   ] spawn_process: at 2019-02-05 20:37:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-02-05 20:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-02-05 20:37:06 [DEBUG   ] spawn_process: at 2019-02-05 20:37:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-02-05 20:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-02-05 20:37:06 [DEBUG   ] spawn_process: at 2019-02-05 20:37:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-02-05 20:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-02-05 20:37:06 [DEBUG   ] spawn_process: at 2019-02-05 20:37:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-02-05 20:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-02-05 20:37:06 [DEBUG   ] spawn_process: at 2019-02-05 20:37:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-02-05 20:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-02-05 20:37:06 [DEBUG   ] spawn_process: at 2019-02-05 20:37:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-02-05 20:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-02-05 20:37:06 [DEBUG   ] spawn_process: at 2019-02-05 20:37:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-02-05 20:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-02-05 20:37:06 [DEBUG   ] spawn_process: at 2019-02-05 20:37:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-02-05 20:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-02-05 20:37:06 [DEBUG   ] spawn_process: at 2019-02-05 20:37:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-02-05 20:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-02-05 20:37:06 [DEBUG   ] spawn_process: at 2019-02-05 20:37:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-02-05 20:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-02-05 20:37:06 [DEBUG   ] spawn_process: at 2019-02-05 20:37:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-02-05 20:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-02-05 20:37:06 [DEBUG   ] spawn_process: at 2019-02-05 20:37:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-02-05 20:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-02-05 20:37:06 [DEBUG   ] spawn_process: at 2019-02-05 20:37:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-02-05 20:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-02-05 20:37:06 [DEBUG   ] spawn_process: at 2019-02-05 20:37:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-02-05 20:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-02-05 20:37:06 [DEBUG   ] spawn_process: at 2019-02-05 20:37:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-02-05 20:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-02-05 20:37:06 [DEBUG   ] spawn_process: at 2019-02-05 20:37:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-02-05 20:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-02-05 20:37:06 [DEBUG   ] spawn_process: at 2019-02-05 20:37:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-02-05 20:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-02-05 20:37:06 [DEBUG   ] spawn_process: at 2019-02-05 20:37:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-02-05 20:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-02-05 20:37:06 [DEBUG   ] spawn_process: at 2019-02-05 20:37:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-02-05 20:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-02-05 20:37:06 [DEBUG   ] spawn_process: at 2019-02-05 20:37:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-02-05 20:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-02-05 20:37:06 [DEBUG   ] spawn_process: at 2019-02-05 20:37:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-02-05 20:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-02-05 20:37:06 [DEBUG   ] spawn_process: at 2019-02-05 20:37:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-02-05 20:37:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-02-05 20:37:06 [DEBUG   ] spawn_process: at 2019-02-05 20:37:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-02-05 20:37:07 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2019-02-05 20:37:07 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-02-05 20:37:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-02-05 20:37:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:37:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:37:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:37:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:37:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:37:07 [DEBUG   ] Finished updating board flags in 1.540 seconds
2019-02-05 20:37:17 [DEBUG   ] Got command BAM from MCS: ref #1413053
2019-02-05 20:37:17 [INFO    ] Finished processing BAM request
2019-02-05 20:37:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:37:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1413053   8 58519 74237029 A  ERROR'
2019-02-05 20:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 20:37:17 [DEBUG   ] spawn_process: at 2019-02-05 20:37:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 20:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 20:37:17 [DEBUG   ] spawn_process: at 2019-02-05 20:37:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 20:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 20:37:17 [DEBUG   ] spawn_process: at 2019-02-05 20:37:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 20:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 20:37:17 [DEBUG   ] spawn_process: at 2019-02-05 20:37:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 20:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 20:37:17 [DEBUG   ] spawn_process: at 2019-02-05 20:37:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 20:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 20:37:17 [DEBUG   ] spawn_process: at 2019-02-05 20:37:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 20:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 20:37:17 [DEBUG   ] spawn_process: at 2019-02-05 20:37:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 20:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 20:37:17 [DEBUG   ] spawn_process: at 2019-02-05 20:37:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 20:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 20:37:17 [DEBUG   ] spawn_process: at 2019-02-05 20:37:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 20:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 20:37:17 [DEBUG   ] spawn_process: at 2019-02-05 20:37:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 20:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 20:37:17 [DEBUG   ] spawn_process: at 2019-02-05 20:37:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 20:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 20:37:17 [DEBUG   ] spawn_process: at 2019-02-05 20:37:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 20:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 20:37:17 [DEBUG   ] spawn_process: at 2019-02-05 20:37:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 20:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 20:37:17 [DEBUG   ] spawn_process: at 2019-02-05 20:37:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 20:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 20:37:17 [DEBUG   ] spawn_process: at 2019-02-05 20:37:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 20:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 20:37:17 [DEBUG   ] spawn_process: at 2019-02-05 20:37:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 20:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 20:37:17 [DEBUG   ] spawn_process: at 2019-02-05 20:37:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 20:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 20:37:17 [DEBUG   ] spawn_process: at 2019-02-05 20:37:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 20:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 20:37:17 [DEBUG   ] spawn_process: at 2019-02-05 20:37:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 20:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 20:37:17 [DEBUG   ] spawn_process: at 2019-02-05 20:37:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 20:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 20:37:17 [DEBUG   ] spawn_process: at 2019-02-05 20:37:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 20:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 20:37:17 [DEBUG   ] spawn_process: at 2019-02-05 20:37:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 20:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 20:37:17 [DEBUG   ] spawn_process: at 2019-02-05 20:37:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 20:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 20:37:17 [DEBUG   ] spawn_process: at 2019-02-05 20:37:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 20:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 20:37:17 [DEBUG   ] spawn_process: at 2019-02-05 20:37:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 20:37:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 20:37:17 [DEBUG   ] spawn_process: at 2019-02-05 20:37:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 20:37:19 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-05 20:37:39 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-02-05 20:37:59 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 20:38:03 [DEBUG   ] Got command BAM from MCS: ref #1413054
2019-02-05 20:38:03 [INFO    ] Finished processing BAM request
2019-02-05 20:38:03 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:38:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1413054   8 58519 74283025 A  ERROR'
2019-02-05 20:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-02-05 20:38:03 [DEBUG   ] spawn_process: at 2019-02-05 20:38:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-02-05 20:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-02-05 20:38:03 [DEBUG   ] spawn_process: at 2019-02-05 20:38:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-02-05 20:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-02-05 20:38:03 [DEBUG   ] spawn_process: at 2019-02-05 20:38:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-02-05 20:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-02-05 20:38:03 [DEBUG   ] spawn_process: at 2019-02-05 20:38:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-02-05 20:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-02-05 20:38:03 [DEBUG   ] spawn_process: at 2019-02-05 20:38:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-02-05 20:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-02-05 20:38:03 [DEBUG   ] spawn_process: at 2019-02-05 20:38:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-02-05 20:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-02-05 20:38:03 [DEBUG   ] spawn_process: at 2019-02-05 20:38:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-02-05 20:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-02-05 20:38:03 [DEBUG   ] spawn_process: at 2019-02-05 20:38:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-02-05 20:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-02-05 20:38:03 [DEBUG   ] spawn_process: at 2019-02-05 20:38:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-02-05 20:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-02-05 20:38:03 [DEBUG   ] spawn_process: at 2019-02-05 20:38:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-02-05 20:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-02-05 20:38:03 [DEBUG   ] spawn_process: at 2019-02-05 20:38:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-02-05 20:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-02-05 20:38:03 [DEBUG   ] spawn_process: at 2019-02-05 20:38:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-02-05 20:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-02-05 20:38:03 [DEBUG   ] spawn_process: at 2019-02-05 20:38:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-02-05 20:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-02-05 20:38:03 [DEBUG   ] spawn_process: at 2019-02-05 20:38:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-02-05 20:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-02-05 20:38:03 [DEBUG   ] spawn_process: at 2019-02-05 20:38:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-02-05 20:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-02-05 20:38:03 [DEBUG   ] spawn_process: at 2019-02-05 20:38:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-02-05 20:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-02-05 20:38:03 [DEBUG   ] spawn_process: at 2019-02-05 20:38:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-02-05 20:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-02-05 20:38:03 [DEBUG   ] spawn_process: at 2019-02-05 20:38:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-02-05 20:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-02-05 20:38:03 [DEBUG   ] spawn_process: at 2019-02-05 20:38:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-02-05 20:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-02-05 20:38:03 [DEBUG   ] spawn_process: at 2019-02-05 20:38:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-02-05 20:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-02-05 20:38:03 [DEBUG   ] spawn_process: at 2019-02-05 20:38:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-02-05 20:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-02-05 20:38:03 [DEBUG   ] spawn_process: at 2019-02-05 20:38:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-02-05 20:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-02-05 20:38:03 [DEBUG   ] spawn_process: at 2019-02-05 20:38:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-02-05 20:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-02-05 20:38:03 [DEBUG   ] spawn_process: at 2019-02-05 20:38:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-02-05 20:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-02-05 20:38:03 [DEBUG   ] spawn_process: at 2019-02-05 20:38:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-02-05 20:38:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-02-05 20:38:03 [DEBUG   ] spawn_process: at 2019-02-05 20:38:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-02-05 20:38:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-02-05 20:38:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:38:07 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-02-05 20:38:07 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-02-05 20:38:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:38:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:38:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:38:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:38:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:38:07 [DEBUG   ] Finished updating board flags in 1.475 seconds
2019-02-05 20:38:10 [DEBUG   ] Got command BAM from MCS: ref #1413055
2019-02-05 20:38:10 [INFO    ] Finished processing BAM request
2019-02-05 20:38:10 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:38:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1413055   8 58519 74290033 A  ERROR'
2019-02-05 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-02-05 20:38:10 [DEBUG   ] spawn_process: at 2019-02-05 20:38:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-02-05 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-02-05 20:38:10 [DEBUG   ] spawn_process: at 2019-02-05 20:38:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-02-05 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-02-05 20:38:10 [DEBUG   ] spawn_process: at 2019-02-05 20:38:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-02-05 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-02-05 20:38:10 [DEBUG   ] spawn_process: at 2019-02-05 20:38:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-02-05 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-02-05 20:38:10 [DEBUG   ] spawn_process: at 2019-02-05 20:38:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-02-05 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-02-05 20:38:10 [DEBUG   ] spawn_process: at 2019-02-05 20:38:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-02-05 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-02-05 20:38:10 [DEBUG   ] spawn_process: at 2019-02-05 20:38:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-02-05 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-02-05 20:38:10 [DEBUG   ] spawn_process: at 2019-02-05 20:38:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-02-05 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-02-05 20:38:10 [DEBUG   ] spawn_process: at 2019-02-05 20:38:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-02-05 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-02-05 20:38:10 [DEBUG   ] spawn_process: at 2019-02-05 20:38:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-02-05 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-02-05 20:38:10 [DEBUG   ] spawn_process: at 2019-02-05 20:38:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-02-05 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-02-05 20:38:10 [DEBUG   ] spawn_process: at 2019-02-05 20:38:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-02-05 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-02-05 20:38:10 [DEBUG   ] spawn_process: at 2019-02-05 20:38:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-02-05 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-02-05 20:38:10 [DEBUG   ] spawn_process: at 2019-02-05 20:38:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-02-05 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-02-05 20:38:10 [DEBUG   ] spawn_process: at 2019-02-05 20:38:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-02-05 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-02-05 20:38:10 [DEBUG   ] spawn_process: at 2019-02-05 20:38:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-02-05 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-02-05 20:38:10 [DEBUG   ] spawn_process: at 2019-02-05 20:38:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-02-05 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-02-05 20:38:10 [DEBUG   ] spawn_process: at 2019-02-05 20:38:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-02-05 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-02-05 20:38:10 [DEBUG   ] spawn_process: at 2019-02-05 20:38:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-02-05 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-02-05 20:38:10 [DEBUG   ] spawn_process: at 2019-02-05 20:38:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-02-05 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-02-05 20:38:10 [DEBUG   ] spawn_process: at 2019-02-05 20:38:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-02-05 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-02-05 20:38:10 [DEBUG   ] spawn_process: at 2019-02-05 20:38:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-02-05 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-02-05 20:38:10 [DEBUG   ] spawn_process: at 2019-02-05 20:38:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-02-05 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-02-05 20:38:10 [DEBUG   ] spawn_process: at 2019-02-05 20:38:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-02-05 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-02-05 20:38:10 [DEBUG   ] spawn_process: at 2019-02-05 20:38:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-02-05 20:38:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-02-05 20:38:10 [DEBUG   ] spawn_process: at 2019-02-05 20:38:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-02-05 20:38:19 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 20:38:39 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 20:38:49 [DEBUG   ] Got command BAM from MCS: ref #1413060
2019-02-05 20:38:49 [INFO    ] Finished processing BAM request
2019-02-05 20:38:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:38:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1413060   8 58519 74329025 A  ERROR'
2019-02-05 20:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-02-05 20:38:49 [DEBUG   ] spawn_process: at 2019-02-05 20:38:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-02-05 20:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-02-05 20:38:49 [DEBUG   ] spawn_process: at 2019-02-05 20:38:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-02-05 20:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-02-05 20:38:49 [DEBUG   ] spawn_process: at 2019-02-05 20:38:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-02-05 20:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-02-05 20:38:49 [DEBUG   ] spawn_process: at 2019-02-05 20:38:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-02-05 20:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-02-05 20:38:49 [DEBUG   ] spawn_process: at 2019-02-05 20:38:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-02-05 20:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-02-05 20:38:49 [DEBUG   ] spawn_process: at 2019-02-05 20:38:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-02-05 20:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-02-05 20:38:49 [DEBUG   ] spawn_process: at 2019-02-05 20:38:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-02-05 20:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-02-05 20:38:49 [DEBUG   ] spawn_process: at 2019-02-05 20:38:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-02-05 20:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-02-05 20:38:49 [DEBUG   ] spawn_process: at 2019-02-05 20:38:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-02-05 20:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-02-05 20:38:49 [DEBUG   ] spawn_process: at 2019-02-05 20:38:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-02-05 20:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-02-05 20:38:49 [DEBUG   ] spawn_process: at 2019-02-05 20:38:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-02-05 20:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-02-05 20:38:49 [DEBUG   ] spawn_process: at 2019-02-05 20:38:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-02-05 20:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-02-05 20:38:49 [DEBUG   ] spawn_process: at 2019-02-05 20:38:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-02-05 20:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-02-05 20:38:49 [DEBUG   ] spawn_process: at 2019-02-05 20:38:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-02-05 20:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-02-05 20:38:49 [DEBUG   ] spawn_process: at 2019-02-05 20:38:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-02-05 20:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-02-05 20:38:49 [DEBUG   ] spawn_process: at 2019-02-05 20:38:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-02-05 20:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-02-05 20:38:49 [DEBUG   ] spawn_process: at 2019-02-05 20:38:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-02-05 20:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-02-05 20:38:49 [DEBUG   ] spawn_process: at 2019-02-05 20:38:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-02-05 20:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-02-05 20:38:49 [DEBUG   ] spawn_process: at 2019-02-05 20:38:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-02-05 20:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-02-05 20:38:49 [DEBUG   ] spawn_process: at 2019-02-05 20:38:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-02-05 20:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-02-05 20:38:49 [DEBUG   ] spawn_process: at 2019-02-05 20:38:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-02-05 20:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-02-05 20:38:49 [DEBUG   ] spawn_process: at 2019-02-05 20:38:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-02-05 20:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-02-05 20:38:49 [DEBUG   ] spawn_process: at 2019-02-05 20:38:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-02-05 20:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-02-05 20:38:49 [DEBUG   ] spawn_process: at 2019-02-05 20:38:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-02-05 20:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-02-05 20:38:49 [DEBUG   ] spawn_process: at 2019-02-05 20:38:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-02-05 20:38:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-02-05 20:38:49 [DEBUG   ] spawn_process: at 2019-02-05 20:38:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-02-05 20:38:59 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 20:39:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-02-05 20:39:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-02-05 20:39:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:39:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 20:39:07 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-02-05 20:39:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:39:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:39:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:39:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:39:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:39:07 [DEBUG   ] Finished updating board flags in 1.322 seconds
2019-02-05 20:39:14 [DEBUG   ] Got command BAM from MCS: ref #1413061
2019-02-05 20:39:14 [INFO    ] Finished processing BAM request
2019-02-05 20:39:14 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:39:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1413061   8 58519 74354029 A  ERROR'
2019-02-05 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-02-05 20:39:14 [DEBUG   ] spawn_process: at 2019-02-05 20:39:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-02-05 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-02-05 20:39:14 [DEBUG   ] spawn_process: at 2019-02-05 20:39:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-02-05 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-02-05 20:39:14 [DEBUG   ] spawn_process: at 2019-02-05 20:39:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-02-05 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-02-05 20:39:14 [DEBUG   ] spawn_process: at 2019-02-05 20:39:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-02-05 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-02-05 20:39:14 [DEBUG   ] spawn_process: at 2019-02-05 20:39:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-02-05 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-02-05 20:39:14 [DEBUG   ] spawn_process: at 2019-02-05 20:39:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-02-05 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-02-05 20:39:14 [DEBUG   ] spawn_process: at 2019-02-05 20:39:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-02-05 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-02-05 20:39:14 [DEBUG   ] spawn_process: at 2019-02-05 20:39:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-02-05 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-02-05 20:39:14 [DEBUG   ] spawn_process: at 2019-02-05 20:39:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-02-05 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-02-05 20:39:14 [DEBUG   ] spawn_process: at 2019-02-05 20:39:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-02-05 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-02-05 20:39:14 [DEBUG   ] spawn_process: at 2019-02-05 20:39:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-02-05 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-02-05 20:39:14 [DEBUG   ] spawn_process: at 2019-02-05 20:39:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-02-05 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-02-05 20:39:14 [DEBUG   ] spawn_process: at 2019-02-05 20:39:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-02-05 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-02-05 20:39:14 [DEBUG   ] spawn_process: at 2019-02-05 20:39:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-02-05 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-02-05 20:39:14 [DEBUG   ] spawn_process: at 2019-02-05 20:39:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-02-05 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-02-05 20:39:14 [DEBUG   ] spawn_process: at 2019-02-05 20:39:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-02-05 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-02-05 20:39:14 [DEBUG   ] spawn_process: at 2019-02-05 20:39:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-02-05 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-02-05 20:39:14 [DEBUG   ] spawn_process: at 2019-02-05 20:39:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-02-05 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-02-05 20:39:14 [DEBUG   ] spawn_process: at 2019-02-05 20:39:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-02-05 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-02-05 20:39:14 [DEBUG   ] spawn_process: at 2019-02-05 20:39:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-02-05 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-02-05 20:39:14 [DEBUG   ] spawn_process: at 2019-02-05 20:39:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-02-05 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-02-05 20:39:14 [DEBUG   ] spawn_process: at 2019-02-05 20:39:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-02-05 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-02-05 20:39:14 [DEBUG   ] spawn_process: at 2019-02-05 20:39:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-02-05 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-02-05 20:39:14 [DEBUG   ] spawn_process: at 2019-02-05 20:39:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-02-05 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-02-05 20:39:14 [DEBUG   ] spawn_process: at 2019-02-05 20:39:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-02-05 20:39:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-02-05 20:39:14 [DEBUG   ] spawn_process: at 2019-02-05 20:39:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-02-05 20:39:19 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 20:39:35 [DEBUG   ] Got command BAM from MCS: ref #1413062
2019-02-05 20:39:35 [INFO    ] Finished processing BAM request
2019-02-05 20:39:35 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:39:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1413062   8 58519 74375025 A  ERROR'
2019-02-05 20:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-02-05 20:39:35 [DEBUG   ] spawn_process: at 2019-02-05 20:39:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-02-05 20:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-02-05 20:39:35 [DEBUG   ] spawn_process: at 2019-02-05 20:39:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-02-05 20:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-02-05 20:39:35 [DEBUG   ] spawn_process: at 2019-02-05 20:39:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-02-05 20:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-02-05 20:39:35 [DEBUG   ] spawn_process: at 2019-02-05 20:39:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-02-05 20:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-02-05 20:39:35 [DEBUG   ] spawn_process: at 2019-02-05 20:39:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-02-05 20:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-02-05 20:39:35 [DEBUG   ] spawn_process: at 2019-02-05 20:39:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-02-05 20:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-02-05 20:39:35 [DEBUG   ] spawn_process: at 2019-02-05 20:39:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-02-05 20:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-02-05 20:39:35 [DEBUG   ] spawn_process: at 2019-02-05 20:39:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-02-05 20:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-02-05 20:39:35 [DEBUG   ] spawn_process: at 2019-02-05 20:39:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-02-05 20:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-02-05 20:39:35 [DEBUG   ] spawn_process: at 2019-02-05 20:39:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-02-05 20:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-02-05 20:39:35 [DEBUG   ] spawn_process: at 2019-02-05 20:39:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-02-05 20:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-02-05 20:39:35 [DEBUG   ] spawn_process: at 2019-02-05 20:39:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-02-05 20:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-02-05 20:39:35 [DEBUG   ] spawn_process: at 2019-02-05 20:39:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-02-05 20:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-02-05 20:39:35 [DEBUG   ] spawn_process: at 2019-02-05 20:39:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-02-05 20:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-02-05 20:39:35 [DEBUG   ] spawn_process: at 2019-02-05 20:39:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-02-05 20:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-02-05 20:39:35 [DEBUG   ] spawn_process: at 2019-02-05 20:39:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-02-05 20:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-02-05 20:39:35 [DEBUG   ] spawn_process: at 2019-02-05 20:39:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-02-05 20:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-02-05 20:39:35 [DEBUG   ] spawn_process: at 2019-02-05 20:39:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-02-05 20:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-02-05 20:39:35 [DEBUG   ] spawn_process: at 2019-02-05 20:39:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-02-05 20:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-02-05 20:39:35 [DEBUG   ] spawn_process: at 2019-02-05 20:39:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-02-05 20:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-02-05 20:39:35 [DEBUG   ] spawn_process: at 2019-02-05 20:39:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-02-05 20:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-02-05 20:39:35 [DEBUG   ] spawn_process: at 2019-02-05 20:39:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-02-05 20:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-02-05 20:39:35 [DEBUG   ] spawn_process: at 2019-02-05 20:39:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-02-05 20:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-02-05 20:39:35 [DEBUG   ] spawn_process: at 2019-02-05 20:39:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-02-05 20:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-02-05 20:39:35 [DEBUG   ] spawn_process: at 2019-02-05 20:39:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-02-05 20:39:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-02-05 20:39:35 [DEBUG   ] spawn_process: at 2019-02-05 20:39:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-02-05 20:39:39 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 20:39:56 [DEBUG   ] Got command RPT from MCS: ref #1413063
2019-02-05 20:39:56 [DEBUG   ] summary = ERROR
2019-02-05 20:39:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413063  13 58519 74396985 A  ERRORERROR'
2019-02-05 20:39:57 [DEBUG   ] Got command RPT from MCS: ref #1413064
2019-02-05 20:39:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 20:39:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413064  77 58519 74397189 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 20:39:57 [DEBUG   ] Got command RPT from MCS: ref #1413065
2019-02-05 20:39:57 [DEBUG   ] summary = ERROR
2019-02-05 20:39:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413065  13 58519 74397393 A  ERRORERROR'
2019-02-05 20:39:57 [DEBUG   ] Got command RPT from MCS: ref #1413066
2019-02-05 20:39:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 20:39:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413066  77 58519 74397585 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 20:39:57 [DEBUG   ] Got command RPT from MCS: ref #1413067
2019-02-05 20:39:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 20:39:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413067  12 58519 74397789 A  ERRORB¤ff'
2019-02-05 20:39:59 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 20:40:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-02-05 20:40:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-02-05 20:40:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:40:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-02-05 20:40:07 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-02-05 20:40:07 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-02-05 20:40:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:40:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:40:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:40:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:40:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:40:07 [DEBUG   ] Finished updating board flags in 1.229 seconds
2019-02-05 20:40:18 [DEBUG   ] Got command BAM from MCS: ref #1413068
2019-02-05 20:40:18 [INFO    ] Finished processing BAM request
2019-02-05 20:40:18 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:40:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1413068   8 58519 74418029 A  ERROR'
2019-02-05 20:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-02-05 20:40:18 [DEBUG   ] spawn_process: at 2019-02-05 20:40:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-02-05 20:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-02-05 20:40:18 [DEBUG   ] spawn_process: at 2019-02-05 20:40:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-02-05 20:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-02-05 20:40:18 [DEBUG   ] spawn_process: at 2019-02-05 20:40:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-02-05 20:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-02-05 20:40:18 [DEBUG   ] spawn_process: at 2019-02-05 20:40:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-02-05 20:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-02-05 20:40:18 [DEBUG   ] spawn_process: at 2019-02-05 20:40:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-02-05 20:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-02-05 20:40:18 [DEBUG   ] spawn_process: at 2019-02-05 20:40:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-02-05 20:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-02-05 20:40:18 [DEBUG   ] spawn_process: at 2019-02-05 20:40:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-02-05 20:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-02-05 20:40:18 [DEBUG   ] spawn_process: at 2019-02-05 20:40:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-02-05 20:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-02-05 20:40:18 [DEBUG   ] spawn_process: at 2019-02-05 20:40:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-02-05 20:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-02-05 20:40:18 [DEBUG   ] spawn_process: at 2019-02-05 20:40:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-02-05 20:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-02-05 20:40:18 [DEBUG   ] spawn_process: at 2019-02-05 20:40:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-02-05 20:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-02-05 20:40:18 [DEBUG   ] spawn_process: at 2019-02-05 20:40:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-02-05 20:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-02-05 20:40:18 [DEBUG   ] spawn_process: at 2019-02-05 20:40:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-02-05 20:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-02-05 20:40:18 [DEBUG   ] spawn_process: at 2019-02-05 20:40:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-02-05 20:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-02-05 20:40:18 [DEBUG   ] spawn_process: at 2019-02-05 20:40:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-02-05 20:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-02-05 20:40:18 [DEBUG   ] spawn_process: at 2019-02-05 20:40:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-02-05 20:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-02-05 20:40:18 [DEBUG   ] spawn_process: at 2019-02-05 20:40:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-02-05 20:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-02-05 20:40:18 [DEBUG   ] spawn_process: at 2019-02-05 20:40:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-02-05 20:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-02-05 20:40:18 [DEBUG   ] spawn_process: at 2019-02-05 20:40:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-02-05 20:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-02-05 20:40:18 [DEBUG   ] spawn_process: at 2019-02-05 20:40:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-02-05 20:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-02-05 20:40:18 [DEBUG   ] spawn_process: at 2019-02-05 20:40:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-02-05 20:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-02-05 20:40:18 [DEBUG   ] spawn_process: at 2019-02-05 20:40:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-02-05 20:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-02-05 20:40:18 [DEBUG   ] spawn_process: at 2019-02-05 20:40:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-02-05 20:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-02-05 20:40:18 [DEBUG   ] spawn_process: at 2019-02-05 20:40:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-02-05 20:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-02-05 20:40:18 [DEBUG   ] spawn_process: at 2019-02-05 20:40:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-02-05 20:40:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-02-05 20:40:18 [DEBUG   ] spawn_process: at 2019-02-05 20:40:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-02-05 20:40:19 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 20:40:21 [DEBUG   ] Got command BAM from MCS: ref #1413069
2019-02-05 20:40:21 [INFO    ] Finished processing BAM request
2019-02-05 20:40:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:40:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1413069   8 58519 74421029 A  ERROR'
2019-02-05 20:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 20:40:21 [DEBUG   ] spawn_process: at 2019-02-05 20:40:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 20:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 20:40:21 [DEBUG   ] spawn_process: at 2019-02-05 20:40:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 20:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 20:40:21 [DEBUG   ] spawn_process: at 2019-02-05 20:40:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 20:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 20:40:21 [DEBUG   ] spawn_process: at 2019-02-05 20:40:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 20:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 20:40:21 [DEBUG   ] spawn_process: at 2019-02-05 20:40:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 20:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 20:40:21 [DEBUG   ] spawn_process: at 2019-02-05 20:40:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 20:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 20:40:21 [DEBUG   ] spawn_process: at 2019-02-05 20:40:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 20:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 20:40:21 [DEBUG   ] spawn_process: at 2019-02-05 20:40:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 20:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 20:40:21 [DEBUG   ] spawn_process: at 2019-02-05 20:40:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 20:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 20:40:21 [DEBUG   ] spawn_process: at 2019-02-05 20:40:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 20:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 20:40:21 [DEBUG   ] spawn_process: at 2019-02-05 20:40:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 20:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 20:40:21 [DEBUG   ] spawn_process: at 2019-02-05 20:40:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 20:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 20:40:21 [DEBUG   ] spawn_process: at 2019-02-05 20:40:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 20:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 20:40:21 [DEBUG   ] spawn_process: at 2019-02-05 20:40:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 20:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 20:40:21 [DEBUG   ] spawn_process: at 2019-02-05 20:40:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 20:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 20:40:21 [DEBUG   ] spawn_process: at 2019-02-05 20:40:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 20:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 20:40:21 [DEBUG   ] spawn_process: at 2019-02-05 20:40:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 20:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 20:40:21 [DEBUG   ] spawn_process: at 2019-02-05 20:40:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 20:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 20:40:21 [DEBUG   ] spawn_process: at 2019-02-05 20:40:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 20:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 20:40:21 [DEBUG   ] spawn_process: at 2019-02-05 20:40:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 20:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 20:40:21 [DEBUG   ] spawn_process: at 2019-02-05 20:40:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 20:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 20:40:21 [DEBUG   ] spawn_process: at 2019-02-05 20:40:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 20:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 20:40:21 [DEBUG   ] spawn_process: at 2019-02-05 20:40:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 20:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 20:40:21 [DEBUG   ] spawn_process: at 2019-02-05 20:40:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 20:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 20:40:21 [DEBUG   ] spawn_process: at 2019-02-05 20:40:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 20:40:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 20:40:21 [DEBUG   ] spawn_process: at 2019-02-05 20:40:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 20:40:39 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 20:40:59 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-02-05 20:41:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:41:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-02-05 20:41:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-02-05 20:41:07 [DEBUG   ] Got command BAM from MCS: ref #1413070
2019-02-05 20:41:07 [INFO    ] Finished processing BAM request
2019-02-05 20:41:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:41:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1413070   8 58519 74467025 A  ERROR'
2019-02-05 20:41:07 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-02-05 20:41:07 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-02-05 20:41:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:41:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:41:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:41:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:41:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:41:07 [DEBUG   ] Finished updating board flags in 1.178 seconds
2019-02-05 20:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 20:41:07 [DEBUG   ] spawn_process: at 2019-02-05 20:41:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 20:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 20:41:07 [DEBUG   ] spawn_process: at 2019-02-05 20:41:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 20:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 20:41:07 [DEBUG   ] spawn_process: at 2019-02-05 20:41:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 20:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 20:41:07 [DEBUG   ] spawn_process: at 2019-02-05 20:41:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 20:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 20:41:07 [DEBUG   ] spawn_process: at 2019-02-05 20:41:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 20:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 20:41:07 [DEBUG   ] spawn_process: at 2019-02-05 20:41:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 20:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 20:41:07 [DEBUG   ] spawn_process: at 2019-02-05 20:41:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 20:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 20:41:07 [DEBUG   ] spawn_process: at 2019-02-05 20:41:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 20:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 20:41:07 [DEBUG   ] spawn_process: at 2019-02-05 20:41:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 20:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 20:41:07 [DEBUG   ] spawn_process: at 2019-02-05 20:41:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 20:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 20:41:07 [DEBUG   ] spawn_process: at 2019-02-05 20:41:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 20:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 20:41:07 [DEBUG   ] spawn_process: at 2019-02-05 20:41:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 20:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 20:41:07 [DEBUG   ] spawn_process: at 2019-02-05 20:41:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 20:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 20:41:07 [DEBUG   ] spawn_process: at 2019-02-05 20:41:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 20:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 20:41:07 [DEBUG   ] spawn_process: at 2019-02-05 20:41:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 20:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 20:41:07 [DEBUG   ] spawn_process: at 2019-02-05 20:41:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 20:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 20:41:07 [DEBUG   ] spawn_process: at 2019-02-05 20:41:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 20:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 20:41:07 [DEBUG   ] spawn_process: at 2019-02-05 20:41:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 20:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 20:41:07 [DEBUG   ] spawn_process: at 2019-02-05 20:41:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 20:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 20:41:07 [DEBUG   ] spawn_process: at 2019-02-05 20:41:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 20:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 20:41:07 [DEBUG   ] spawn_process: at 2019-02-05 20:41:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 20:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 20:41:07 [DEBUG   ] spawn_process: at 2019-02-05 20:41:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 20:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 20:41:07 [DEBUG   ] spawn_process: at 2019-02-05 20:41:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 20:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 20:41:07 [DEBUG   ] spawn_process: at 2019-02-05 20:41:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 20:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 20:41:07 [DEBUG   ] spawn_process: at 2019-02-05 20:41:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 20:41:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 20:41:07 [DEBUG   ] spawn_process: at 2019-02-05 20:41:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 20:41:12 [DEBUG   ] Got command RPT from MCS: ref #1413071
2019-02-05 20:41:12 [DEBUG   ] summary = ERROR
2019-02-05 20:41:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413071  13 58519 74472029 A  ERRORERROR'
2019-02-05 20:41:12 [DEBUG   ] Got command RPT from MCS: ref #1413072
2019-02-05 20:41:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 20:41:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413072  77 58519 74472030 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 20:41:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 20:41:22 [DEBUG   ] Got command BAM from MCS: ref #1413092
2019-02-05 20:41:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:41:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1413092   8 58519 74482033 A  ERROR'
2019-02-05 20:41:22 [INFO    ] Finished processing BAM request
2019-02-05 20:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 20:41:22 [DEBUG   ] spawn_process: at 2019-02-05 20:41:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 20:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 20:41:22 [DEBUG   ] spawn_process: at 2019-02-05 20:41:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 20:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 20:41:22 [DEBUG   ] spawn_process: at 2019-02-05 20:41:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 20:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 20:41:22 [DEBUG   ] spawn_process: at 2019-02-05 20:41:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 20:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 20:41:22 [DEBUG   ] spawn_process: at 2019-02-05 20:41:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 20:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 20:41:22 [DEBUG   ] spawn_process: at 2019-02-05 20:41:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 20:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 20:41:22 [DEBUG   ] spawn_process: at 2019-02-05 20:41:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 20:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 20:41:22 [DEBUG   ] spawn_process: at 2019-02-05 20:41:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 20:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 20:41:22 [DEBUG   ] spawn_process: at 2019-02-05 20:41:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 20:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 20:41:22 [DEBUG   ] spawn_process: at 2019-02-05 20:41:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 20:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 20:41:22 [DEBUG   ] spawn_process: at 2019-02-05 20:41:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 20:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 20:41:22 [DEBUG   ] spawn_process: at 2019-02-05 20:41:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 20:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 20:41:22 [DEBUG   ] spawn_process: at 2019-02-05 20:41:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 20:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 20:41:22 [DEBUG   ] spawn_process: at 2019-02-05 20:41:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 20:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 20:41:22 [DEBUG   ] spawn_process: at 2019-02-05 20:41:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 20:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 20:41:22 [DEBUG   ] spawn_process: at 2019-02-05 20:41:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 20:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 20:41:22 [DEBUG   ] spawn_process: at 2019-02-05 20:41:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 20:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 20:41:22 [DEBUG   ] spawn_process: at 2019-02-05 20:41:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 20:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 20:41:22 [DEBUG   ] spawn_process: at 2019-02-05 20:41:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 20:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 20:41:22 [DEBUG   ] spawn_process: at 2019-02-05 20:41:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 20:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 20:41:22 [DEBUG   ] spawn_process: at 2019-02-05 20:41:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 20:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 20:41:22 [DEBUG   ] spawn_process: at 2019-02-05 20:41:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 20:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 20:41:22 [DEBUG   ] spawn_process: at 2019-02-05 20:41:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 20:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 20:41:22 [DEBUG   ] spawn_process: at 2019-02-05 20:41:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 20:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 20:41:22 [DEBUG   ] spawn_process: at 2019-02-05 20:41:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 20:41:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 20:41:22 [DEBUG   ] spawn_process: at 2019-02-05 20:41:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 20:41:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 20:41:52 [DEBUG   ] Got command BAM from MCS: ref #1413093
2019-02-05 20:41:52 [INFO    ] Finished processing BAM request
2019-02-05 20:41:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:41:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1413093   8 58519 74512025 A  ERROR'
2019-02-05 20:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 20:41:52 [DEBUG   ] spawn_process: at 2019-02-05 20:41:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 20:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 20:41:52 [DEBUG   ] spawn_process: at 2019-02-05 20:41:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 20:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 20:41:52 [DEBUG   ] spawn_process: at 2019-02-05 20:41:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 20:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 20:41:52 [DEBUG   ] spawn_process: at 2019-02-05 20:41:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 20:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 20:41:52 [DEBUG   ] spawn_process: at 2019-02-05 20:41:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 20:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 20:41:52 [DEBUG   ] spawn_process: at 2019-02-05 20:41:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 20:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 20:41:52 [DEBUG   ] spawn_process: at 2019-02-05 20:41:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 20:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 20:41:52 [DEBUG   ] spawn_process: at 2019-02-05 20:41:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 20:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 20:41:52 [DEBUG   ] spawn_process: at 2019-02-05 20:41:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 20:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 20:41:52 [DEBUG   ] spawn_process: at 2019-02-05 20:41:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 20:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 20:41:52 [DEBUG   ] spawn_process: at 2019-02-05 20:41:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 20:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 20:41:52 [DEBUG   ] spawn_process: at 2019-02-05 20:41:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 20:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 20:41:52 [DEBUG   ] spawn_process: at 2019-02-05 20:41:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 20:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 20:41:52 [DEBUG   ] spawn_process: at 2019-02-05 20:41:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 20:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 20:41:52 [DEBUG   ] spawn_process: at 2019-02-05 20:41:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 20:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 20:41:52 [DEBUG   ] spawn_process: at 2019-02-05 20:41:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 20:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 20:41:52 [DEBUG   ] spawn_process: at 2019-02-05 20:41:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 20:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 20:41:52 [DEBUG   ] spawn_process: at 2019-02-05 20:41:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 20:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 20:41:52 [DEBUG   ] spawn_process: at 2019-02-05 20:41:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 20:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 20:41:52 [DEBUG   ] spawn_process: at 2019-02-05 20:41:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 20:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 20:41:52 [DEBUG   ] spawn_process: at 2019-02-05 20:41:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 20:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 20:41:52 [DEBUG   ] spawn_process: at 2019-02-05 20:41:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 20:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 20:41:52 [DEBUG   ] spawn_process: at 2019-02-05 20:41:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 20:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 20:41:52 [DEBUG   ] spawn_process: at 2019-02-05 20:41:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 20:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 20:41:52 [DEBUG   ] spawn_process: at 2019-02-05 20:41:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 20:41:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 20:41:52 [DEBUG   ] spawn_process: at 2019-02-05 20:41:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 20:42:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 20:42:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2019-02-05 20:42:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:42:07 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-02-05 20:42:07 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-02-05 20:42:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-05 20:42:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:42:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:42:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:42:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:42:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:42:07 [DEBUG   ] Finished updating board flags in 1.006 seconds
2019-02-05 20:42:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 20:42:26 [DEBUG   ] Got command BAM from MCS: ref #1413094
2019-02-05 20:42:26 [INFO    ] Finished processing BAM request
2019-02-05 20:42:26 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:42:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1413094   8 58519 74546029 A  ERROR'
2019-02-05 20:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 20:42:26 [DEBUG   ] spawn_process: at 2019-02-05 20:42:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 20:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 20:42:26 [DEBUG   ] spawn_process: at 2019-02-05 20:42:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 20:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 20:42:26 [DEBUG   ] spawn_process: at 2019-02-05 20:42:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 20:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 20:42:26 [DEBUG   ] spawn_process: at 2019-02-05 20:42:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 20:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 20:42:26 [DEBUG   ] spawn_process: at 2019-02-05 20:42:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 20:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 20:42:26 [DEBUG   ] spawn_process: at 2019-02-05 20:42:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 20:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 20:42:26 [DEBUG   ] spawn_process: at 2019-02-05 20:42:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 20:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 20:42:26 [DEBUG   ] spawn_process: at 2019-02-05 20:42:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 20:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 20:42:26 [DEBUG   ] spawn_process: at 2019-02-05 20:42:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 20:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 20:42:26 [DEBUG   ] spawn_process: at 2019-02-05 20:42:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 20:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 20:42:26 [DEBUG   ] spawn_process: at 2019-02-05 20:42:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 20:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 20:42:26 [DEBUG   ] spawn_process: at 2019-02-05 20:42:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 20:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 20:42:26 [DEBUG   ] spawn_process: at 2019-02-05 20:42:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 20:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 20:42:26 [DEBUG   ] spawn_process: at 2019-02-05 20:42:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 20:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 20:42:26 [DEBUG   ] spawn_process: at 2019-02-05 20:42:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 20:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 20:42:26 [DEBUG   ] spawn_process: at 2019-02-05 20:42:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 20:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 20:42:26 [DEBUG   ] spawn_process: at 2019-02-05 20:42:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 20:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 20:42:26 [DEBUG   ] spawn_process: at 2019-02-05 20:42:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 20:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 20:42:26 [DEBUG   ] spawn_process: at 2019-02-05 20:42:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 20:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 20:42:26 [DEBUG   ] spawn_process: at 2019-02-05 20:42:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 20:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 20:42:26 [DEBUG   ] spawn_process: at 2019-02-05 20:42:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 20:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 20:42:26 [DEBUG   ] spawn_process: at 2019-02-05 20:42:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 20:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 20:42:26 [DEBUG   ] spawn_process: at 2019-02-05 20:42:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 20:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 20:42:26 [DEBUG   ] spawn_process: at 2019-02-05 20:42:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 20:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 20:42:26 [DEBUG   ] spawn_process: at 2019-02-05 20:42:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 20:42:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 20:42:26 [DEBUG   ] spawn_process: at 2019-02-05 20:42:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 20:42:37 [DEBUG   ] Got command BAM from MCS: ref #1413095
2019-02-05 20:42:37 [INFO    ] Finished processing BAM request
2019-02-05 20:42:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:42:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1413095   8 58519 74557029 A  ERROR'
2019-02-05 20:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-02-05 20:42:37 [DEBUG   ] spawn_process: at 2019-02-05 20:42:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-02-05 20:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-02-05 20:42:37 [DEBUG   ] spawn_process: at 2019-02-05 20:42:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-02-05 20:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-02-05 20:42:37 [DEBUG   ] spawn_process: at 2019-02-05 20:42:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-02-05 20:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-02-05 20:42:37 [DEBUG   ] spawn_process: at 2019-02-05 20:42:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-02-05 20:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-02-05 20:42:37 [DEBUG   ] spawn_process: at 2019-02-05 20:42:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-02-05 20:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-02-05 20:42:37 [DEBUG   ] spawn_process: at 2019-02-05 20:42:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-02-05 20:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-02-05 20:42:37 [DEBUG   ] spawn_process: at 2019-02-05 20:42:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-02-05 20:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-02-05 20:42:37 [DEBUG   ] spawn_process: at 2019-02-05 20:42:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-02-05 20:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-02-05 20:42:37 [DEBUG   ] spawn_process: at 2019-02-05 20:42:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-02-05 20:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-02-05 20:42:37 [DEBUG   ] spawn_process: at 2019-02-05 20:42:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-02-05 20:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-02-05 20:42:37 [DEBUG   ] spawn_process: at 2019-02-05 20:42:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-02-05 20:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-02-05 20:42:37 [DEBUG   ] spawn_process: at 2019-02-05 20:42:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-02-05 20:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-02-05 20:42:37 [DEBUG   ] spawn_process: at 2019-02-05 20:42:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-02-05 20:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-02-05 20:42:37 [DEBUG   ] spawn_process: at 2019-02-05 20:42:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-02-05 20:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-02-05 20:42:37 [DEBUG   ] spawn_process: at 2019-02-05 20:42:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-02-05 20:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-02-05 20:42:37 [DEBUG   ] spawn_process: at 2019-02-05 20:42:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-02-05 20:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-02-05 20:42:37 [DEBUG   ] spawn_process: at 2019-02-05 20:42:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-02-05 20:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-02-05 20:42:37 [DEBUG   ] spawn_process: at 2019-02-05 20:42:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-02-05 20:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-02-05 20:42:37 [DEBUG   ] spawn_process: at 2019-02-05 20:42:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-02-05 20:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-02-05 20:42:37 [DEBUG   ] spawn_process: at 2019-02-05 20:42:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-02-05 20:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-02-05 20:42:37 [DEBUG   ] spawn_process: at 2019-02-05 20:42:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-02-05 20:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-02-05 20:42:37 [DEBUG   ] spawn_process: at 2019-02-05 20:42:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-02-05 20:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-02-05 20:42:37 [DEBUG   ] spawn_process: at 2019-02-05 20:42:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-02-05 20:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-02-05 20:42:37 [DEBUG   ] spawn_process: at 2019-02-05 20:42:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-02-05 20:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-02-05 20:42:37 [DEBUG   ] spawn_process: at 2019-02-05 20:42:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-02-05 20:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-02-05 20:42:37 [DEBUG   ] spawn_process: at 2019-02-05 20:42:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-02-05 20:42:40 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 20:43:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 20:43:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 20:43:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2019-02-05 20:43:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-02-05 20:43:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:43:07 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-02-05 20:43:07 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2019-02-05 20:43:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-02-05 20:43:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:43:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:43:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:43:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:43:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:43:07 [DEBUG   ] Finished updating board flags in 0.998 seconds
2019-02-05 20:43:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 20:43:22 [DEBUG   ] Got command BAM from MCS: ref #1413096
2019-02-05 20:43:22 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:43:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1413096   8 58519 74602029 A  ERROR'
2019-02-05 20:43:22 [INFO    ] Finished processing BAM request
2019-02-05 20:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 20:43:22 [DEBUG   ] spawn_process: at 2019-02-05 20:43:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 20:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 20:43:22 [DEBUG   ] spawn_process: at 2019-02-05 20:43:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 20:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 20:43:22 [DEBUG   ] spawn_process: at 2019-02-05 20:43:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 20:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 20:43:22 [DEBUG   ] spawn_process: at 2019-02-05 20:43:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 20:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 20:43:22 [DEBUG   ] spawn_process: at 2019-02-05 20:43:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 20:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 20:43:22 [DEBUG   ] spawn_process: at 2019-02-05 20:43:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 20:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 20:43:22 [DEBUG   ] spawn_process: at 2019-02-05 20:43:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 20:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 20:43:22 [DEBUG   ] spawn_process: at 2019-02-05 20:43:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 20:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 20:43:22 [DEBUG   ] spawn_process: at 2019-02-05 20:43:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 20:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 20:43:22 [DEBUG   ] spawn_process: at 2019-02-05 20:43:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 20:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 20:43:22 [DEBUG   ] spawn_process: at 2019-02-05 20:43:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 20:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 20:43:22 [DEBUG   ] spawn_process: at 2019-02-05 20:43:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 20:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 20:43:22 [DEBUG   ] spawn_process: at 2019-02-05 20:43:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 20:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 20:43:22 [DEBUG   ] spawn_process: at 2019-02-05 20:43:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 20:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 20:43:22 [DEBUG   ] spawn_process: at 2019-02-05 20:43:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 20:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 20:43:22 [DEBUG   ] spawn_process: at 2019-02-05 20:43:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 20:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 20:43:22 [DEBUG   ] spawn_process: at 2019-02-05 20:43:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 20:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 20:43:22 [DEBUG   ] spawn_process: at 2019-02-05 20:43:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 20:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 20:43:22 [DEBUG   ] spawn_process: at 2019-02-05 20:43:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 20:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 20:43:22 [DEBUG   ] spawn_process: at 2019-02-05 20:43:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 20:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 20:43:22 [DEBUG   ] spawn_process: at 2019-02-05 20:43:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 20:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 20:43:22 [DEBUG   ] spawn_process: at 2019-02-05 20:43:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 20:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 20:43:22 [DEBUG   ] spawn_process: at 2019-02-05 20:43:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 20:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 20:43:22 [DEBUG   ] spawn_process: at 2019-02-05 20:43:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 20:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 20:43:22 [DEBUG   ] spawn_process: at 2019-02-05 20:43:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 20:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 20:43:22 [DEBUG   ] spawn_process: at 2019-02-05 20:43:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 20:43:30 [DEBUG   ] Got command BAM from MCS: ref #1413097
2019-02-05 20:43:30 [INFO    ] Finished processing BAM request
2019-02-05 20:43:30 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:43:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1413097   8 58519 74610037 A  ERROR'
2019-02-05 20:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 20:43:30 [DEBUG   ] spawn_process: at 2019-02-05 20:43:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 20:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 20:43:30 [DEBUG   ] spawn_process: at 2019-02-05 20:43:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 20:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 20:43:30 [DEBUG   ] spawn_process: at 2019-02-05 20:43:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 20:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 20:43:30 [DEBUG   ] spawn_process: at 2019-02-05 20:43:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 20:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 20:43:30 [DEBUG   ] spawn_process: at 2019-02-05 20:43:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 20:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 20:43:30 [DEBUG   ] spawn_process: at 2019-02-05 20:43:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 20:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 20:43:30 [DEBUG   ] spawn_process: at 2019-02-05 20:43:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 20:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 20:43:30 [DEBUG   ] spawn_process: at 2019-02-05 20:43:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 20:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 20:43:30 [DEBUG   ] spawn_process: at 2019-02-05 20:43:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 20:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 20:43:30 [DEBUG   ] spawn_process: at 2019-02-05 20:43:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 20:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 20:43:30 [DEBUG   ] spawn_process: at 2019-02-05 20:43:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 20:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 20:43:30 [DEBUG   ] spawn_process: at 2019-02-05 20:43:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 20:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 20:43:30 [DEBUG   ] spawn_process: at 2019-02-05 20:43:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 20:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 20:43:30 [DEBUG   ] spawn_process: at 2019-02-05 20:43:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 20:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 20:43:30 [DEBUG   ] spawn_process: at 2019-02-05 20:43:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 20:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 20:43:30 [DEBUG   ] spawn_process: at 2019-02-05 20:43:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 20:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 20:43:30 [DEBUG   ] spawn_process: at 2019-02-05 20:43:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 20:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 20:43:30 [DEBUG   ] spawn_process: at 2019-02-05 20:43:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 20:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 20:43:30 [DEBUG   ] spawn_process: at 2019-02-05 20:43:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 20:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 20:43:30 [DEBUG   ] spawn_process: at 2019-02-05 20:43:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 20:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 20:43:30 [DEBUG   ] spawn_process: at 2019-02-05 20:43:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 20:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 20:43:30 [DEBUG   ] spawn_process: at 2019-02-05 20:43:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 20:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 20:43:30 [DEBUG   ] spawn_process: at 2019-02-05 20:43:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 20:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 20:43:30 [DEBUG   ] spawn_process: at 2019-02-05 20:43:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 20:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 20:43:30 [DEBUG   ] spawn_process: at 2019-02-05 20:43:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 20:43:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 20:43:30 [DEBUG   ] spawn_process: at 2019-02-05 20:43:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 20:43:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 20:44:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 20:44:07 [DEBUG   ] Got command BAM from MCS: ref #1413098
2019-02-05 20:44:07 [INFO    ] Finished processing BAM request
2019-02-05 20:44:07 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:44:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1413098   8 58519 74647029 A  ERROR'
2019-02-05 20:44:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-02-05 20:44:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:44:07 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2019-02-05 20:44:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:44:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:44:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:44:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:44:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:44:07 [DEBUG   ] Finished updating board flags in 1.269 seconds
2019-02-05 20:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-02-05 20:44:07 [DEBUG   ] spawn_process: at 2019-02-05 20:44:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-02-05 20:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-02-05 20:44:07 [DEBUG   ] spawn_process: at 2019-02-05 20:44:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-02-05 20:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-02-05 20:44:07 [DEBUG   ] spawn_process: at 2019-02-05 20:44:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-02-05 20:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-02-05 20:44:07 [DEBUG   ] spawn_process: at 2019-02-05 20:44:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-02-05 20:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-02-05 20:44:07 [DEBUG   ] spawn_process: at 2019-02-05 20:44:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-02-05 20:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-02-05 20:44:07 [DEBUG   ] spawn_process: at 2019-02-05 20:44:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-02-05 20:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-02-05 20:44:07 [DEBUG   ] spawn_process: at 2019-02-05 20:44:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-02-05 20:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-02-05 20:44:07 [DEBUG   ] spawn_process: at 2019-02-05 20:44:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-02-05 20:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-02-05 20:44:07 [DEBUG   ] spawn_process: at 2019-02-05 20:44:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-02-05 20:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-02-05 20:44:07 [DEBUG   ] spawn_process: at 2019-02-05 20:44:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-02-05 20:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-02-05 20:44:07 [DEBUG   ] spawn_process: at 2019-02-05 20:44:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-02-05 20:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-02-05 20:44:07 [DEBUG   ] spawn_process: at 2019-02-05 20:44:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-02-05 20:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-02-05 20:44:07 [DEBUG   ] spawn_process: at 2019-02-05 20:44:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-02-05 20:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-02-05 20:44:07 [DEBUG   ] spawn_process: at 2019-02-05 20:44:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-02-05 20:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-02-05 20:44:07 [DEBUG   ] spawn_process: at 2019-02-05 20:44:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-02-05 20:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-02-05 20:44:07 [DEBUG   ] spawn_process: at 2019-02-05 20:44:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-02-05 20:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-02-05 20:44:07 [DEBUG   ] spawn_process: at 2019-02-05 20:44:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-02-05 20:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-02-05 20:44:07 [DEBUG   ] spawn_process: at 2019-02-05 20:44:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-02-05 20:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-02-05 20:44:07 [DEBUG   ] spawn_process: at 2019-02-05 20:44:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-02-05 20:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-02-05 20:44:07 [DEBUG   ] spawn_process: at 2019-02-05 20:44:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-02-05 20:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-02-05 20:44:07 [DEBUG   ] spawn_process: at 2019-02-05 20:44:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-02-05 20:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-02-05 20:44:07 [DEBUG   ] spawn_process: at 2019-02-05 20:44:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-02-05 20:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-02-05 20:44:07 [DEBUG   ] spawn_process: at 2019-02-05 20:44:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-02-05 20:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-02-05 20:44:07 [DEBUG   ] spawn_process: at 2019-02-05 20:44:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-02-05 20:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-02-05 20:44:07 [DEBUG   ] spawn_process: at 2019-02-05 20:44:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-02-05 20:44:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-02-05 20:44:07 [DEBUG   ] spawn_process: at 2019-02-05 20:44:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-02-05 20:44:20 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 20:44:34 [DEBUG   ] Got command BAM from MCS: ref #1413105
2019-02-05 20:44:34 [INFO    ] Finished processing BAM request
2019-02-05 20:44:34 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:44:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1413105   8 58519 74674029 A  ERROR'
2019-02-05 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-02-05 20:44:34 [DEBUG   ] spawn_process: at 2019-02-05 20:44:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-02-05 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-02-05 20:44:34 [DEBUG   ] spawn_process: at 2019-02-05 20:44:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-02-05 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-02-05 20:44:34 [DEBUG   ] spawn_process: at 2019-02-05 20:44:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-02-05 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-02-05 20:44:34 [DEBUG   ] spawn_process: at 2019-02-05 20:44:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-02-05 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-02-05 20:44:34 [DEBUG   ] spawn_process: at 2019-02-05 20:44:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-02-05 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-02-05 20:44:34 [DEBUG   ] spawn_process: at 2019-02-05 20:44:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-02-05 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-02-05 20:44:34 [DEBUG   ] spawn_process: at 2019-02-05 20:44:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-02-05 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-02-05 20:44:34 [DEBUG   ] spawn_process: at 2019-02-05 20:44:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-02-05 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-02-05 20:44:34 [DEBUG   ] spawn_process: at 2019-02-05 20:44:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-02-05 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-02-05 20:44:34 [DEBUG   ] spawn_process: at 2019-02-05 20:44:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-02-05 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-02-05 20:44:34 [DEBUG   ] spawn_process: at 2019-02-05 20:44:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-02-05 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-02-05 20:44:34 [DEBUG   ] spawn_process: at 2019-02-05 20:44:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-02-05 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-02-05 20:44:34 [DEBUG   ] spawn_process: at 2019-02-05 20:44:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-02-05 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-02-05 20:44:34 [DEBUG   ] spawn_process: at 2019-02-05 20:44:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-02-05 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-02-05 20:44:34 [DEBUG   ] spawn_process: at 2019-02-05 20:44:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-02-05 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-02-05 20:44:34 [DEBUG   ] spawn_process: at 2019-02-05 20:44:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-02-05 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-02-05 20:44:34 [DEBUG   ] spawn_process: at 2019-02-05 20:44:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-02-05 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-02-05 20:44:34 [DEBUG   ] spawn_process: at 2019-02-05 20:44:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-02-05 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-02-05 20:44:34 [DEBUG   ] spawn_process: at 2019-02-05 20:44:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-02-05 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-02-05 20:44:34 [DEBUG   ] spawn_process: at 2019-02-05 20:44:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-02-05 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-02-05 20:44:34 [DEBUG   ] spawn_process: at 2019-02-05 20:44:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-02-05 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-02-05 20:44:34 [DEBUG   ] spawn_process: at 2019-02-05 20:44:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-02-05 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-02-05 20:44:34 [DEBUG   ] spawn_process: at 2019-02-05 20:44:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-02-05 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-02-05 20:44:34 [DEBUG   ] spawn_process: at 2019-02-05 20:44:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-02-05 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-02-05 20:44:34 [DEBUG   ] spawn_process: at 2019-02-05 20:44:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-02-05 20:44:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-02-05 20:44:34 [DEBUG   ] spawn_process: at 2019-02-05 20:44:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-02-05 20:44:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 20:44:52 [DEBUG   ] Got command BAM from MCS: ref #1413106
2019-02-05 20:44:52 [INFO    ] Finished processing BAM request
2019-02-05 20:44:52 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:44:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1413106   8 58519 74692025 A  ERROR'
2019-02-05 20:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-02-05 20:44:52 [DEBUG   ] spawn_process: at 2019-02-05 20:44:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-02-05 20:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-02-05 20:44:52 [DEBUG   ] spawn_process: at 2019-02-05 20:44:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-02-05 20:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-02-05 20:44:52 [DEBUG   ] spawn_process: at 2019-02-05 20:44:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-02-05 20:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-02-05 20:44:52 [DEBUG   ] spawn_process: at 2019-02-05 20:44:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-02-05 20:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-02-05 20:44:52 [DEBUG   ] spawn_process: at 2019-02-05 20:44:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-02-05 20:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-02-05 20:44:52 [DEBUG   ] spawn_process: at 2019-02-05 20:44:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-02-05 20:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-02-05 20:44:52 [DEBUG   ] spawn_process: at 2019-02-05 20:44:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-02-05 20:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-02-05 20:44:52 [DEBUG   ] spawn_process: at 2019-02-05 20:44:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-02-05 20:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-02-05 20:44:52 [DEBUG   ] spawn_process: at 2019-02-05 20:44:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-02-05 20:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-02-05 20:44:52 [DEBUG   ] spawn_process: at 2019-02-05 20:44:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-02-05 20:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-02-05 20:44:52 [DEBUG   ] spawn_process: at 2019-02-05 20:44:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-02-05 20:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-02-05 20:44:52 [DEBUG   ] spawn_process: at 2019-02-05 20:44:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-02-05 20:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-02-05 20:44:52 [DEBUG   ] spawn_process: at 2019-02-05 20:44:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-02-05 20:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-02-05 20:44:52 [DEBUG   ] spawn_process: at 2019-02-05 20:44:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-02-05 20:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-02-05 20:44:52 [DEBUG   ] spawn_process: at 2019-02-05 20:44:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-02-05 20:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-02-05 20:44:52 [DEBUG   ] spawn_process: at 2019-02-05 20:44:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-02-05 20:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-02-05 20:44:52 [DEBUG   ] spawn_process: at 2019-02-05 20:44:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-02-05 20:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-02-05 20:44:52 [DEBUG   ] spawn_process: at 2019-02-05 20:44:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-02-05 20:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-02-05 20:44:52 [DEBUG   ] spawn_process: at 2019-02-05 20:44:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-02-05 20:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-02-05 20:44:52 [DEBUG   ] spawn_process: at 2019-02-05 20:44:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-02-05 20:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-02-05 20:44:52 [DEBUG   ] spawn_process: at 2019-02-05 20:44:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-02-05 20:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-02-05 20:44:52 [DEBUG   ] spawn_process: at 2019-02-05 20:44:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-02-05 20:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-02-05 20:44:52 [DEBUG   ] spawn_process: at 2019-02-05 20:44:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-02-05 20:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-02-05 20:44:52 [DEBUG   ] spawn_process: at 2019-02-05 20:44:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-02-05 20:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-02-05 20:44:52 [DEBUG   ] spawn_process: at 2019-02-05 20:44:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-02-05 20:44:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-02-05 20:44:52 [DEBUG   ] spawn_process: at 2019-02-05 20:44:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-02-05 20:44:57 [DEBUG   ] Got command RPT from MCS: ref #1413107
2019-02-05 20:44:57 [DEBUG   ] summary = ERROR
2019-02-05 20:44:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413107  13 58519 74697069 A  ERRORERROR'
2019-02-05 20:44:57 [DEBUG   ] Got command RPT from MCS: ref #1413108
2019-02-05 20:44:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 20:44:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413108  77 58519 74697273 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 20:44:57 [DEBUG   ] Got command RPT from MCS: ref #1413109
2019-02-05 20:44:57 [DEBUG   ] summary = ERROR
2019-02-05 20:44:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413109  13 58519 74697477 A  ERRORERROR'
2019-02-05 20:44:57 [DEBUG   ] Got command RPT from MCS: ref #1413111
2019-02-05 20:44:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 20:44:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413111  77 58519 74697669 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 20:44:57 [DEBUG   ] Got command RPT from MCS: ref #1413113
2019-02-05 20:44:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 20:44:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413113  12 58519 74697873 A  ERRORB¤ff'
2019-02-05 20:45:00 [DEBUG   ] Finished updating ant stats in 1.191 seconds
2019-02-05 20:45:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 20:45:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:45:07 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-02-05 20:45:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:45:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:45:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:45:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:45:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:45:07 [DEBUG   ] Finished updating board flags in 1.173 seconds
2019-02-05 20:45:20 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 20:45:37 [DEBUG   ] Got command BAM from MCS: ref #1413117
2019-02-05 20:45:37 [INFO    ] Finished processing BAM request
2019-02-05 20:45:37 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1413117   8 58519 74737033 A  ERROR'
2019-02-05 20:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-02-05 20:45:37 [DEBUG   ] spawn_process: at 2019-02-05 20:45:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-02-05 20:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-02-05 20:45:37 [DEBUG   ] spawn_process: at 2019-02-05 20:45:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-02-05 20:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-02-05 20:45:37 [DEBUG   ] spawn_process: at 2019-02-05 20:45:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-02-05 20:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-02-05 20:45:37 [DEBUG   ] spawn_process: at 2019-02-05 20:45:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-02-05 20:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-02-05 20:45:37 [DEBUG   ] spawn_process: at 2019-02-05 20:45:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-02-05 20:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-02-05 20:45:37 [DEBUG   ] spawn_process: at 2019-02-05 20:45:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-02-05 20:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-02-05 20:45:37 [DEBUG   ] spawn_process: at 2019-02-05 20:45:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-02-05 20:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-02-05 20:45:37 [DEBUG   ] spawn_process: at 2019-02-05 20:45:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-02-05 20:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-02-05 20:45:37 [DEBUG   ] spawn_process: at 2019-02-05 20:45:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-02-05 20:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-02-05 20:45:37 [DEBUG   ] spawn_process: at 2019-02-05 20:45:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-02-05 20:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-02-05 20:45:37 [DEBUG   ] spawn_process: at 2019-02-05 20:45:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-02-05 20:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-02-05 20:45:37 [DEBUG   ] spawn_process: at 2019-02-05 20:45:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-02-05 20:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-02-05 20:45:37 [DEBUG   ] spawn_process: at 2019-02-05 20:45:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-02-05 20:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-02-05 20:45:37 [DEBUG   ] spawn_process: at 2019-02-05 20:45:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-02-05 20:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-02-05 20:45:37 [DEBUG   ] spawn_process: at 2019-02-05 20:45:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-02-05 20:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-02-05 20:45:37 [DEBUG   ] spawn_process: at 2019-02-05 20:45:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-02-05 20:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-02-05 20:45:37 [DEBUG   ] spawn_process: at 2019-02-05 20:45:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-02-05 20:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-02-05 20:45:37 [DEBUG   ] spawn_process: at 2019-02-05 20:45:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-02-05 20:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-02-05 20:45:37 [DEBUG   ] spawn_process: at 2019-02-05 20:45:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-02-05 20:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-02-05 20:45:37 [DEBUG   ] spawn_process: at 2019-02-05 20:45:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-02-05 20:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-02-05 20:45:37 [DEBUG   ] spawn_process: at 2019-02-05 20:45:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-02-05 20:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-02-05 20:45:37 [DEBUG   ] spawn_process: at 2019-02-05 20:45:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-02-05 20:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-02-05 20:45:37 [DEBUG   ] spawn_process: at 2019-02-05 20:45:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-02-05 20:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-02-05 20:45:37 [DEBUG   ] spawn_process: at 2019-02-05 20:45:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-02-05 20:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-02-05 20:45:37 [DEBUG   ] spawn_process: at 2019-02-05 20:45:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-02-05 20:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-02-05 20:45:37 [DEBUG   ] spawn_process: at 2019-02-05 20:45:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-02-05 20:45:38 [DEBUG   ] Got command BAM from MCS: ref #1413118
2019-02-05 20:45:38 [INFO    ] Finished processing BAM request
2019-02-05 20:45:38 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:45:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1413118   8 58519 74738037 A  ERROR'
2019-02-05 20:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-02-05 20:45:38 [DEBUG   ] spawn_process: at 2019-02-05 20:45:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-02-05 20:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-02-05 20:45:38 [DEBUG   ] spawn_process: at 2019-02-05 20:45:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-02-05 20:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-02-05 20:45:38 [DEBUG   ] spawn_process: at 2019-02-05 20:45:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-02-05 20:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-02-05 20:45:38 [DEBUG   ] spawn_process: at 2019-02-05 20:45:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-02-05 20:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-02-05 20:45:38 [DEBUG   ] spawn_process: at 2019-02-05 20:45:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-02-05 20:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-02-05 20:45:38 [DEBUG   ] spawn_process: at 2019-02-05 20:45:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-02-05 20:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-02-05 20:45:38 [DEBUG   ] spawn_process: at 2019-02-05 20:45:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-02-05 20:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-02-05 20:45:38 [DEBUG   ] spawn_process: at 2019-02-05 20:45:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-02-05 20:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-02-05 20:45:38 [DEBUG   ] spawn_process: at 2019-02-05 20:45:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-02-05 20:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-02-05 20:45:38 [DEBUG   ] spawn_process: at 2019-02-05 20:45:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-02-05 20:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-02-05 20:45:38 [DEBUG   ] spawn_process: at 2019-02-05 20:45:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-02-05 20:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-02-05 20:45:38 [DEBUG   ] spawn_process: at 2019-02-05 20:45:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-02-05 20:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-02-05 20:45:38 [DEBUG   ] spawn_process: at 2019-02-05 20:45:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-02-05 20:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-02-05 20:45:38 [DEBUG   ] spawn_process: at 2019-02-05 20:45:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-02-05 20:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-02-05 20:45:38 [DEBUG   ] spawn_process: at 2019-02-05 20:45:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-02-05 20:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-02-05 20:45:38 [DEBUG   ] spawn_process: at 2019-02-05 20:45:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-02-05 20:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-02-05 20:45:38 [DEBUG   ] spawn_process: at 2019-02-05 20:45:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-02-05 20:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-02-05 20:45:38 [DEBUG   ] spawn_process: at 2019-02-05 20:45:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-02-05 20:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-02-05 20:45:38 [DEBUG   ] spawn_process: at 2019-02-05 20:45:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-02-05 20:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-02-05 20:45:38 [DEBUG   ] spawn_process: at 2019-02-05 20:45:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-02-05 20:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-02-05 20:45:38 [DEBUG   ] spawn_process: at 2019-02-05 20:45:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-02-05 20:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-02-05 20:45:38 [DEBUG   ] spawn_process: at 2019-02-05 20:45:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-02-05 20:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-02-05 20:45:38 [DEBUG   ] spawn_process: at 2019-02-05 20:45:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-02-05 20:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-02-05 20:45:38 [DEBUG   ] spawn_process: at 2019-02-05 20:45:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-02-05 20:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-02-05 20:45:38 [DEBUG   ] spawn_process: at 2019-02-05 20:45:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-02-05 20:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-02-05 20:45:38 [DEBUG   ] spawn_process: at 2019-02-05 20:45:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-02-05 20:45:40 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 20:46:00 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 20:46:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:46:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2019-02-05 20:46:07 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-02-05 20:46:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:46:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:46:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:46:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:46:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:46:07 [DEBUG   ] Finished updating board flags in 1.022 seconds
2019-02-05 20:46:12 [DEBUG   ] Got command RPT from MCS: ref #1413119
2019-02-05 20:46:12 [DEBUG   ] summary = ERROR
2019-02-05 20:46:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413119  13 58519 74772033 A  ERRORERROR'
2019-02-05 20:46:12 [DEBUG   ] Got command RPT from MCS: ref #1413120
2019-02-05 20:46:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 20:46:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413120  77 58519 74772034 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 20:46:20 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 20:46:21 [DEBUG   ] Got command BAM from MCS: ref #1413136
2019-02-05 20:46:21 [INFO    ] Finished processing BAM request
2019-02-05 20:46:21 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:46:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1413136   8 58519 74781025 A  ERROR'
2019-02-05 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-02-05 20:46:21 [DEBUG   ] spawn_process: at 2019-02-05 20:46:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-02-05 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-02-05 20:46:21 [DEBUG   ] spawn_process: at 2019-02-05 20:46:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-02-05 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-02-05 20:46:21 [DEBUG   ] spawn_process: at 2019-02-05 20:46:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-02-05 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-02-05 20:46:21 [DEBUG   ] spawn_process: at 2019-02-05 20:46:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-02-05 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-02-05 20:46:21 [DEBUG   ] spawn_process: at 2019-02-05 20:46:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-02-05 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-02-05 20:46:21 [DEBUG   ] spawn_process: at 2019-02-05 20:46:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-02-05 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-02-05 20:46:21 [DEBUG   ] spawn_process: at 2019-02-05 20:46:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-02-05 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-02-05 20:46:21 [DEBUG   ] spawn_process: at 2019-02-05 20:46:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-02-05 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-02-05 20:46:21 [DEBUG   ] spawn_process: at 2019-02-05 20:46:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-02-05 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-02-05 20:46:21 [DEBUG   ] spawn_process: at 2019-02-05 20:46:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-02-05 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-02-05 20:46:21 [DEBUG   ] spawn_process: at 2019-02-05 20:46:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-02-05 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-02-05 20:46:21 [DEBUG   ] spawn_process: at 2019-02-05 20:46:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-02-05 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-02-05 20:46:21 [DEBUG   ] spawn_process: at 2019-02-05 20:46:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-02-05 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-02-05 20:46:21 [DEBUG   ] spawn_process: at 2019-02-05 20:46:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-02-05 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-02-05 20:46:21 [DEBUG   ] spawn_process: at 2019-02-05 20:46:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-02-05 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-02-05 20:46:21 [DEBUG   ] spawn_process: at 2019-02-05 20:46:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-02-05 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-02-05 20:46:21 [DEBUG   ] spawn_process: at 2019-02-05 20:46:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-02-05 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-02-05 20:46:21 [DEBUG   ] spawn_process: at 2019-02-05 20:46:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-02-05 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-02-05 20:46:21 [DEBUG   ] spawn_process: at 2019-02-05 20:46:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-02-05 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-02-05 20:46:21 [DEBUG   ] spawn_process: at 2019-02-05 20:46:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-02-05 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-02-05 20:46:21 [DEBUG   ] spawn_process: at 2019-02-05 20:46:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-02-05 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-02-05 20:46:21 [DEBUG   ] spawn_process: at 2019-02-05 20:46:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-02-05 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-02-05 20:46:21 [DEBUG   ] spawn_process: at 2019-02-05 20:46:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-02-05 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-02-05 20:46:21 [DEBUG   ] spawn_process: at 2019-02-05 20:46:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-02-05 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-02-05 20:46:21 [DEBUG   ] spawn_process: at 2019-02-05 20:46:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-02-05 20:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-02-05 20:46:21 [DEBUG   ] spawn_process: at 2019-02-05 20:46:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-02-05 20:46:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 20:46:42 [DEBUG   ] Got command BAM from MCS: ref #1413137
2019-02-05 20:46:42 [INFO    ] Finished processing BAM request
2019-02-05 20:46:42 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:46:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1413137   8 58519 74802025 A  ERROR'
2019-02-05 20:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 20:46:42 [DEBUG   ] spawn_process: at 2019-02-05 20:46:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 20:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 20:46:42 [DEBUG   ] spawn_process: at 2019-02-05 20:46:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 20:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 20:46:42 [DEBUG   ] spawn_process: at 2019-02-05 20:46:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 20:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 20:46:42 [DEBUG   ] spawn_process: at 2019-02-05 20:46:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 20:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 20:46:42 [DEBUG   ] spawn_process: at 2019-02-05 20:46:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 20:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 20:46:42 [DEBUG   ] spawn_process: at 2019-02-05 20:46:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 20:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 20:46:42 [DEBUG   ] spawn_process: at 2019-02-05 20:46:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 20:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 20:46:42 [DEBUG   ] spawn_process: at 2019-02-05 20:46:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 20:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 20:46:42 [DEBUG   ] spawn_process: at 2019-02-05 20:46:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 20:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 20:46:42 [DEBUG   ] spawn_process: at 2019-02-05 20:46:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 20:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 20:46:42 [DEBUG   ] spawn_process: at 2019-02-05 20:46:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 20:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 20:46:42 [DEBUG   ] spawn_process: at 2019-02-05 20:46:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 20:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 20:46:42 [DEBUG   ] spawn_process: at 2019-02-05 20:46:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 20:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 20:46:42 [DEBUG   ] spawn_process: at 2019-02-05 20:46:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 20:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 20:46:42 [DEBUG   ] spawn_process: at 2019-02-05 20:46:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 20:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 20:46:42 [DEBUG   ] spawn_process: at 2019-02-05 20:46:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 20:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 20:46:42 [DEBUG   ] spawn_process: at 2019-02-05 20:46:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 20:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 20:46:42 [DEBUG   ] spawn_process: at 2019-02-05 20:46:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 20:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 20:46:42 [DEBUG   ] spawn_process: at 2019-02-05 20:46:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 20:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 20:46:42 [DEBUG   ] spawn_process: at 2019-02-05 20:46:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 20:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 20:46:42 [DEBUG   ] spawn_process: at 2019-02-05 20:46:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 20:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 20:46:42 [DEBUG   ] spawn_process: at 2019-02-05 20:46:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 20:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 20:46:42 [DEBUG   ] spawn_process: at 2019-02-05 20:46:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 20:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 20:46:42 [DEBUG   ] spawn_process: at 2019-02-05 20:46:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 20:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 20:46:42 [DEBUG   ] spawn_process: at 2019-02-05 20:46:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 20:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 20:46:42 [DEBUG   ] spawn_process: at 2019-02-05 20:46:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 20:47:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 20:47:05 [DEBUG   ] Got command BAM from MCS: ref #1413138
2019-02-05 20:47:05 [INFO    ] Finished processing BAM request
2019-02-05 20:47:05 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:47:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1413138   8 58519 74825025 A  ERROR'
2019-02-05 20:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-02-05 20:47:05 [DEBUG   ] spawn_process: at 2019-02-05 20:47:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-02-05 20:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-02-05 20:47:05 [DEBUG   ] spawn_process: at 2019-02-05 20:47:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-02-05 20:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-02-05 20:47:05 [DEBUG   ] spawn_process: at 2019-02-05 20:47:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-02-05 20:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-02-05 20:47:05 [DEBUG   ] spawn_process: at 2019-02-05 20:47:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-02-05 20:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-02-05 20:47:05 [DEBUG   ] spawn_process: at 2019-02-05 20:47:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-02-05 20:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-02-05 20:47:05 [DEBUG   ] spawn_process: at 2019-02-05 20:47:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-02-05 20:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-02-05 20:47:05 [DEBUG   ] spawn_process: at 2019-02-05 20:47:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-02-05 20:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-02-05 20:47:05 [DEBUG   ] spawn_process: at 2019-02-05 20:47:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-02-05 20:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-02-05 20:47:05 [DEBUG   ] spawn_process: at 2019-02-05 20:47:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-02-05 20:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-02-05 20:47:05 [DEBUG   ] spawn_process: at 2019-02-05 20:47:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-02-05 20:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-02-05 20:47:05 [DEBUG   ] spawn_process: at 2019-02-05 20:47:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-02-05 20:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-02-05 20:47:05 [DEBUG   ] spawn_process: at 2019-02-05 20:47:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-02-05 20:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-02-05 20:47:05 [DEBUG   ] spawn_process: at 2019-02-05 20:47:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-02-05 20:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-02-05 20:47:05 [DEBUG   ] spawn_process: at 2019-02-05 20:47:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-02-05 20:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-02-05 20:47:05 [DEBUG   ] spawn_process: at 2019-02-05 20:47:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-02-05 20:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-02-05 20:47:05 [DEBUG   ] spawn_process: at 2019-02-05 20:47:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-02-05 20:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-02-05 20:47:05 [DEBUG   ] spawn_process: at 2019-02-05 20:47:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-02-05 20:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-02-05 20:47:05 [DEBUG   ] spawn_process: at 2019-02-05 20:47:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-02-05 20:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-02-05 20:47:05 [DEBUG   ] spawn_process: at 2019-02-05 20:47:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-02-05 20:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-02-05 20:47:05 [DEBUG   ] spawn_process: at 2019-02-05 20:47:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-02-05 20:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-02-05 20:47:05 [DEBUG   ] spawn_process: at 2019-02-05 20:47:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-02-05 20:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-02-05 20:47:05 [DEBUG   ] spawn_process: at 2019-02-05 20:47:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-02-05 20:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-02-05 20:47:05 [DEBUG   ] spawn_process: at 2019-02-05 20:47:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-02-05 20:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-02-05 20:47:05 [DEBUG   ] spawn_process: at 2019-02-05 20:47:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-02-05 20:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-02-05 20:47:05 [DEBUG   ] spawn_process: at 2019-02-05 20:47:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-02-05 20:47:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-02-05 20:47:05 [DEBUG   ] spawn_process: at 2019-02-05 20:47:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-02-05 20:47:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 20:47:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2019-02-05 20:47:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:47:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-02-05 20:47:07 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-02-05 20:47:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:47:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:47:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:47:07 [WARNING ] (13, 1, 'bot')
2019-02-05 20:47:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:47:07 [DEBUG   ] Finished updating board flags in 0.972 seconds
2019-02-05 20:47:20 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 20:47:40 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 20:47:46 [DEBUG   ] Got command BAM from MCS: ref #1413143
2019-02-05 20:47:46 [INFO    ] Finished processing BAM request
2019-02-05 20:47:46 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:47:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1413143   8 58519 74866029 A  ERROR'
2019-02-05 20:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2019-02-05 20:47:46 [DEBUG   ] spawn_process: at 2019-02-05 20:47:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2019-02-05 20:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2019-02-05 20:47:46 [DEBUG   ] spawn_process: at 2019-02-05 20:47:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2019-02-05 20:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2019-02-05 20:47:46 [DEBUG   ] spawn_process: at 2019-02-05 20:47:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2019-02-05 20:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2019-02-05 20:47:46 [DEBUG   ] spawn_process: at 2019-02-05 20:47:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2019-02-05 20:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2019-02-05 20:47:46 [DEBUG   ] spawn_process: at 2019-02-05 20:47:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2019-02-05 20:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2019-02-05 20:47:46 [DEBUG   ] spawn_process: at 2019-02-05 20:47:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2019-02-05 20:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2019-02-05 20:47:46 [DEBUG   ] spawn_process: at 2019-02-05 20:47:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2019-02-05 20:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2019-02-05 20:47:46 [DEBUG   ] spawn_process: at 2019-02-05 20:47:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2019-02-05 20:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2019-02-05 20:47:46 [DEBUG   ] spawn_process: at 2019-02-05 20:47:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2019-02-05 20:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2019-02-05 20:47:46 [DEBUG   ] spawn_process: at 2019-02-05 20:47:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2019-02-05 20:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2019-02-05 20:47:46 [DEBUG   ] spawn_process: at 2019-02-05 20:47:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2019-02-05 20:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2019-02-05 20:47:46 [DEBUG   ] spawn_process: at 2019-02-05 20:47:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2019-02-05 20:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2019-02-05 20:47:46 [DEBUG   ] spawn_process: at 2019-02-05 20:47:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2019-02-05 20:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2019-02-05 20:47:46 [DEBUG   ] spawn_process: at 2019-02-05 20:47:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2019-02-05 20:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2019-02-05 20:47:46 [DEBUG   ] spawn_process: at 2019-02-05 20:47:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2019-02-05 20:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2019-02-05 20:47:46 [DEBUG   ] spawn_process: at 2019-02-05 20:47:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2019-02-05 20:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2019-02-05 20:47:46 [DEBUG   ] spawn_process: at 2019-02-05 20:47:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2019-02-05 20:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2019-02-05 20:47:46 [DEBUG   ] spawn_process: at 2019-02-05 20:47:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2019-02-05 20:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2019-02-05 20:47:46 [DEBUG   ] spawn_process: at 2019-02-05 20:47:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2019-02-05 20:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2019-02-05 20:47:46 [DEBUG   ] spawn_process: at 2019-02-05 20:47:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2019-02-05 20:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2019-02-05 20:47:46 [DEBUG   ] spawn_process: at 2019-02-05 20:47:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2019-02-05 20:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2019-02-05 20:47:46 [DEBUG   ] spawn_process: at 2019-02-05 20:47:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2019-02-05 20:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2019-02-05 20:47:46 [DEBUG   ] spawn_process: at 2019-02-05 20:47:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2019-02-05 20:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2019-02-05 20:47:46 [DEBUG   ] spawn_process: at 2019-02-05 20:47:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2019-02-05 20:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2019-02-05 20:47:46 [DEBUG   ] spawn_process: at 2019-02-05 20:47:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2019-02-05 20:47:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2019-02-05 20:47:46 [DEBUG   ] spawn_process: at 2019-02-05 20:47:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2019-02-05 20:47:49 [DEBUG   ] Got command BAM from MCS: ref #1413144
2019-02-05 20:47:49 [INFO    ] Finished processing BAM request
2019-02-05 20:47:49 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:47:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1413144   8 58519 74869033 A  ERROR'
2019-02-05 20:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2019-02-05 20:47:49 [DEBUG   ] spawn_process: at 2019-02-05 20:47:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2019-02-05 20:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2019-02-05 20:47:49 [DEBUG   ] spawn_process: at 2019-02-05 20:47:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2019-02-05 20:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2019-02-05 20:47:49 [DEBUG   ] spawn_process: at 2019-02-05 20:47:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2019-02-05 20:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2019-02-05 20:47:49 [DEBUG   ] spawn_process: at 2019-02-05 20:47:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2019-02-05 20:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2019-02-05 20:47:49 [DEBUG   ] spawn_process: at 2019-02-05 20:47:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2019-02-05 20:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2019-02-05 20:47:49 [DEBUG   ] spawn_process: at 2019-02-05 20:47:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2019-02-05 20:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2019-02-05 20:47:49 [DEBUG   ] spawn_process: at 2019-02-05 20:47:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2019-02-05 20:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2019-02-05 20:47:49 [DEBUG   ] spawn_process: at 2019-02-05 20:47:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2019-02-05 20:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2019-02-05 20:47:49 [DEBUG   ] spawn_process: at 2019-02-05 20:47:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2019-02-05 20:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2019-02-05 20:47:49 [DEBUG   ] spawn_process: at 2019-02-05 20:47:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2019-02-05 20:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2019-02-05 20:47:49 [DEBUG   ] spawn_process: at 2019-02-05 20:47:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2019-02-05 20:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2019-02-05 20:47:49 [DEBUG   ] spawn_process: at 2019-02-05 20:47:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2019-02-05 20:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2019-02-05 20:47:49 [DEBUG   ] spawn_process: at 2019-02-05 20:47:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2019-02-05 20:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2019-02-05 20:47:49 [DEBUG   ] spawn_process: at 2019-02-05 20:47:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2019-02-05 20:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2019-02-05 20:47:49 [DEBUG   ] spawn_process: at 2019-02-05 20:47:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2019-02-05 20:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2019-02-05 20:47:49 [DEBUG   ] spawn_process: at 2019-02-05 20:47:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2019-02-05 20:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2019-02-05 20:47:49 [DEBUG   ] spawn_process: at 2019-02-05 20:47:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2019-02-05 20:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2019-02-05 20:47:49 [DEBUG   ] spawn_process: at 2019-02-05 20:47:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2019-02-05 20:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2019-02-05 20:47:49 [DEBUG   ] spawn_process: at 2019-02-05 20:47:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2019-02-05 20:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2019-02-05 20:47:49 [DEBUG   ] spawn_process: at 2019-02-05 20:47:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2019-02-05 20:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2019-02-05 20:47:49 [DEBUG   ] spawn_process: at 2019-02-05 20:47:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2019-02-05 20:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2019-02-05 20:47:49 [DEBUG   ] spawn_process: at 2019-02-05 20:47:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2019-02-05 20:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2019-02-05 20:47:49 [DEBUG   ] spawn_process: at 2019-02-05 20:47:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2019-02-05 20:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2019-02-05 20:47:49 [DEBUG   ] spawn_process: at 2019-02-05 20:47:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2019-02-05 20:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2019-02-05 20:47:49 [DEBUG   ] spawn_process: at 2019-02-05 20:47:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2019-02-05 20:47:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2019-02-05 20:47:49 [DEBUG   ] spawn_process: at 2019-02-05 20:47:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2019-02-05 20:48:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 20:48:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 20:48:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:48:08 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2019-02-05 20:48:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2019-02-05 20:48:08 [WARNING ] (13, 1, 'bot')
2019-02-05 20:48:08 [WARNING ] (13, 1, 'bot')
2019-02-05 20:48:08 [WARNING ] (13, 1, 'bot')
2019-02-05 20:48:08 [WARNING ] (13, 1, 'bot')
2019-02-05 20:48:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:48:08 [DEBUG   ] Finished updating board flags in 1.371 seconds
2019-02-05 20:48:20 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 20:48:33 [DEBUG   ] Got command BAM from MCS: ref #1413145
2019-02-05 20:48:33 [INFO    ] Finished processing BAM request
2019-02-05 20:48:33 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:48:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1413145   8 58519 74913025 A  ERROR'
2019-02-05 20:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-02-05 20:48:33 [DEBUG   ] spawn_process: at 2019-02-05 20:48:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-02-05 20:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-02-05 20:48:33 [DEBUG   ] spawn_process: at 2019-02-05 20:48:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-02-05 20:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-02-05 20:48:33 [DEBUG   ] spawn_process: at 2019-02-05 20:48:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-02-05 20:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-02-05 20:48:33 [DEBUG   ] spawn_process: at 2019-02-05 20:48:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-02-05 20:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-02-05 20:48:33 [DEBUG   ] spawn_process: at 2019-02-05 20:48:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-02-05 20:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-02-05 20:48:33 [DEBUG   ] spawn_process: at 2019-02-05 20:48:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-02-05 20:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-02-05 20:48:33 [DEBUG   ] spawn_process: at 2019-02-05 20:48:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-02-05 20:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-02-05 20:48:33 [DEBUG   ] spawn_process: at 2019-02-05 20:48:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-02-05 20:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-02-05 20:48:33 [DEBUG   ] spawn_process: at 2019-02-05 20:48:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-02-05 20:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-02-05 20:48:33 [DEBUG   ] spawn_process: at 2019-02-05 20:48:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-02-05 20:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-02-05 20:48:33 [DEBUG   ] spawn_process: at 2019-02-05 20:48:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-02-05 20:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-02-05 20:48:33 [DEBUG   ] spawn_process: at 2019-02-05 20:48:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-02-05 20:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-02-05 20:48:33 [DEBUG   ] spawn_process: at 2019-02-05 20:48:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-02-05 20:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-02-05 20:48:33 [DEBUG   ] spawn_process: at 2019-02-05 20:48:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-02-05 20:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-02-05 20:48:33 [DEBUG   ] spawn_process: at 2019-02-05 20:48:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-02-05 20:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-02-05 20:48:33 [DEBUG   ] spawn_process: at 2019-02-05 20:48:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-02-05 20:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-02-05 20:48:33 [DEBUG   ] spawn_process: at 2019-02-05 20:48:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-02-05 20:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-02-05 20:48:33 [DEBUG   ] spawn_process: at 2019-02-05 20:48:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-02-05 20:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-02-05 20:48:33 [DEBUG   ] spawn_process: at 2019-02-05 20:48:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-02-05 20:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-02-05 20:48:33 [DEBUG   ] spawn_process: at 2019-02-05 20:48:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-02-05 20:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-02-05 20:48:33 [DEBUG   ] spawn_process: at 2019-02-05 20:48:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-02-05 20:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-02-05 20:48:33 [DEBUG   ] spawn_process: at 2019-02-05 20:48:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-02-05 20:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-02-05 20:48:33 [DEBUG   ] spawn_process: at 2019-02-05 20:48:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-02-05 20:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-02-05 20:48:33 [DEBUG   ] spawn_process: at 2019-02-05 20:48:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-02-05 20:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-02-05 20:48:33 [DEBUG   ] spawn_process: at 2019-02-05 20:48:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-02-05 20:48:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-02-05 20:48:33 [DEBUG   ] spawn_process: at 2019-02-05 20:48:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-02-05 20:48:40 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 20:48:50 [DEBUG   ] Got command BAM from MCS: ref #1413146
2019-02-05 20:48:50 [INFO    ] Finished processing BAM request
2019-02-05 20:48:50 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:48:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1413146   8 58519 74930033 A  ERROR'
2019-02-05 20:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2019-02-05 20:48:50 [DEBUG   ] spawn_process: at 2019-02-05 20:48:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2019-02-05 20:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2019-02-05 20:48:50 [DEBUG   ] spawn_process: at 2019-02-05 20:48:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2019-02-05 20:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2019-02-05 20:48:50 [DEBUG   ] spawn_process: at 2019-02-05 20:48:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2019-02-05 20:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2019-02-05 20:48:50 [DEBUG   ] spawn_process: at 2019-02-05 20:48:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2019-02-05 20:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2019-02-05 20:48:50 [DEBUG   ] spawn_process: at 2019-02-05 20:48:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2019-02-05 20:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2019-02-05 20:48:50 [DEBUG   ] spawn_process: at 2019-02-05 20:48:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2019-02-05 20:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2019-02-05 20:48:50 [DEBUG   ] spawn_process: at 2019-02-05 20:48:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2019-02-05 20:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2019-02-05 20:48:50 [DEBUG   ] spawn_process: at 2019-02-05 20:48:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2019-02-05 20:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2019-02-05 20:48:50 [DEBUG   ] spawn_process: at 2019-02-05 20:48:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2019-02-05 20:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2019-02-05 20:48:50 [DEBUG   ] spawn_process: at 2019-02-05 20:48:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2019-02-05 20:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2019-02-05 20:48:50 [DEBUG   ] spawn_process: at 2019-02-05 20:48:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2019-02-05 20:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2019-02-05 20:48:50 [DEBUG   ] spawn_process: at 2019-02-05 20:48:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2019-02-05 20:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2019-02-05 20:48:50 [DEBUG   ] spawn_process: at 2019-02-05 20:48:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2019-02-05 20:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2019-02-05 20:48:50 [DEBUG   ] spawn_process: at 2019-02-05 20:48:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2019-02-05 20:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2019-02-05 20:48:50 [DEBUG   ] spawn_process: at 2019-02-05 20:48:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2019-02-05 20:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2019-02-05 20:48:50 [DEBUG   ] spawn_process: at 2019-02-05 20:48:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2019-02-05 20:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2019-02-05 20:48:50 [DEBUG   ] spawn_process: at 2019-02-05 20:48:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2019-02-05 20:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2019-02-05 20:48:50 [DEBUG   ] spawn_process: at 2019-02-05 20:48:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2019-02-05 20:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2019-02-05 20:48:50 [DEBUG   ] spawn_process: at 2019-02-05 20:48:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2019-02-05 20:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2019-02-05 20:48:50 [DEBUG   ] spawn_process: at 2019-02-05 20:48:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2019-02-05 20:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2019-02-05 20:48:50 [DEBUG   ] spawn_process: at 2019-02-05 20:48:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2019-02-05 20:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2019-02-05 20:48:50 [DEBUG   ] spawn_process: at 2019-02-05 20:48:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2019-02-05 20:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2019-02-05 20:48:50 [DEBUG   ] spawn_process: at 2019-02-05 20:48:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2019-02-05 20:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2019-02-05 20:48:50 [DEBUG   ] spawn_process: at 2019-02-05 20:48:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2019-02-05 20:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2019-02-05 20:48:50 [DEBUG   ] spawn_process: at 2019-02-05 20:48:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2019-02-05 20:48:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2019-02-05 20:48:50 [DEBUG   ] spawn_process: at 2019-02-05 20:48:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2019-02-05 20:49:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 20:49:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-02-05 20:49:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:49:08 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2019-02-05 20:49:08 [WARNING ] (13, 1, 'bot')
2019-02-05 20:49:08 [WARNING ] (13, 1, 'bot')
2019-02-05 20:49:08 [WARNING ] (13, 1, 'bot')
2019-02-05 20:49:08 [WARNING ] (13, 1, 'bot')
2019-02-05 20:49:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:49:08 [DEBUG   ] Finished updating board flags in 1.227 seconds
2019-02-05 20:49:17 [DEBUG   ] Got command BAM from MCS: ref #1413147
2019-02-05 20:49:17 [INFO    ] Finished processing BAM request
2019-02-05 20:49:17 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:49:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1413147   8 58519 74957029 A  ERROR'
2019-02-05 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-02-05 20:49:17 [DEBUG   ] spawn_process: at 2019-02-05 20:49:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-02-05 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-02-05 20:49:17 [DEBUG   ] spawn_process: at 2019-02-05 20:49:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-02-05 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-02-05 20:49:17 [DEBUG   ] spawn_process: at 2019-02-05 20:49:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-02-05 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-02-05 20:49:17 [DEBUG   ] spawn_process: at 2019-02-05 20:49:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-02-05 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-02-05 20:49:17 [DEBUG   ] spawn_process: at 2019-02-05 20:49:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-02-05 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-02-05 20:49:17 [DEBUG   ] spawn_process: at 2019-02-05 20:49:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-02-05 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-02-05 20:49:17 [DEBUG   ] spawn_process: at 2019-02-05 20:49:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-02-05 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-02-05 20:49:17 [DEBUG   ] spawn_process: at 2019-02-05 20:49:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-02-05 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-02-05 20:49:17 [DEBUG   ] spawn_process: at 2019-02-05 20:49:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-02-05 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-02-05 20:49:17 [DEBUG   ] spawn_process: at 2019-02-05 20:49:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-02-05 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-02-05 20:49:17 [DEBUG   ] spawn_process: at 2019-02-05 20:49:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-02-05 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-02-05 20:49:17 [DEBUG   ] spawn_process: at 2019-02-05 20:49:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-02-05 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-02-05 20:49:17 [DEBUG   ] spawn_process: at 2019-02-05 20:49:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-02-05 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-02-05 20:49:17 [DEBUG   ] spawn_process: at 2019-02-05 20:49:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-02-05 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-02-05 20:49:17 [DEBUG   ] spawn_process: at 2019-02-05 20:49:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-02-05 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-02-05 20:49:17 [DEBUG   ] spawn_process: at 2019-02-05 20:49:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-02-05 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-02-05 20:49:17 [DEBUG   ] spawn_process: at 2019-02-05 20:49:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-02-05 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-02-05 20:49:17 [DEBUG   ] spawn_process: at 2019-02-05 20:49:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-02-05 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-02-05 20:49:17 [DEBUG   ] spawn_process: at 2019-02-05 20:49:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-02-05 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-02-05 20:49:17 [DEBUG   ] spawn_process: at 2019-02-05 20:49:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-02-05 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-02-05 20:49:17 [DEBUG   ] spawn_process: at 2019-02-05 20:49:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-02-05 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-02-05 20:49:17 [DEBUG   ] spawn_process: at 2019-02-05 20:49:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-02-05 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-02-05 20:49:17 [DEBUG   ] spawn_process: at 2019-02-05 20:49:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-02-05 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-02-05 20:49:17 [DEBUG   ] spawn_process: at 2019-02-05 20:49:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-02-05 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-02-05 20:49:17 [DEBUG   ] spawn_process: at 2019-02-05 20:49:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-02-05 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-02-05 20:49:17 [DEBUG   ] spawn_process: at 2019-02-05 20:49:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-02-05 20:49:20 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 20:49:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 20:49:54 [DEBUG   ] Got command BAM from MCS: ref #1413148
2019-02-05 20:49:54 [INFO    ] Finished processing BAM request
2019-02-05 20:49:54 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:49:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1413148   8 58519 74994033 A  ERROR'
2019-02-05 20:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 20:49:54 [DEBUG   ] spawn_process: at 2019-02-05 20:49:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 20:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 20:49:54 [DEBUG   ] spawn_process: at 2019-02-05 20:49:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 20:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 20:49:54 [DEBUG   ] spawn_process: at 2019-02-05 20:49:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 20:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 20:49:54 [DEBUG   ] spawn_process: at 2019-02-05 20:49:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 20:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 20:49:54 [DEBUG   ] spawn_process: at 2019-02-05 20:49:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 20:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 20:49:54 [DEBUG   ] spawn_process: at 2019-02-05 20:49:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 20:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 20:49:54 [DEBUG   ] spawn_process: at 2019-02-05 20:49:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 20:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 20:49:54 [DEBUG   ] spawn_process: at 2019-02-05 20:49:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 20:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 20:49:54 [DEBUG   ] spawn_process: at 2019-02-05 20:49:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 20:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 20:49:54 [DEBUG   ] spawn_process: at 2019-02-05 20:49:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 20:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 20:49:54 [DEBUG   ] spawn_process: at 2019-02-05 20:49:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 20:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 20:49:54 [DEBUG   ] spawn_process: at 2019-02-05 20:49:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 20:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 20:49:54 [DEBUG   ] spawn_process: at 2019-02-05 20:49:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 20:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 20:49:54 [DEBUG   ] spawn_process: at 2019-02-05 20:49:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 20:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 20:49:54 [DEBUG   ] spawn_process: at 2019-02-05 20:49:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 20:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 20:49:54 [DEBUG   ] spawn_process: at 2019-02-05 20:49:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 20:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 20:49:54 [DEBUG   ] spawn_process: at 2019-02-05 20:49:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 20:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 20:49:54 [DEBUG   ] spawn_process: at 2019-02-05 20:49:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 20:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 20:49:54 [DEBUG   ] spawn_process: at 2019-02-05 20:49:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 20:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 20:49:54 [DEBUG   ] spawn_process: at 2019-02-05 20:49:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 20:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 20:49:54 [DEBUG   ] spawn_process: at 2019-02-05 20:49:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 20:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 20:49:54 [DEBUG   ] spawn_process: at 2019-02-05 20:49:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 20:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 20:49:54 [DEBUG   ] spawn_process: at 2019-02-05 20:49:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 20:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 20:49:54 [DEBUG   ] spawn_process: at 2019-02-05 20:49:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 20:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 20:49:54 [DEBUG   ] spawn_process: at 2019-02-05 20:49:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 20:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 20:49:54 [DEBUG   ] spawn_process: at 2019-02-05 20:49:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 20:49:57 [DEBUG   ] Got command RPT from MCS: ref #1413149
2019-02-05 20:49:57 [DEBUG   ] summary = ERROR
2019-02-05 20:49:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413149  13 58519 74997165 A  ERRORERROR'
2019-02-05 20:49:57 [DEBUG   ] Got command RPT from MCS: ref #1413150
2019-02-05 20:49:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 20:49:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413150  77 58519 74997357 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 20:49:57 [DEBUG   ] Got command RPT from MCS: ref #1413151
2019-02-05 20:49:57 [DEBUG   ] summary = ERROR
2019-02-05 20:49:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413151  13 58519 74997561 A  ERRORERROR'
2019-02-05 20:49:57 [DEBUG   ] Got command RPT from MCS: ref #1413152
2019-02-05 20:49:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 20:49:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413152  77 58519 74997765 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 20:49:57 [DEBUG   ] Got command RPT from MCS: ref #1413153
2019-02-05 20:49:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 20:49:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413153  12 58519 74997969 A  ERRORB¢ff'
2019-02-05 20:50:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 20:50:01 [DEBUG   ] Got command BAM from MCS: ref #1413154
2019-02-05 20:50:01 [INFO    ] Finished processing BAM request
2019-02-05 20:50:01 [DEBUG   ] bam = exited with status True, code 0x00
2019-02-05 20:50:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM  1413154   8 58519 75001029 A  ERROR'
2019-02-05 20:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2019-02-05 20:50:01 [DEBUG   ] spawn_process: at 2019-02-05 20:50:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2019-02-05 20:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2019-02-05 20:50:01 [DEBUG   ] spawn_process: at 2019-02-05 20:50:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2019-02-05 20:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2019-02-05 20:50:01 [DEBUG   ] spawn_process: at 2019-02-05 20:50:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2019-02-05 20:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2019-02-05 20:50:01 [DEBUG   ] spawn_process: at 2019-02-05 20:50:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2019-02-05 20:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2019-02-05 20:50:01 [DEBUG   ] spawn_process: at 2019-02-05 20:50:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2019-02-05 20:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2019-02-05 20:50:01 [DEBUG   ] spawn_process: at 2019-02-05 20:50:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2019-02-05 20:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2019-02-05 20:50:01 [DEBUG   ] spawn_process: at 2019-02-05 20:50:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2019-02-05 20:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2019-02-05 20:50:01 [DEBUG   ] spawn_process: at 2019-02-05 20:50:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2019-02-05 20:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2019-02-05 20:50:01 [DEBUG   ] spawn_process: at 2019-02-05 20:50:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2019-02-05 20:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2019-02-05 20:50:01 [DEBUG   ] spawn_process: at 2019-02-05 20:50:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2019-02-05 20:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2019-02-05 20:50:01 [DEBUG   ] spawn_process: at 2019-02-05 20:50:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2019-02-05 20:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2019-02-05 20:50:01 [DEBUG   ] spawn_process: at 2019-02-05 20:50:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2019-02-05 20:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2019-02-05 20:50:01 [DEBUG   ] spawn_process: at 2019-02-05 20:50:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2019-02-05 20:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2019-02-05 20:50:01 [DEBUG   ] spawn_process: at 2019-02-05 20:50:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2019-02-05 20:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2019-02-05 20:50:01 [DEBUG   ] spawn_process: at 2019-02-05 20:50:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2019-02-05 20:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2019-02-05 20:50:01 [DEBUG   ] spawn_process: at 2019-02-05 20:50:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2019-02-05 20:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2019-02-05 20:50:01 [DEBUG   ] spawn_process: at 2019-02-05 20:50:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2019-02-05 20:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2019-02-05 20:50:01 [DEBUG   ] spawn_process: at 2019-02-05 20:50:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2019-02-05 20:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2019-02-05 20:50:01 [DEBUG   ] spawn_process: at 2019-02-05 20:50:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2019-02-05 20:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2019-02-05 20:50:01 [DEBUG   ] spawn_process: at 2019-02-05 20:50:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2019-02-05 20:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2019-02-05 20:50:01 [DEBUG   ] spawn_process: at 2019-02-05 20:50:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2019-02-05 20:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2019-02-05 20:50:01 [DEBUG   ] spawn_process: at 2019-02-05 20:50:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2019-02-05 20:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2019-02-05 20:50:01 [DEBUG   ] spawn_process: at 2019-02-05 20:50:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2019-02-05 20:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2019-02-05 20:50:01 [DEBUG   ] spawn_process: at 2019-02-05 20:50:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2019-02-05 20:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2019-02-05 20:50:01 [DEBUG   ] spawn_process: at 2019-02-05 20:50:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2019-02-05 20:50:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2019-02-05 20:50:01 [DEBUG   ] spawn_process: at 2019-02-05 20:50:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2019-02-05 20:50:04 [DEBUG   ] Got command STP from MCS: ref #1413156
2019-02-05 20:50:04 [INFO    ] Finished processing BAM request
2019-02-05 20:50:04 [INFO    ] Shutdown the adder chain on beam #2
2019-02-05 20:50:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP  1413156   8 58519 75004117 A  ERROR'
2019-02-05 20:50:04 [DEBUG   ] Got command STP from MCS: ref #1413155
2019-02-05 20:50:04 [INFO    ] Finished processing BAM request
2019-02-05 20:50:04 [INFO    ] Shutdown the adder chain on beam #3
2019-02-05 20:50:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP  1413155   8 58519 75004121 A  ERROR'
2019-02-05 20:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2019-02-05 20:50:04 [DEBUG   ] spawn_process: at 2019-02-05 20:50:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2019-02-05 20:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2019-02-05 20:50:04 [DEBUG   ] spawn_process: at 2019-02-05 20:50:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2019-02-05 20:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2019-02-05 20:50:04 [DEBUG   ] spawn_process: at 2019-02-05 20:50:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2019-02-05 20:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2019-02-05 20:50:04 [DEBUG   ] spawn_process: at 2019-02-05 20:50:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2019-02-05 20:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2019-02-05 20:50:04 [DEBUG   ] spawn_process: at 2019-02-05 20:50:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2019-02-05 20:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2019-02-05 20:50:04 [DEBUG   ] spawn_process: at 2019-02-05 20:50:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2019-02-05 20:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2019-02-05 20:50:04 [DEBUG   ] spawn_process: at 2019-02-05 20:50:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2019-02-05 20:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2019-02-05 20:50:04 [DEBUG   ] spawn_process: at 2019-02-05 20:50:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2019-02-05 20:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2019-02-05 20:50:04 [DEBUG   ] spawn_process: at 2019-02-05 20:50:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2019-02-05 20:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2019-02-05 20:50:04 [DEBUG   ] spawn_process: at 2019-02-05 20:50:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2019-02-05 20:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2019-02-05 20:50:04 [DEBUG   ] spawn_process: at 2019-02-05 20:50:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2019-02-05 20:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2019-02-05 20:50:04 [DEBUG   ] spawn_process: at 2019-02-05 20:50:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2019-02-05 20:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2019-02-05 20:50:04 [DEBUG   ] spawn_process: at 2019-02-05 20:50:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2019-02-05 20:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2019-02-05 20:50:04 [DEBUG   ] spawn_process: at 2019-02-05 20:50:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2019-02-05 20:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2019-02-05 20:50:04 [DEBUG   ] spawn_process: at 2019-02-05 20:50:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2019-02-05 20:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2019-02-05 20:50:04 [DEBUG   ] spawn_process: at 2019-02-05 20:50:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2019-02-05 20:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2019-02-05 20:50:04 [DEBUG   ] spawn_process: at 2019-02-05 20:50:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2019-02-05 20:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2019-02-05 20:50:04 [DEBUG   ] spawn_process: at 2019-02-05 20:50:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2019-02-05 20:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2019-02-05 20:50:04 [DEBUG   ] spawn_process: at 2019-02-05 20:50:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2019-02-05 20:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2019-02-05 20:50:04 [DEBUG   ] spawn_process: at 2019-02-05 20:50:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2019-02-05 20:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2019-02-05 20:50:04 [DEBUG   ] spawn_process: at 2019-02-05 20:50:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2019-02-05 20:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2019-02-05 20:50:04 [DEBUG   ] spawn_process: at 2019-02-05 20:50:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2019-02-05 20:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2019-02-05 20:50:04 [DEBUG   ] spawn_process: at 2019-02-05 20:50:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2019-02-05 20:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2019-02-05 20:50:04 [DEBUG   ] spawn_process: at 2019-02-05 20:50:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2019-02-05 20:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2019-02-05 20:50:04 [DEBUG   ] spawn_process: at 2019-02-05 20:50:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2019-02-05 20:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2019-02-05 20:50:04 [DEBUG   ] spawn_process: at 2019-02-05 20:50:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2019-02-05 20:50:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:50:08 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2019-02-05 20:50:08 [WARNING ] (13, 1, 'bot')
2019-02-05 20:50:08 [WARNING ] (13, 1, 'bot')
2019-02-05 20:50:08 [WARNING ] (13, 1, 'bot')
2019-02-05 20:50:08 [WARNING ] (13, 1, 'bot')
2019-02-05 20:50:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:50:08 [DEBUG   ] Finished updating board flags in 1.177 seconds
2019-02-05 20:50:20 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-05 20:50:40 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-05 20:51:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:51:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:51:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 20:51:08 [WARNING ] (13, 1, 'bot')
2019-02-05 20:51:08 [WARNING ] (13, 1, 'bot')
2019-02-05 20:51:08 [WARNING ] (13, 1, 'bot')
2019-02-05 20:51:08 [WARNING ] (13, 1, 'bot')
2019-02-05 20:51:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:51:08 [DEBUG   ] Finished updating board flags in 1.018 seconds
2019-02-05 20:51:12 [DEBUG   ] Got command RPT from MCS: ref #1413161
2019-02-05 20:51:12 [DEBUG   ] summary = ERROR
2019-02-05 20:51:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413161  13 58519 75072033 A  ERRORERROR'
2019-02-05 20:51:12 [DEBUG   ] Got command RPT from MCS: ref #1413162
2019-02-05 20:51:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 20:51:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413162  77 58519 75072034 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 20:51:20 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-05 20:51:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:52:00 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-05 20:52:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:52:08 [WARNING ] (13, 1, 'bot')
2019-02-05 20:52:08 [WARNING ] (13, 1, 'bot')
2019-02-05 20:52:08 [WARNING ] (13, 1, 'bot')
2019-02-05 20:52:08 [WARNING ] (13, 1, 'bot')
2019-02-05 20:52:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:52:08 [DEBUG   ] Finished updating board flags in 1.071 seconds
2019-02-05 20:52:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:52:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:53:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:53:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 20:53:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:53:09 [WARNING ] (13, 1, 'bot')
2019-02-05 20:53:09 [WARNING ] (13, 1, 'bot')
2019-02-05 20:53:09 [WARNING ] (13, 1, 'bot')
2019-02-05 20:53:09 [WARNING ] (13, 1, 'bot')
2019-02-05 20:53:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:53:09 [DEBUG   ] Finished updating board flags in 2.006 seconds
2019-02-05 20:53:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:53:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:54:00 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-05 20:54:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:54:09 [WARNING ] (13, 1, 'bot')
2019-02-05 20:54:09 [WARNING ] (13, 1, 'bot')
2019-02-05 20:54:09 [WARNING ] (13, 1, 'bot')
2019-02-05 20:54:09 [WARNING ] (13, 1, 'bot')
2019-02-05 20:54:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:54:09 [DEBUG   ] Finished updating board flags in 1.913 seconds
2019-02-05 20:54:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:54:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:54:57 [DEBUG   ] Got command RPT from MCS: ref #1413184
2019-02-05 20:54:57 [DEBUG   ] summary = ERROR
2019-02-05 20:54:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413184  13 58519 75297245 A  ERRORERROR'
2019-02-05 20:54:57 [DEBUG   ] Got command RPT from MCS: ref #1413185
2019-02-05 20:54:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 20:54:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413185  77 58519 75297449 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 20:54:57 [DEBUG   ] Got command RPT from MCS: ref #1413186
2019-02-05 20:54:57 [DEBUG   ] summary = ERROR
2019-02-05 20:54:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413186  13 58519 75297641 A  ERRORERROR'
2019-02-05 20:54:57 [DEBUG   ] Got command RPT from MCS: ref #1413188
2019-02-05 20:54:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 20:54:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413188  77 58519 75297845 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 20:54:58 [DEBUG   ] Got command RPT from MCS: ref #1413189
2019-02-05 20:54:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 20:54:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413189  12 58519 75298049 A  ERRORBš™š'
2019-02-05 20:55:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:55:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:55:08 [WARNING ] (13, 1, 'bot')
2019-02-05 20:55:08 [WARNING ] (13, 1, 'bot')
2019-02-05 20:55:08 [WARNING ] (13, 1, 'bot')
2019-02-05 20:55:08 [WARNING ] (13, 1, 'bot')
2019-02-05 20:55:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:55:08 [DEBUG   ] Finished updating board flags in 1.249 seconds
2019-02-05 20:55:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:55:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:56:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:56:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:56:08 [WARNING ] (13, 1, 'bot')
2019-02-05 20:56:08 [WARNING ] (13, 1, 'bot')
2019-02-05 20:56:08 [WARNING ] (13, 1, 'bot')
2019-02-05 20:56:08 [WARNING ] (13, 1, 'bot')
2019-02-05 20:56:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:56:08 [DEBUG   ] Finished updating board flags in 1.227 seconds
2019-02-05 20:56:12 [DEBUG   ] Got command RPT from MCS: ref #1413194
2019-02-05 20:56:12 [DEBUG   ] summary = ERROR
2019-02-05 20:56:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413194  13 58519 75372037 A  ERRORERROR'
2019-02-05 20:56:12 [DEBUG   ] Got command RPT from MCS: ref #1413195
2019-02-05 20:56:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 20:56:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413195  77 58519 75372038 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 20:56:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:56:40 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-05 20:57:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:57:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-02-05 20:57:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:57:08 [WARNING ] (13, 1, 'bot')
2019-02-05 20:57:08 [WARNING ] (13, 1, 'bot')
2019-02-05 20:57:08 [WARNING ] (13, 1, 'bot')
2019-02-05 20:57:08 [WARNING ] (13, 1, 'bot')
2019-02-05 20:57:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:57:08 [DEBUG   ] Finished updating board flags in 1.172 seconds
2019-02-05 20:57:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:57:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:58:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:58:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:58:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-02-05 20:58:08 [WARNING ] (13, 1, 'bot')
2019-02-05 20:58:08 [WARNING ] (13, 1, 'bot')
2019-02-05 20:58:08 [WARNING ] (13, 1, 'bot')
2019-02-05 20:58:08 [WARNING ] (13, 1, 'bot')
2019-02-05 20:58:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:58:08 [DEBUG   ] Finished updating board flags in 1.097 seconds
2019-02-05 20:58:20 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-05 20:58:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:59:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 20:59:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 20:59:09 [WARNING ] (13, 1, 'bot')
2019-02-05 20:59:09 [WARNING ] (13, 1, 'bot')
2019-02-05 20:59:09 [WARNING ] (13, 1, 'bot')
2019-02-05 20:59:09 [WARNING ] (13, 1, 'bot')
2019-02-05 20:59:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 20:59:09 [DEBUG   ] Finished updating board flags in 1.540 seconds
2019-02-05 20:59:20 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-05 20:59:40 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 20:59:57 [DEBUG   ] Got command RPT from MCS: ref #1413219
2019-02-05 20:59:57 [DEBUG   ] summary = ERROR
2019-02-05 20:59:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413219  13 58519 75597317 A  ERRORERROR'
2019-02-05 20:59:57 [DEBUG   ] Got command RPT from MCS: ref #1413220
2019-02-05 20:59:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 20:59:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413220  77 58519 75597521 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 20:59:57 [DEBUG   ] Got command RPT from MCS: ref #1413221
2019-02-05 20:59:57 [DEBUG   ] summary = ERROR
2019-02-05 20:59:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413221  13 58519 75597725 A  ERRORERROR'
2019-02-05 20:59:57 [DEBUG   ] Got command RPT from MCS: ref #1413222
2019-02-05 20:59:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 20:59:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413222  77 58519 75597929 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 20:59:58 [DEBUG   ] Got command RPT from MCS: ref #1413223
2019-02-05 20:59:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 20:59:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413223  12 58519 75598121 A  ERRORB™™š'
2019-02-05 21:00:00 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 21:00:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:00:09 [WARNING ] (13, 1, 'bot')
2019-02-05 21:00:09 [WARNING ] (13, 1, 'bot')
2019-02-05 21:00:09 [WARNING ] (13, 1, 'bot')
2019-02-05 21:00:09 [WARNING ] (13, 1, 'bot')
2019-02-05 21:00:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:00:09 [DEBUG   ] Finished updating board flags in 1.317 seconds
2019-02-05 21:00:20 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 21:00:40 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 21:01:00 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 21:01:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:01:09 [WARNING ] (13, 1, 'bot')
2019-02-05 21:01:09 [WARNING ] (13, 1, 'bot')
2019-02-05 21:01:09 [WARNING ] (13, 1, 'bot')
2019-02-05 21:01:09 [WARNING ] (13, 1, 'bot')
2019-02-05 21:01:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:01:09 [DEBUG   ] Finished updating board flags in 1.224 seconds
2019-02-05 21:01:12 [DEBUG   ] Got command RPT from MCS: ref #1413224
2019-02-05 21:01:12 [DEBUG   ] summary = ERROR
2019-02-05 21:01:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413224  13 58519 75672029 A  ERRORERROR'
2019-02-05 21:01:12 [DEBUG   ] Got command RPT from MCS: ref #1413225
2019-02-05 21:01:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 21:01:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413225  77 58519 75672030 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 21:01:20 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 21:01:40 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 21:02:00 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 21:02:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:02:09 [WARNING ] (13, 1, 'bot')
2019-02-05 21:02:09 [WARNING ] (13, 1, 'bot')
2019-02-05 21:02:09 [WARNING ] (13, 1, 'bot')
2019-02-05 21:02:09 [WARNING ] (13, 1, 'bot')
2019-02-05 21:02:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:02:09 [DEBUG   ] Finished updating board flags in 1.185 seconds
2019-02-05 21:02:20 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 21:02:40 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 21:03:00 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 21:03:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:03:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-02-05 21:03:09 [WARNING ] (13, 1, 'bot')
2019-02-05 21:03:09 [WARNING ] (13, 1, 'bot')
2019-02-05 21:03:09 [WARNING ] (13, 1, 'bot')
2019-02-05 21:03:09 [WARNING ] (13, 1, 'bot')
2019-02-05 21:03:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:03:09 [DEBUG   ] Finished updating board flags in 1.003 seconds
2019-02-05 21:03:20 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 21:03:40 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 21:04:00 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 21:04:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 21:04:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:04:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 21:04:09 [WARNING ] (13, 1, 'bot')
2019-02-05 21:04:09 [WARNING ] (13, 1, 'bot')
2019-02-05 21:04:09 [WARNING ] (13, 1, 'bot')
2019-02-05 21:04:09 [WARNING ] (13, 1, 'bot')
2019-02-05 21:04:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:04:09 [DEBUG   ] Finished updating board flags in 1.076 seconds
2019-02-05 21:04:20 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 21:04:40 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 21:04:57 [DEBUG   ] Got command RPT from MCS: ref #1413247
2019-02-05 21:04:57 [DEBUG   ] summary = ERROR
2019-02-05 21:04:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413247  13 58519 75897401 A  ERRORERROR'
2019-02-05 21:04:57 [DEBUG   ] Got command RPT from MCS: ref #1413248
2019-02-05 21:04:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 21:04:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413248  77 58519 75897605 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 21:04:57 [DEBUG   ] Got command RPT from MCS: ref #1413249
2019-02-05 21:04:57 [DEBUG   ] summary = ERROR
2019-02-05 21:04:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413249  13 58519 75897797 A  ERRORERROR'
2019-02-05 21:04:58 [DEBUG   ] Got command RPT from MCS: ref #1413250
2019-02-05 21:04:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 21:04:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413250  77 58519 75898001 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 21:04:58 [DEBUG   ] Got command RPT from MCS: ref #1413252
2019-02-05 21:04:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 21:04:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413252  12 58519 75898205 A  ERRORBš™š'
2019-02-05 21:05:00 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 21:05:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:05:09 [WARNING ] (13, 1, 'bot')
2019-02-05 21:05:09 [WARNING ] (13, 1, 'bot')
2019-02-05 21:05:09 [WARNING ] (13, 1, 'bot')
2019-02-05 21:05:09 [WARNING ] (13, 1, 'bot')
2019-02-05 21:05:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:05:09 [DEBUG   ] Finished updating board flags in 1.470 seconds
2019-02-05 21:05:20 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 21:05:40 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 21:06:00 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 21:06:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:06:09 [WARNING ] (13, 1, 'bot')
2019-02-05 21:06:09 [WARNING ] (13, 1, 'bot')
2019-02-05 21:06:09 [WARNING ] (13, 1, 'bot')
2019-02-05 21:06:09 [WARNING ] (13, 1, 'bot')
2019-02-05 21:06:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:06:09 [DEBUG   ] Finished updating board flags in 1.415 seconds
2019-02-05 21:06:12 [DEBUG   ] Got command RPT from MCS: ref #1413261
2019-02-05 21:06:12 [DEBUG   ] summary = ERROR
2019-02-05 21:06:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413261  13 58519 75972037 A  ERRORERROR'
2019-02-05 21:06:12 [DEBUG   ] Got command RPT from MCS: ref #1413262
2019-02-05 21:06:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 21:06:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413262  77 58519 75972038 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 21:06:20 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 21:06:40 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 21:07:00 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 21:07:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:07:09 [WARNING ] (13, 1, 'bot')
2019-02-05 21:07:09 [WARNING ] (13, 1, 'bot')
2019-02-05 21:07:09 [WARNING ] (13, 1, 'bot')
2019-02-05 21:07:09 [WARNING ] (13, 1, 'bot')
2019-02-05 21:07:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:07:09 [DEBUG   ] Finished updating board flags in 1.302 seconds
2019-02-05 21:07:20 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-02-05 21:07:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 21:08:01 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 21:08:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 21:08:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:08:09 [WARNING ] (13, 1, 'bot')
2019-02-05 21:08:09 [WARNING ] (13, 1, 'bot')
2019-02-05 21:08:09 [WARNING ] (13, 1, 'bot')
2019-02-05 21:08:09 [WARNING ] (13, 1, 'bot')
2019-02-05 21:08:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:08:09 [DEBUG   ] Finished updating board flags in 1.212 seconds
2019-02-05 21:08:21 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-05 21:08:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 21:09:01 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 21:09:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:09:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 21:09:09 [WARNING ] (13, 1, 'bot')
2019-02-05 21:09:09 [WARNING ] (13, 1, 'bot')
2019-02-05 21:09:09 [WARNING ] (13, 1, 'bot')
2019-02-05 21:09:09 [WARNING ] (13, 1, 'bot')
2019-02-05 21:09:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:09:09 [DEBUG   ] Finished updating board flags in 1.213 seconds
2019-02-05 21:09:21 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-05 21:09:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 21:09:57 [DEBUG   ] Got command RPT from MCS: ref #1413282
2019-02-05 21:09:57 [DEBUG   ] summary = ERROR
2019-02-05 21:09:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413282  13 58519 76197481 A  ERRORERROR'
2019-02-05 21:09:57 [DEBUG   ] Got command RPT from MCS: ref #1413283
2019-02-05 21:09:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 21:09:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413283  77 58519 76197685 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 21:09:57 [DEBUG   ] Got command RPT from MCS: ref #1413284
2019-02-05 21:09:57 [DEBUG   ] summary = ERROR
2019-02-05 21:09:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413284  13 58519 76197889 A  ERRORERROR'
2019-02-05 21:09:58 [DEBUG   ] Got command RPT from MCS: ref #1413285
2019-02-05 21:09:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 21:09:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413285  77 58519 76198081 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 21:09:58 [DEBUG   ] Got command RPT from MCS: ref #1413286
2019-02-05 21:09:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 21:09:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413286  12 58519 76198285 A  ERRORB™™š'
2019-02-05 21:10:01 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-05 21:10:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 21:10:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:10:09 [WARNING ] (13, 1, 'bot')
2019-02-05 21:10:09 [WARNING ] (13, 1, 'bot')
2019-02-05 21:10:09 [WARNING ] (13, 1, 'bot')
2019-02-05 21:10:09 [WARNING ] (13, 1, 'bot')
2019-02-05 21:10:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:10:09 [DEBUG   ] Finished updating board flags in 1.170 seconds
2019-02-05 21:10:21 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-05 21:10:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 21:11:01 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-05 21:11:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:11:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 21:11:09 [WARNING ] (13, 1, 'bot')
2019-02-05 21:11:09 [WARNING ] (13, 1, 'bot')
2019-02-05 21:11:09 [WARNING ] (13, 1, 'bot')
2019-02-05 21:11:09 [WARNING ] (13, 1, 'bot')
2019-02-05 21:11:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:11:09 [DEBUG   ] Finished updating board flags in 1.025 seconds
2019-02-05 21:11:12 [DEBUG   ] Got command RPT from MCS: ref #1413287
2019-02-05 21:11:12 [DEBUG   ] summary = ERROR
2019-02-05 21:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413287  13 58519 76272037 A  ERRORERROR'
2019-02-05 21:11:12 [DEBUG   ] Got command RPT from MCS: ref #1413288
2019-02-05 21:11:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 21:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413288  77 58519 76272038 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 21:11:21 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 21:11:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 21:12:01 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-05 21:12:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 21:12:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:12:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 21:12:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:12:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:12:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:12:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:12:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:12:10 [DEBUG   ] Finished updating board flags in 1.547 seconds
2019-02-05 21:12:21 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-05 21:12:41 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 21:13:01 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-02-05 21:13:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:13:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 21:13:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:13:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:13:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:13:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:13:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:13:10 [DEBUG   ] Finished updating board flags in 1.390 seconds
2019-02-05 21:13:21 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-02-05 21:13:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 21:14:02 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 21:14:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:14:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:14:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:14:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:14:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:14:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:14:10 [DEBUG   ] Finished updating board flags in 1.214 seconds
2019-02-05 21:14:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 21:14:42 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 21:14:57 [DEBUG   ] Got command RPT from MCS: ref #1413314
2019-02-05 21:14:57 [DEBUG   ] summary = ERROR
2019-02-05 21:14:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413314  13 58519 76497557 A  ERRORERROR'
2019-02-05 21:14:57 [DEBUG   ] Got command RPT from MCS: ref #1413315
2019-02-05 21:14:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 21:14:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413315  77 58519 76497761 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 21:14:57 [DEBUG   ] Got command RPT from MCS: ref #1413316
2019-02-05 21:14:57 [DEBUG   ] summary = ERROR
2019-02-05 21:14:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413316  13 58519 76497965 A  ERRORERROR'
2019-02-05 21:14:58 [DEBUG   ] Got command RPT from MCS: ref #1413318
2019-02-05 21:14:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 21:14:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413318  77 58519 76498169 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 21:14:58 [DEBUG   ] Got command RPT from MCS: ref #1413319
2019-02-05 21:14:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 21:14:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413319  12 58519 76498361 A  ERRORB™™š'
2019-02-05 21:15:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 21:15:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 21:15:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:15:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 21:15:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:15:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:15:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:15:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:15:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:15:10 [DEBUG   ] Finished updating board flags in 1.183 seconds
2019-02-05 21:15:22 [DEBUG   ] Finished updating ant stats in 1.191 seconds
2019-02-05 21:15:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 21:16:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 21:16:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:16:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 21:16:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:16:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:16:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:16:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:16:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:16:10 [DEBUG   ] Finished updating board flags in 1.014 seconds
2019-02-05 21:16:12 [DEBUG   ] Got command RPT from MCS: ref #1413324
2019-02-05 21:16:12 [DEBUG   ] summary = ERROR
2019-02-05 21:16:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413324  13 58519 76572041 A  ERRORERROR'
2019-02-05 21:16:12 [DEBUG   ] Got command RPT from MCS: ref #1413325
2019-02-05 21:16:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 21:16:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413325  77 58519 76572042 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 21:16:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 21:16:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 21:17:03 [DEBUG   ] Finished updating ant stats in 2.000 seconds
2019-02-05 21:17:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:17:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:17:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:17:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:17:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:17:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:17:10 [DEBUG   ] Finished updating board flags in 1.000 seconds
2019-02-05 21:17:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 21:17:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 21:18:02 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-05 21:18:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 21:18:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:18:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 21:18:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-02-05 21:18:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:18:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:18:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:18:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:18:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:18:10 [DEBUG   ] Finished updating board flags in 1.025 seconds
2019-02-05 21:18:22 [DEBUG   ] Finished updating ant stats in 0.787 seconds
2019-02-05 21:18:42 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-05 21:19:02 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2019-02-05 21:19:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:19:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-02-05 21:19:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-02-05 21:19:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:19:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:19:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:19:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:19:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:19:10 [DEBUG   ] Finished updating board flags in 1.459 seconds
2019-02-05 21:19:22 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-02-05 21:19:43 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 21:19:57 [DEBUG   ] Got command RPT from MCS: ref #1413345
2019-02-05 21:19:57 [DEBUG   ] summary = ERROR
2019-02-05 21:19:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413345  13 58519 76797650 A  ERRORERROR'
2019-02-05 21:19:57 [DEBUG   ] Got command RPT from MCS: ref #1413346
2019-02-05 21:19:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 21:19:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413346  77 58519 76797841 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 21:19:58 [DEBUG   ] Got command RPT from MCS: ref #1413347
2019-02-05 21:19:58 [DEBUG   ] summary = ERROR
2019-02-05 21:19:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413347  13 58519 76798045 A  ERRORERROR'
2019-02-05 21:19:58 [DEBUG   ] Got command RPT from MCS: ref #1413348
2019-02-05 21:19:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 21:19:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413348  77 58519 76798250 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 21:19:58 [DEBUG   ] Got command RPT from MCS: ref #1413349
2019-02-05 21:19:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 21:19:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413349  12 58519 76798453 A  ERRORBš™š'
2019-02-05 21:20:03 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 21:20:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-02-05 21:20:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:20:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:20:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:20:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:20:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:20:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:20:10 [DEBUG   ] Finished updating board flags in 1.362 seconds
2019-02-05 21:20:23 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-02-05 21:20:43 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 21:21:03 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 21:21:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-02-05 21:21:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:21:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:21:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:21:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:21:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:21:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:21:10 [DEBUG   ] Finished updating board flags in 1.232 seconds
2019-02-05 21:21:12 [DEBUG   ] Got command RPT from MCS: ref #1413354
2019-02-05 21:21:12 [DEBUG   ] summary = ERROR
2019-02-05 21:21:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413354  13 58519 76872041 A  ERRORERROR'
2019-02-05 21:21:12 [DEBUG   ] Got command RPT from MCS: ref #1413355
2019-02-05 21:21:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 21:21:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413355  77 58519 76872042 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 21:21:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 21:21:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 21:22:03 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 21:22:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:22:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-02-05 21:22:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:22:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:22:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:22:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:22:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:22:10 [DEBUG   ] Finished updating board flags in 1.169 seconds
2019-02-05 21:22:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 21:22:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 21:23:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 21:23:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:23:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:23:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:23:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:23:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:23:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:23:10 [DEBUG   ] Finished updating board flags in 1.036 seconds
2019-02-05 21:23:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 21:23:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 21:24:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 21:24:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:24:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-02-05 21:24:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:24:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:24:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:24:10 [WARNING ] (13, 1, 'bot')
2019-02-05 21:24:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:24:10 [DEBUG   ] Finished updating board flags in 0.966 seconds
2019-02-05 21:24:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 21:24:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 21:24:57 [DEBUG   ] Got command RPT from MCS: ref #1413377
2019-02-05 21:24:57 [DEBUG   ] summary = ERROR
2019-02-05 21:24:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413377  13 58519 77097725 A  ERRORERROR'
2019-02-05 21:24:57 [DEBUG   ] Got command RPT from MCS: ref #1413378
2019-02-05 21:24:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 21:24:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413378  77 58519 77097929 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 21:24:58 [DEBUG   ] Got command RPT from MCS: ref #1413379
2019-02-05 21:24:58 [DEBUG   ] summary = ERROR
2019-02-05 21:24:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413379  13 58519 77098121 A  ERRORERROR'
2019-02-05 21:24:58 [DEBUG   ] Got command RPT from MCS: ref #1413381
2019-02-05 21:24:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 21:24:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413381  77 58519 77098325 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 21:24:58 [DEBUG   ] Got command RPT from MCS: ref #1413382
2019-02-05 21:24:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 21:24:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413382  12 58519 77098529 A  ERRORBš™š'
2019-02-05 21:25:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 21:25:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:25:11 [WARNING ] (13, 1, 'bot')
2019-02-05 21:25:11 [WARNING ] (13, 1, 'bot')
2019-02-05 21:25:11 [WARNING ] (13, 1, 'bot')
2019-02-05 21:25:11 [WARNING ] (13, 1, 'bot')
2019-02-05 21:25:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:25:11 [DEBUG   ] Finished updating board flags in 1.430 seconds
2019-02-05 21:25:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 21:25:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 21:26:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 21:26:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:26:11 [WARNING ] (13, 1, 'bot')
2019-02-05 21:26:11 [WARNING ] (13, 1, 'bot')
2019-02-05 21:26:11 [WARNING ] (13, 1, 'bot')
2019-02-05 21:26:11 [WARNING ] (13, 1, 'bot')
2019-02-05 21:26:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:26:11 [DEBUG   ] Finished updating board flags in 1.349 seconds
2019-02-05 21:26:12 [DEBUG   ] Got command RPT from MCS: ref #1413387
2019-02-05 21:26:12 [DEBUG   ] summary = ERROR
2019-02-05 21:26:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413387  13 58519 77172037 A  ERRORERROR'
2019-02-05 21:26:12 [DEBUG   ] Got command RPT from MCS: ref #1413388
2019-02-05 21:26:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 21:26:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413388  77 58519 77172038 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 21:26:23 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-05 21:26:43 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 21:27:03 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-05 21:27:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:27:11 [WARNING ] (13, 1, 'bot')
2019-02-05 21:27:11 [WARNING ] (13, 1, 'bot')
2019-02-05 21:27:11 [WARNING ] (13, 1, 'bot')
2019-02-05 21:27:11 [WARNING ] (13, 1, 'bot')
2019-02-05 21:27:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:27:11 [DEBUG   ] Finished updating board flags in 1.186 seconds
2019-02-05 21:27:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 21:27:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 21:28:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 21:28:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:28:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 21:28:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 21:28:11 [WARNING ] (13, 1, 'bot')
2019-02-05 21:28:11 [WARNING ] (13, 1, 'bot')
2019-02-05 21:28:11 [WARNING ] (13, 1, 'bot')
2019-02-05 21:28:11 [WARNING ] (13, 1, 'bot')
2019-02-05 21:28:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:28:11 [DEBUG   ] Finished updating board flags in 1.010 seconds
2019-02-05 21:28:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 21:28:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 21:29:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 21:29:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 21:29:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:29:11 [WARNING ] (13, 1, 'bot')
2019-02-05 21:29:11 [WARNING ] (13, 1, 'bot')
2019-02-05 21:29:11 [WARNING ] (13, 1, 'bot')
2019-02-05 21:29:11 [WARNING ] (13, 1, 'bot')
2019-02-05 21:29:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:29:11 [DEBUG   ] Finished updating board flags in 1.008 seconds
2019-02-05 21:29:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 21:29:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 21:29:57 [DEBUG   ] Got command RPT from MCS: ref #1413412
2019-02-05 21:29:57 [DEBUG   ] summary = ERROR
2019-02-05 21:29:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413412  13 58519 77397809 A  ERRORERROR'
2019-02-05 21:29:58 [DEBUG   ] Got command RPT from MCS: ref #1413413
2019-02-05 21:29:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 21:29:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413413  77 58519 77398001 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 21:29:58 [DEBUG   ] Got command RPT from MCS: ref #1413414
2019-02-05 21:29:58 [DEBUG   ] summary = ERROR
2019-02-05 21:29:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413414  13 58519 77398205 A  ERRORERROR'
2019-02-05 21:29:58 [DEBUG   ] Got command RPT from MCS: ref #1413415
2019-02-05 21:29:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 21:29:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413415  77 58519 77398409 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 21:29:58 [DEBUG   ] Got command RPT from MCS: ref #1413416
2019-02-05 21:29:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 21:29:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413416  12 58519 77398613 A  ERRORB™™š'
2019-02-05 21:30:03 [DEBUG   ] Finished updating ant stats in 0.591 seconds
2019-02-05 21:30:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:30:11 [WARNING ] (13, 1, 'bot')
2019-02-05 21:30:11 [WARNING ] (13, 1, 'bot')
2019-02-05 21:30:11 [WARNING ] (13, 1, 'bot')
2019-02-05 21:30:11 [WARNING ] (13, 1, 'bot')
2019-02-05 21:30:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:30:11 [DEBUG   ] Finished updating board flags in 0.984 seconds
2019-02-05 21:30:23 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-02-05 21:30:43 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 21:31:03 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 21:31:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:31:12 [DEBUG   ] Got command RPT from MCS: ref #1413417
2019-02-05 21:31:12 [DEBUG   ] summary = ERROR
2019-02-05 21:31:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413417  13 58519 77472046 A  ERRORERROR'
2019-02-05 21:31:12 [DEBUG   ] Got command RPT from MCS: ref #1413418
2019-02-05 21:31:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 21:31:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413418  77 58519 77472046 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 21:31:12 [WARNING ] (13, 1, 'bot')
2019-02-05 21:31:12 [WARNING ] (13, 1, 'bot')
2019-02-05 21:31:12 [WARNING ] (13, 1, 'bot')
2019-02-05 21:31:12 [WARNING ] (13, 1, 'bot')
2019-02-05 21:31:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:31:12 [DEBUG   ] Finished updating board flags in 1.817 seconds
2019-02-05 21:31:23 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-02-05 21:31:43 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 21:32:03 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-02-05 21:32:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:32:11 [WARNING ] (13, 1, 'bot')
2019-02-05 21:32:11 [WARNING ] (13, 1, 'bot')
2019-02-05 21:32:11 [WARNING ] (13, 1, 'bot')
2019-02-05 21:32:11 [WARNING ] (13, 1, 'bot')
2019-02-05 21:32:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:32:11 [DEBUG   ] Finished updating board flags in 1.265 seconds
2019-02-05 21:32:23 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-02-05 21:32:44 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 21:33:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 21:33:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 21:33:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:33:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 21:33:11 [WARNING ] (13, 1, 'bot')
2019-02-05 21:33:11 [WARNING ] (13, 1, 'bot')
2019-02-05 21:33:11 [WARNING ] (13, 1, 'bot')
2019-02-05 21:33:11 [WARNING ] (13, 1, 'bot')
2019-02-05 21:33:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:33:11 [DEBUG   ] Finished updating board flags in 1.234 seconds
2019-02-05 21:33:24 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 21:33:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 21:34:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 21:34:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:34:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 21:34:11 [WARNING ] (13, 1, 'bot')
2019-02-05 21:34:11 [WARNING ] (13, 1, 'bot')
2019-02-05 21:34:11 [WARNING ] (13, 1, 'bot')
2019-02-05 21:34:11 [WARNING ] (13, 1, 'bot')
2019-02-05 21:34:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:34:11 [DEBUG   ] Finished updating board flags in 1.157 seconds
2019-02-05 21:34:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 21:34:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 21:34:57 [DEBUG   ] Got command RPT from MCS: ref #1413440
2019-02-05 21:34:57 [DEBUG   ] summary = ERROR
2019-02-05 21:34:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413440  13 58519 77697889 A  ERRORERROR'
2019-02-05 21:34:58 [DEBUG   ] Got command RPT from MCS: ref #1413441
2019-02-05 21:34:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 21:34:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413441  77 58519 77698081 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 21:34:58 [DEBUG   ] Got command RPT from MCS: ref #1413442
2019-02-05 21:34:58 [DEBUG   ] summary = ERROR
2019-02-05 21:34:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413442  13 58519 77698285 A  ERRORERROR'
2019-02-05 21:34:58 [DEBUG   ] Got command RPT from MCS: ref #1413444
2019-02-05 21:34:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 21:34:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413444  77 58519 77698489 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 21:34:58 [DEBUG   ] Got command RPT from MCS: ref #1413446
2019-02-05 21:34:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 21:34:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413446  12 58519 77698693 A  ERRORB™™š'
2019-02-05 21:35:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 21:35:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:35:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-02-05 21:35:11 [WARNING ] (13, 1, 'bot')
2019-02-05 21:35:11 [WARNING ] (13, 1, 'bot')
2019-02-05 21:35:11 [WARNING ] (13, 1, 'bot')
2019-02-05 21:35:11 [WARNING ] (13, 1, 'bot')
2019-02-05 21:35:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:35:11 [DEBUG   ] Finished updating board flags in 1.050 seconds
2019-02-05 21:35:24 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 21:35:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 21:36:04 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 21:36:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:36:11 [WARNING ] (13, 1, 'bot')
2019-02-05 21:36:11 [WARNING ] (13, 1, 'bot')
2019-02-05 21:36:11 [WARNING ] (13, 1, 'bot')
2019-02-05 21:36:11 [WARNING ] (13, 1, 'bot')
2019-02-05 21:36:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:36:11 [DEBUG   ] Finished updating board flags in 0.933 seconds
2019-02-05 21:36:12 [DEBUG   ] Got command RPT from MCS: ref #1413454
2019-02-05 21:36:12 [DEBUG   ] summary = ERROR
2019-02-05 21:36:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413454  13 58519 77772041 A  ERRORERROR'
2019-02-05 21:36:12 [DEBUG   ] Got command RPT from MCS: ref #1413455
2019-02-05 21:36:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 21:36:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413455  77 58519 77772042 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 21:36:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 21:36:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 21:37:04 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 21:37:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:37:12 [WARNING ] (13, 1, 'bot')
2019-02-05 21:37:12 [WARNING ] (13, 1, 'bot')
2019-02-05 21:37:12 [WARNING ] (13, 1, 'bot')
2019-02-05 21:37:12 [WARNING ] (13, 1, 'bot')
2019-02-05 21:37:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:37:12 [DEBUG   ] Finished updating board flags in 1.363 seconds
2019-02-05 21:37:24 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 21:37:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 21:38:01 [DEBUG   ] Got command TBN from MCS: ref #1413471
2019-02-05 21:38:01 [DEBUG   ] spawn_process: at 2019-02-05 21:38:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1549402682']
2019-02-05 21:38:01 [DEBUG   ] spawn_process: at 2019-02-05 21:38:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1549402682']
2019-02-05 21:38:01 [DEBUG   ] tbn = exited with status True, code 0x00
2019-02-05 21:38:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN  1413471   8 58519 77881014 A  ERROR'
2019-02-05 21:38:01 [DEBUG   ] spawn_process: at 2019-02-05 21:38:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1549402682']
2019-02-05 21:38:01 [DEBUG   ] spawn_process: at 2019-02-05 21:38:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1549402682']
2019-02-05 21:38:01 [DEBUG   ] spawn_process: at 2019-02-05 21:38:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1549402682']
2019-02-05 21:38:01 [DEBUG   ] spawn_process: at 2019-02-05 21:38:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1549402682']
2019-02-05 21:38:01 [DEBUG   ] spawn_process: at 2019-02-05 21:38:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1549402682']
2019-02-05 21:38:01 [DEBUG   ] spawn_process: at 2019-02-05 21:38:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1549402682']
2019-02-05 21:38:01 [DEBUG   ] spawn_process: at 2019-02-05 21:38:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1549402682']
2019-02-05 21:38:01 [DEBUG   ] spawn_process: at 2019-02-05 21:38:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1549402682']
2019-02-05 21:38:01 [DEBUG   ] spawn_process: at 2019-02-05 21:38:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1549402682']
2019-02-05 21:38:01 [DEBUG   ] spawn_process: at 2019-02-05 21:38:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1549402682']
2019-02-05 21:38:01 [DEBUG   ] spawn_process: at 2019-02-05 21:38:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1549402682']
2019-02-05 21:38:01 [DEBUG   ] spawn_process: at 2019-02-05 21:38:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1549402682']
2019-02-05 21:38:01 [DEBUG   ] spawn_process: at 2019-02-05 21:38:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1549402682']
2019-02-05 21:38:01 [DEBUG   ] spawn_process: at 2019-02-05 21:38:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1549402682']
2019-02-05 21:38:01 [DEBUG   ] spawn_process: at 2019-02-05 21:38:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1549402682']
2019-02-05 21:38:01 [DEBUG   ] spawn_process: at 2019-02-05 21:38:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1549402682']
2019-02-05 21:38:01 [DEBUG   ] spawn_process: at 2019-02-05 21:38:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1549402682']
2019-02-05 21:38:01 [DEBUG   ] spawn_process: at 2019-02-05 21:38:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1549402682']
2019-02-05 21:38:01 [DEBUG   ] spawn_process: at 2019-02-05 21:38:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1549402682']
2019-02-05 21:38:01 [DEBUG   ] spawn_process: at 2019-02-05 21:38:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1549402682']
2019-02-05 21:38:01 [DEBUG   ] spawn_process: at 2019-02-05 21:38:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1549402682']
2019-02-05 21:38:01 [DEBUG   ] spawn_process: at 2019-02-05 21:38:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1549402682']
2019-02-05 21:38:01 [DEBUG   ] spawn_process: at 2019-02-05 21:38:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1549402682']
2019-02-05 21:38:01 [DEBUG   ] spawn_process: at 2019-02-05 21:38:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1549402682']
2019-02-05 21:38:01 [INFO    ] Finished spawning TBN in 0.051 s
2019-02-05 21:38:04 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-02-05 21:38:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 21:38:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:38:12 [WARNING ] (13, 1, 'bot')
2019-02-05 21:38:12 [WARNING ] (13, 1, 'bot')
2019-02-05 21:38:12 [WARNING ] (13, 1, 'bot')
2019-02-05 21:38:12 [WARNING ] (13, 1, 'bot')
2019-02-05 21:38:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:38:12 [DEBUG   ] Finished updating board flags in 1.490 seconds
2019-02-05 21:38:24 [DEBUG   ] Finished updating ant stats in 1.267 seconds
2019-02-05 21:38:44 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-05 21:39:04 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-05 21:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:39:12 [WARNING ] (13, 1, 'bot')
2019-02-05 21:39:12 [WARNING ] (13, 1, 'bot')
2019-02-05 21:39:12 [WARNING ] (13, 1, 'bot')
2019-02-05 21:39:12 [WARNING ] (13, 1, 'bot')
2019-02-05 21:39:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:39:12 [DEBUG   ] Finished updating board flags in 1.497 seconds
2019-02-05 21:39:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 21:39:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 21:39:57 [DEBUG   ] Got command RPT from MCS: ref #1413476
2019-02-05 21:39:57 [DEBUG   ] summary = ERROR
2019-02-05 21:39:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413476  13 58519 77997965 A  ERRORERROR'
2019-02-05 21:39:58 [DEBUG   ] Got command RPT from MCS: ref #1413477
2019-02-05 21:39:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 21:39:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413477  77 58519 77998169 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 21:39:58 [DEBUG   ] Got command RPT from MCS: ref #1413478
2019-02-05 21:39:58 [DEBUG   ] summary = ERROR
2019-02-05 21:39:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413478  13 58519 77998373 A  ERRORERROR'
2019-02-05 21:39:58 [DEBUG   ] Got command RPT from MCS: ref #1413479
2019-02-05 21:39:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 21:39:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413479  77 58519 77998565 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 21:39:58 [DEBUG   ] Got command RPT from MCS: ref #1413480
2019-02-05 21:39:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 21:39:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413480  12 58519 77998769 A  ERRORB˜™š'
2019-02-05 21:40:04 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-02-05 21:40:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:40:12 [WARNING ] (13, 1, 'bot')
2019-02-05 21:40:12 [WARNING ] (13, 1, 'bot')
2019-02-05 21:40:12 [WARNING ] (13, 1, 'bot')
2019-02-05 21:40:12 [WARNING ] (13, 1, 'bot')
2019-02-05 21:40:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:40:12 [DEBUG   ] Finished updating board flags in 1.493 seconds
2019-02-05 21:40:24 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-02-05 21:40:44 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2019-02-05 21:41:04 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-02-05 21:41:12 [DEBUG   ] Got command RPT from MCS: ref #1413481
2019-02-05 21:41:12 [DEBUG   ] summary = ERROR
2019-02-05 21:41:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413481  13 58519 78072045 A  ERRORERROR'
2019-02-05 21:41:12 [DEBUG   ] Got command RPT from MCS: ref #1413482
2019-02-05 21:41:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 21:41:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413482  77 58519 78072046 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 21:41:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:41:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 21:41:13 [WARNING ] (13, 1, 'bot')
2019-02-05 21:41:13 [WARNING ] (13, 1, 'bot')
2019-02-05 21:41:13 [WARNING ] (13, 1, 'bot')
2019-02-05 21:41:13 [WARNING ] (13, 1, 'bot')
2019-02-05 21:41:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:41:13 [DEBUG   ] Finished updating board flags in 2.160 seconds
2019-02-05 21:41:24 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-02-05 21:41:44 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-05 21:42:05 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-02-05 21:42:12 [DEBUG   ] Got command TBW from MCS: ref #1413503
2019-02-05 21:42:12 [DEBUG   ] tbw = exited with status True, code 0x00
2019-02-05 21:42:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW  1413503   8 58519 78132081 A  ERROR'
2019-02-05 21:42:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:42:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 21:42:13 [WARNING ] (13, 1, 'bot')
2019-02-05 21:42:13 [WARNING ] (13, 1, 'bot')
2019-02-05 21:42:13 [WARNING ] (13, 1, 'bot')
2019-02-05 21:42:13 [WARNING ] (13, 1, 'bot')
2019-02-05 21:42:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:42:13 [DEBUG   ] Finished updating board flags in 1.987 seconds
2019-02-05 21:42:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2019-02-05 21:42:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2019-02-05 21:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2019-02-05 21:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2019-02-05 21:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2019-02-05 21:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2019-02-05 21:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2019-02-05 21:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2019-02-05 21:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2019-02-05 21:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2019-02-05 21:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2019-02-05 21:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2019-02-05 21:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2019-02-05 21:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2019-02-05 21:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2019-02-05 21:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2019-02-05 21:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2019-02-05 21:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2019-02-05 21:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2019-02-05 21:42:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2019-02-05 21:42:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2019-02-05 21:42:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2019-02-05 21:42:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2019-02-05 21:42:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2019-02-05 21:42:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2019-02-05 21:42:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2019-02-05 21:42:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2019-02-05 21:42:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2019-02-05 21:42:15 [DEBUG   ] spawn_process: at 2019-02-05 21:42:15 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2019-02-05 21:42:15 [DEBUG   ] spawn_process: at 2019-02-05 21:42:15 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2019-02-05 21:42:15 [DEBUG   ] spawn_process: at 2019-02-05 21:42:15 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2019-02-05 21:42:15 [DEBUG   ] spawn_process: at 2019-02-05 21:42:15 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2019-02-05 21:42:15 [DEBUG   ] spawn_process: at 2019-02-05 21:42:15 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2019-02-05 21:42:15 [DEBUG   ] spawn_process: at 2019-02-05 21:42:15 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2019-02-05 21:42:15 [DEBUG   ] spawn_process: at 2019-02-05 21:42:15 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2019-02-05 21:42:15 [DEBUG   ] spawn_process: at 2019-02-05 21:42:15 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2019-02-05 21:42:15 [DEBUG   ] spawn_process: at 2019-02-05 21:42:15 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2019-02-05 21:42:15 [DEBUG   ] spawn_process: at 2019-02-05 21:42:15 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2019-02-05 21:42:15 [DEBUG   ] spawn_process: at 2019-02-05 21:42:15 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2019-02-05 21:42:15 [DEBUG   ] spawn_process: at 2019-02-05 21:42:15 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2019-02-05 21:42:15 [DEBUG   ] spawn_process: at 2019-02-05 21:42:15 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2019-02-05 21:42:15 [DEBUG   ] spawn_process: at 2019-02-05 21:42:15 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2019-02-05 21:42:15 [DEBUG   ] spawn_process: at 2019-02-05 21:42:15 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2019-02-05 21:42:15 [DEBUG   ] spawn_process: at 2019-02-05 21:42:15 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2019-02-05 21:42:15 [DEBUG   ] spawn_process: at 2019-02-05 21:42:15 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2019-02-05 21:42:15 [DEBUG   ] spawn_process: at 2019-02-05 21:42:15 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2019-02-05 21:42:15 [DEBUG   ] spawn_process: at 2019-02-05 21:42:15 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2019-02-05 21:42:15 [DEBUG   ] spawn_process: at 2019-02-05 21:42:15 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2019-02-05 21:42:15 [DEBUG   ] spawn_process: at 2019-02-05 21:42:15 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2019-02-05 21:42:15 [DEBUG   ] spawn_process: at 2019-02-05 21:42:15 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2019-02-05 21:42:15 [DEBUG   ] spawn_process: at 2019-02-05 21:42:15 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2019-02-05 21:42:15 [DEBUG   ] spawn_process: at 2019-02-05 21:42:15 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2019-02-05 21:42:15 [DEBUG   ] spawn_process: at 2019-02-05 21:42:15 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2019-02-05 21:42:15 [DEBUG   ] spawn_process: at 2019-02-05 21:42:15 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2019-02-05 21:42:15 [INFO    ] Finished spawning TBW
2019-02-05 21:43:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:43:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 21:43:13 [WARNING ] (13, 1, 'bot')
2019-02-05 21:43:13 [WARNING ] (13, 1, 'bot')
2019-02-05 21:43:13 [WARNING ] (13, 1, 'bot')
2019-02-05 21:43:13 [WARNING ] (13, 1, 'bot')
2019-02-05 21:43:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:43:13 [DEBUG   ] Finished updating board flags in 1.749 seconds
2019-02-05 21:44:03 [INFO    ] __waitForTBW - TBW finished in 108.175 s
2019-02-05 21:44:04 [DEBUG   ] Finished updating ant stats in 0.443 seconds
2019-02-05 21:44:04 [INFO    ] Started antennas statistics background thread
2019-02-05 21:44:04 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2019-02-05 21:44:04 [DEBUG   ] spawn_process: at 2019-02-05 21:44:04 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1549403046']
2019-02-05 21:44:04 [DEBUG   ] spawn_process: at 2019-02-05 21:44:04 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1549403046']
2019-02-05 21:44:04 [DEBUG   ] spawn_process: at 2019-02-05 21:44:04 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1549403046']
2019-02-05 21:44:04 [DEBUG   ] spawn_process: at 2019-02-05 21:44:04 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1549403046']
2019-02-05 21:44:04 [DEBUG   ] spawn_process: at 2019-02-05 21:44:04 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1549403046']
2019-02-05 21:44:04 [DEBUG   ] spawn_process: at 2019-02-05 21:44:04 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1549403046']
2019-02-05 21:44:04 [DEBUG   ] spawn_process: at 2019-02-05 21:44:04 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1549403046']
2019-02-05 21:44:04 [DEBUG   ] spawn_process: at 2019-02-05 21:44:04 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1549403046']
2019-02-05 21:44:04 [DEBUG   ] spawn_process: at 2019-02-05 21:44:04 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1549403046']
2019-02-05 21:44:04 [DEBUG   ] spawn_process: at 2019-02-05 21:44:04 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1549403046']
2019-02-05 21:44:04 [DEBUG   ] spawn_process: at 2019-02-05 21:44:04 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1549403046']
2019-02-05 21:44:04 [DEBUG   ] spawn_process: at 2019-02-05 21:44:04 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1549403046']
2019-02-05 21:44:04 [DEBUG   ] spawn_process: at 2019-02-05 21:44:04 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1549403046']
2019-02-05 21:44:04 [DEBUG   ] spawn_process: at 2019-02-05 21:44:04 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1549403046']
2019-02-05 21:44:04 [DEBUG   ] spawn_process: at 2019-02-05 21:44:04 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1549403046']
2019-02-05 21:44:04 [DEBUG   ] spawn_process: at 2019-02-05 21:44:04 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1549403046']
2019-02-05 21:44:04 [DEBUG   ] spawn_process: at 2019-02-05 21:44:04 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1549403046']
2019-02-05 21:44:04 [DEBUG   ] spawn_process: at 2019-02-05 21:44:04 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1549403046']
2019-02-05 21:44:04 [DEBUG   ] spawn_process: at 2019-02-05 21:44:04 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1549403046']
2019-02-05 21:44:04 [DEBUG   ] spawn_process: at 2019-02-05 21:44:04 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1549403046']
2019-02-05 21:44:04 [DEBUG   ] spawn_process: at 2019-02-05 21:44:04 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1549403046']
2019-02-05 21:44:04 [DEBUG   ] spawn_process: at 2019-02-05 21:44:04 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1549403046']
2019-02-05 21:44:04 [DEBUG   ] spawn_process: at 2019-02-05 21:44:04 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1549403046']
2019-02-05 21:44:04 [DEBUG   ] spawn_process: at 2019-02-05 21:44:04 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1549403046']
2019-02-05 21:44:04 [DEBUG   ] spawn_process: at 2019-02-05 21:44:04 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1549403046']
2019-02-05 21:44:04 [DEBUG   ] spawn_process: at 2019-02-05 21:44:04 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1549403046']
2019-02-05 21:44:04 [INFO    ] Finished spawning TBN in 0.048 s
2019-02-05 21:44:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:44:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 21:44:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 21:44:13 [WARNING ] (13, 1, 'bot')
2019-02-05 21:44:13 [WARNING ] (13, 1, 'bot')
2019-02-05 21:44:13 [WARNING ] (13, 1, 'bot')
2019-02-05 21:44:13 [WARNING ] (13, 1, 'bot')
2019-02-05 21:44:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:44:13 [DEBUG   ] Finished updating board flags in 1.776 seconds
2019-02-05 21:44:24 [DEBUG   ] Finished updating ant stats in 0.463 seconds
2019-02-05 21:44:44 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2019-02-05 21:44:58 [DEBUG   ] Got command RPT from MCS: ref #1413517
2019-02-05 21:44:58 [DEBUG   ] summary = ERROR
2019-02-05 21:44:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413517  13 58519 78298049 A  ERRORERROR'
2019-02-05 21:44:58 [DEBUG   ] Got command RPT from MCS: ref #1413518
2019-02-05 21:44:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 21:44:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413518  77 58519 78298253 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 21:44:58 [DEBUG   ] Got command RPT from MCS: ref #1413519
2019-02-05 21:44:58 [DEBUG   ] summary = ERROR
2019-02-05 21:44:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413519  13 58519 78298445 A  ERRORERROR'
2019-02-05 21:44:58 [DEBUG   ] Got command RPT from MCS: ref #1413521
2019-02-05 21:44:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 21:44:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413521  77 58519 78298649 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 21:44:58 [DEBUG   ] Got command RPT from MCS: ref #1413523
2019-02-05 21:44:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 21:44:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413523  12 58519 78298853 A  ERRORB˜™š'
2019-02-05 21:45:04 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-02-05 21:45:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:45:13 [WARNING ] (13, 1, 'bot')
2019-02-05 21:45:13 [WARNING ] (13, 1, 'bot')
2019-02-05 21:45:13 [WARNING ] (13, 1, 'bot')
2019-02-05 21:45:13 [WARNING ] (13, 1, 'bot')
2019-02-05 21:45:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:45:13 [DEBUG   ] Finished updating board flags in 1.465 seconds
2019-02-05 21:45:25 [DEBUG   ] Finished updating ant stats in 1.391 seconds
2019-02-05 21:45:45 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-02-05 21:46:05 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-02-05 21:46:12 [DEBUG   ] Got command RPT from MCS: ref #1413527
2019-02-05 21:46:12 [DEBUG   ] summary = ERROR
2019-02-05 21:46:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413527  13 58519 78372041 A  ERRORERROR'
2019-02-05 21:46:12 [DEBUG   ] Got command RPT from MCS: ref #1413528
2019-02-05 21:46:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 21:46:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413528  77 58519 78372042 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 21:46:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:46:13 [WARNING ] (13, 1, 'bot')
2019-02-05 21:46:13 [WARNING ] (13, 1, 'bot')
2019-02-05 21:46:13 [WARNING ] (13, 1, 'bot')
2019-02-05 21:46:13 [WARNING ] (13, 1, 'bot')
2019-02-05 21:46:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:46:13 [DEBUG   ] Finished updating board flags in 1.417 seconds
2019-02-05 21:46:25 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-02-05 21:46:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 21:47:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 21:47:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 21:47:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:47:13 [WARNING ] (13, 1, 'bot')
2019-02-05 21:47:13 [WARNING ] (13, 1, 'bot')
2019-02-05 21:47:13 [WARNING ] (13, 1, 'bot')
2019-02-05 21:47:13 [WARNING ] (13, 1, 'bot')
2019-02-05 21:47:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:47:13 [DEBUG   ] Finished updating board flags in 1.388 seconds
2019-02-05 21:47:25 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-02-05 21:47:45 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-05 21:48:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 21:48:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:48:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 21:48:13 [WARNING ] (13, 1, 'bot')
2019-02-05 21:48:13 [WARNING ] (13, 1, 'bot')
2019-02-05 21:48:13 [WARNING ] (13, 1, 'bot')
2019-02-05 21:48:13 [WARNING ] (13, 1, 'bot')
2019-02-05 21:48:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:48:13 [DEBUG   ] Finished updating board flags in 1.358 seconds
2019-02-05 21:48:25 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-02-05 21:48:45 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-05 21:49:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-02-05 21:49:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:49:14 [WARNING ] (13, 1, 'bot')
2019-02-05 21:49:14 [WARNING ] (13, 1, 'bot')
2019-02-05 21:49:14 [WARNING ] (13, 1, 'bot')
2019-02-05 21:49:14 [WARNING ] (13, 1, 'bot')
2019-02-05 21:49:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:49:14 [DEBUG   ] Finished updating board flags in 2.073 seconds
2019-02-05 21:49:25 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-05 21:49:45 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 21:49:58 [DEBUG   ] Got command RPT from MCS: ref #1413548
2019-02-05 21:49:58 [DEBUG   ] summary = ERROR
2019-02-05 21:49:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413548  13 58519 78598129 A  ERRORERROR'
2019-02-05 21:49:58 [DEBUG   ] Got command RPT from MCS: ref #1413549
2019-02-05 21:49:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 21:49:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413549  77 58519 78598333 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 21:49:58 [DEBUG   ] Got command RPT from MCS: ref #1413550
2019-02-05 21:49:58 [DEBUG   ] summary = ERROR
2019-02-05 21:49:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413550  13 58519 78598525 A  ERRORERROR'
2019-02-05 21:49:58 [DEBUG   ] Got command RPT from MCS: ref #1413551
2019-02-05 21:49:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 21:49:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413551  77 58519 78598729 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 21:49:58 [DEBUG   ] Got command RPT from MCS: ref #1413552
2019-02-05 21:49:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 21:49:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413552  12 58519 78598933 A  ERRORB™™š'
2019-02-05 21:50:05 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2019-02-05 21:50:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:50:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-05 21:50:14 [WARNING ] (13, 1, 'bot')
2019-02-05 21:50:14 [WARNING ] (13, 1, 'bot')
2019-02-05 21:50:14 [WARNING ] (13, 1, 'bot')
2019-02-05 21:50:14 [WARNING ] (13, 1, 'bot')
2019-02-05 21:50:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:50:14 [DEBUG   ] Finished updating board flags in 1.976 seconds
2019-02-05 21:50:26 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-02-05 21:50:46 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2019-02-05 21:51:06 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-05 21:51:12 [DEBUG   ] Got command RPT from MCS: ref #1413557
2019-02-05 21:51:12 [DEBUG   ] summary = ERROR
2019-02-05 21:51:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413557  13 58519 78672041 A  ERRORERROR'
2019-02-05 21:51:12 [DEBUG   ] Got command RPT from MCS: ref #1413558
2019-02-05 21:51:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 21:51:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413558  77 58519 78672042 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 21:51:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 21:51:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:51:14 [WARNING ] (13, 1, 'bot')
2019-02-05 21:51:14 [WARNING ] (13, 1, 'bot')
2019-02-05 21:51:14 [WARNING ] (13, 1, 'bot')
2019-02-05 21:51:14 [WARNING ] (13, 1, 'bot')
2019-02-05 21:51:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:51:14 [DEBUG   ] Finished updating board flags in 1.812 seconds
2019-02-05 21:51:26 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-02-05 21:51:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 21:52:06 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 21:52:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:52:14 [WARNING ] (13, 1, 'bot')
2019-02-05 21:52:14 [WARNING ] (13, 1, 'bot')
2019-02-05 21:52:14 [WARNING ] (13, 1, 'bot')
2019-02-05 21:52:14 [WARNING ] (13, 1, 'bot')
2019-02-05 21:52:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:52:14 [DEBUG   ] Finished updating board flags in 1.810 seconds
2019-02-05 21:52:26 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-05 21:52:46 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-05 21:53:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 21:53:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:53:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 21:53:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-02-05 21:53:14 [WARNING ] (13, 1, 'bot')
2019-02-05 21:53:14 [WARNING ] (13, 1, 'bot')
2019-02-05 21:53:14 [WARNING ] (13, 1, 'bot')
2019-02-05 21:53:14 [WARNING ] (13, 1, 'bot')
2019-02-05 21:53:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:53:14 [DEBUG   ] Finished updating board flags in 1.776 seconds
2019-02-05 21:53:26 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-02-05 21:53:46 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-05 21:54:06 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-05 21:54:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 21:54:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:54:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 21:54:14 [WARNING ] (13, 1, 'bot')
2019-02-05 21:54:14 [WARNING ] (13, 1, 'bot')
2019-02-05 21:54:14 [WARNING ] (13, 1, 'bot')
2019-02-05 21:54:14 [WARNING ] (13, 1, 'bot')
2019-02-05 21:54:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:54:14 [DEBUG   ] Finished updating board flags in 1.621 seconds
2019-02-05 21:54:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 21:54:46 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-05 21:54:58 [DEBUG   ] Got command RPT from MCS: ref #1413580
2019-02-05 21:54:58 [DEBUG   ] summary = ERROR
2019-02-05 21:54:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413580  13 58519 78898205 A  ERRORERROR'
2019-02-05 21:54:58 [DEBUG   ] Got command RPT from MCS: ref #1413581
2019-02-05 21:54:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 21:54:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413581  77 58519 78898409 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 21:54:58 [DEBUG   ] Got command RPT from MCS: ref #1413582
2019-02-05 21:54:58 [DEBUG   ] summary = ERROR
2019-02-05 21:54:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413582  13 58519 78898613 A  ERRORERROR'
2019-02-05 21:54:58 [DEBUG   ] Got command RPT from MCS: ref #1413584
2019-02-05 21:54:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 21:54:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413584  77 58519 78898805 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 21:54:59 [DEBUG   ] Got command RPT from MCS: ref #1413586
2019-02-05 21:54:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 21:54:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413586  12 58519 78899009 A  ERRORBš™š'
2019-02-05 21:55:06 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-02-05 21:55:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:55:14 [WARNING ] (13, 1, 'bot')
2019-02-05 21:55:14 [WARNING ] (13, 1, 'bot')
2019-02-05 21:55:14 [WARNING ] (13, 1, 'bot')
2019-02-05 21:55:14 [WARNING ] (13, 1, 'bot')
2019-02-05 21:55:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:55:14 [DEBUG   ] Finished updating board flags in 1.590 seconds
2019-02-05 21:55:26 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-05 21:55:46 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 21:56:06 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2019-02-05 21:56:12 [DEBUG   ] Got command RPT from MCS: ref #1413590
2019-02-05 21:56:12 [DEBUG   ] summary = ERROR
2019-02-05 21:56:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413590  13 58519 78972045 A  ERRORERROR'
2019-02-05 21:56:12 [DEBUG   ] Got command RPT from MCS: ref #1413591
2019-02-05 21:56:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 21:56:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413591  77 58519 78972046 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 21:56:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:56:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 21:56:14 [WARNING ] (13, 1, 'bot')
2019-02-05 21:56:14 [WARNING ] (13, 1, 'bot')
2019-02-05 21:56:14 [WARNING ] (13, 1, 'bot')
2019-02-05 21:56:14 [WARNING ] (13, 1, 'bot')
2019-02-05 21:56:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:56:14 [DEBUG   ] Finished updating board flags in 1.417 seconds
2019-02-05 21:56:27 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-02-05 21:56:47 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-02-05 21:57:07 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-02-05 21:57:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:57:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 21:57:14 [WARNING ] (13, 1, 'bot')
2019-02-05 21:57:14 [WARNING ] (13, 1, 'bot')
2019-02-05 21:57:14 [WARNING ] (13, 1, 'bot')
2019-02-05 21:57:14 [WARNING ] (13, 1, 'bot')
2019-02-05 21:57:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:57:14 [DEBUG   ] Finished updating board flags in 1.382 seconds
2019-02-05 21:57:27 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-02-05 21:57:47 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-05 21:58:07 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-02-05 21:58:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:58:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 21:58:14 [WARNING ] (13, 1, 'bot')
2019-02-05 21:58:14 [WARNING ] (13, 1, 'bot')
2019-02-05 21:58:14 [WARNING ] (13, 1, 'bot')
2019-02-05 21:58:14 [WARNING ] (13, 1, 'bot')
2019-02-05 21:58:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:58:14 [DEBUG   ] Finished updating board flags in 1.384 seconds
2019-02-05 21:58:27 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-05 21:58:47 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-05 21:59:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 21:59:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 21:59:15 [WARNING ] (13, 1, 'bot')
2019-02-05 21:59:15 [WARNING ] (13, 1, 'bot')
2019-02-05 21:59:15 [WARNING ] (13, 1, 'bot')
2019-02-05 21:59:15 [WARNING ] (13, 1, 'bot')
2019-02-05 21:59:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 21:59:15 [DEBUG   ] Finished updating board flags in 2.033 seconds
2019-02-05 21:59:27 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 21:59:47 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-02-05 21:59:58 [DEBUG   ] Got command RPT from MCS: ref #1413626
2019-02-05 21:59:58 [DEBUG   ] summary = ERROR
2019-02-05 21:59:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413626  13 58519 79198293 A  ERRORERROR'
2019-02-05 21:59:58 [DEBUG   ] Got command RPT from MCS: ref #1413627
2019-02-05 21:59:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 21:59:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413627  77 58519 79198497 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 21:59:58 [DEBUG   ] Got command RPT from MCS: ref #1413628
2019-02-05 21:59:58 [DEBUG   ] summary = ERROR
2019-02-05 21:59:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413628  13 58519 79198689 A  ERRORERROR'
2019-02-05 21:59:58 [DEBUG   ] Got command RPT from MCS: ref #1413629
2019-02-05 21:59:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 21:59:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413629  77 58519 79198893 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 21:59:59 [DEBUG   ] Got command RPT from MCS: ref #1413630
2019-02-05 21:59:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 21:59:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413630  12 58519 79199097 A  ERRORB™™š'
2019-02-05 22:00:07 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-02-05 22:00:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:00:15 [WARNING ] (13, 1, 'bot')
2019-02-05 22:00:15 [WARNING ] (13, 1, 'bot')
2019-02-05 22:00:15 [WARNING ] (13, 1, 'bot')
2019-02-05 22:00:15 [WARNING ] (13, 1, 'bot')
2019-02-05 22:00:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:00:15 [DEBUG   ] Finished updating board flags in 1.996 seconds
2019-02-05 22:00:28 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-02-05 22:00:48 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-02-05 22:01:08 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-02-05 22:01:12 [DEBUG   ] Got command RPT from MCS: ref #1413631
2019-02-05 22:01:12 [DEBUG   ] summary = ERROR
2019-02-05 22:01:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413631  13 58519 79272045 A  ERRORERROR'
2019-02-05 22:01:12 [DEBUG   ] Got command RPT from MCS: ref #1413632
2019-02-05 22:01:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 22:01:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413632  77 58519 79272046 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 22:01:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 22:01:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:01:15 [WARNING ] (13, 1, 'bot')
2019-02-05 22:01:15 [WARNING ] (13, 1, 'bot')
2019-02-05 22:01:15 [WARNING ] (13, 1, 'bot')
2019-02-05 22:01:15 [WARNING ] (13, 1, 'bot')
2019-02-05 22:01:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:01:15 [DEBUG   ] Finished updating board flags in 1.800 seconds
2019-02-05 22:01:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 22:01:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 22:02:08 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-05 22:02:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:02:15 [WARNING ] (13, 1, 'bot')
2019-02-05 22:02:15 [WARNING ] (13, 1, 'bot')
2019-02-05 22:02:15 [WARNING ] (13, 1, 'bot')
2019-02-05 22:02:15 [WARNING ] (13, 1, 'bot')
2019-02-05 22:02:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:02:15 [DEBUG   ] Finished updating board flags in 1.793 seconds
2019-02-05 22:02:28 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-05 22:02:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 22:03:08 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-05 22:03:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:03:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 22:03:15 [WARNING ] (13, 1, 'bot')
2019-02-05 22:03:15 [WARNING ] (13, 1, 'bot')
2019-02-05 22:03:15 [WARNING ] (13, 1, 'bot')
2019-02-05 22:03:15 [WARNING ] (13, 1, 'bot')
2019-02-05 22:03:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:03:15 [DEBUG   ] Finished updating board flags in 1.618 seconds
2019-02-05 22:03:28 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-05 22:03:48 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-05 22:04:08 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 22:04:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 22:04:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:04:15 [WARNING ] (13, 1, 'bot')
2019-02-05 22:04:15 [WARNING ] (13, 1, 'bot')
2019-02-05 22:04:15 [WARNING ] (13, 1, 'bot')
2019-02-05 22:04:15 [WARNING ] (13, 1, 'bot')
2019-02-05 22:04:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:04:15 [DEBUG   ] Finished updating board flags in 1.601 seconds
2019-02-05 22:04:28 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-02-05 22:04:49 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-02-05 22:04:58 [DEBUG   ] Got command RPT from MCS: ref #1413654
2019-02-05 22:04:58 [DEBUG   ] summary = ERROR
2019-02-05 22:04:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413654  13 58519 79498369 A  ERRORERROR'
2019-02-05 22:04:58 [DEBUG   ] Got command RPT from MCS: ref #1413655
2019-02-05 22:04:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 22:04:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413655  77 58519 79498573 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 22:04:58 [DEBUG   ] Got command RPT from MCS: ref #1413656
2019-02-05 22:04:58 [DEBUG   ] summary = ERROR
2019-02-05 22:04:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413656  13 58519 79498765 A  ERRORERROR'
2019-02-05 22:04:58 [DEBUG   ] Got command RPT from MCS: ref #1413658
2019-02-05 22:04:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 22:04:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413658  77 58519 79498969 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 22:04:59 [DEBUG   ] Got command RPT from MCS: ref #1413659
2019-02-05 22:04:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 22:04:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413659  12 58519 79499173 A  ERRORB™™š'
2019-02-05 22:05:09 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-05 22:05:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:05:15 [WARNING ] (13, 1, 'bot')
2019-02-05 22:05:15 [WARNING ] (13, 1, 'bot')
2019-02-05 22:05:15 [WARNING ] (13, 1, 'bot')
2019-02-05 22:05:15 [WARNING ] (13, 1, 'bot')
2019-02-05 22:05:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:05:15 [DEBUG   ] Finished updating board flags in 1.591 seconds
2019-02-05 22:05:29 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-05 22:05:49 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-02-05 22:06:09 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-05 22:06:12 [DEBUG   ] Got command RPT from MCS: ref #1413668
2019-02-05 22:06:12 [DEBUG   ] summary = ERROR
2019-02-05 22:06:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413668  13 58519 79572053 A  ERRORERROR'
2019-02-05 22:06:12 [DEBUG   ] Got command RPT from MCS: ref #1413669
2019-02-05 22:06:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 22:06:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413669  77 58519 79572054 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 22:06:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:06:15 [WARNING ] (13, 1, 'bot')
2019-02-05 22:06:15 [WARNING ] (13, 1, 'bot')
2019-02-05 22:06:15 [WARNING ] (13, 1, 'bot')
2019-02-05 22:06:15 [WARNING ] (13, 1, 'bot')
2019-02-05 22:06:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:06:15 [DEBUG   ] Finished updating board flags in 1.397 seconds
2019-02-05 22:06:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 22:06:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 22:07:09 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-02-05 22:07:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:07:15 [WARNING ] (13, 1, 'bot')
2019-02-05 22:07:15 [WARNING ] (13, 1, 'bot')
2019-02-05 22:07:15 [WARNING ] (13, 1, 'bot')
2019-02-05 22:07:15 [WARNING ] (13, 1, 'bot')
2019-02-05 22:07:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:07:15 [DEBUG   ] Finished updating board flags in 1.352 seconds
2019-02-05 22:07:29 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2019-02-05 22:07:49 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-02-05 22:08:09 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 22:08:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:08:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-02-05 22:08:16 [WARNING ] (13, 1, 'bot')
2019-02-05 22:08:16 [WARNING ] (13, 1, 'bot')
2019-02-05 22:08:16 [WARNING ] (13, 1, 'bot')
2019-02-05 22:08:16 [WARNING ] (13, 1, 'bot')
2019-02-05 22:08:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:08:16 [DEBUG   ] Finished updating board flags in 2.065 seconds
2019-02-05 22:08:30 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-02-05 22:08:50 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-02-05 22:09:10 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 22:09:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:09:16 [WARNING ] (13, 1, 'bot')
2019-02-05 22:09:16 [WARNING ] (13, 1, 'bot')
2019-02-05 22:09:16 [WARNING ] (13, 1, 'bot')
2019-02-05 22:09:16 [WARNING ] (13, 1, 'bot')
2019-02-05 22:09:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:09:16 [DEBUG   ] Finished updating board flags in 2.003 seconds
2019-02-05 22:09:30 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-02-05 22:09:50 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-05 22:09:58 [DEBUG   ] Got command RPT from MCS: ref #1413689
2019-02-05 22:09:58 [DEBUG   ] summary = ERROR
2019-02-05 22:09:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413689  13 58519 79798453 A  ERRORERROR'
2019-02-05 22:09:58 [DEBUG   ] Got command RPT from MCS: ref #1413690
2019-02-05 22:09:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 22:09:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413690  77 58519 79798645 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 22:09:58 [DEBUG   ] Got command RPT from MCS: ref #1413691
2019-02-05 22:09:58 [DEBUG   ] summary = ERROR
2019-02-05 22:09:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413691  13 58519 79798849 A  ERRORERROR'
2019-02-05 22:09:59 [DEBUG   ] Got command RPT from MCS: ref #1413692
2019-02-05 22:09:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 22:09:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413692  77 58519 79799053 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 22:09:59 [DEBUG   ] Got command RPT from MCS: ref #1413693
2019-02-05 22:09:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 22:09:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413693  12 58519 79799245 A  ERRORB˜™š'
2019-02-05 22:10:10 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 22:10:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:10:16 [WARNING ] (13, 1, 'bot')
2019-02-05 22:10:16 [WARNING ] (13, 1, 'bot')
2019-02-05 22:10:16 [WARNING ] (13, 1, 'bot')
2019-02-05 22:10:16 [WARNING ] (13, 1, 'bot')
2019-02-05 22:10:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:10:16 [DEBUG   ] Finished updating board flags in 1.992 seconds
2019-02-05 22:10:30 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 22:10:50 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-02-05 22:11:10 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-05 22:11:12 [DEBUG   ] Got command RPT from MCS: ref #1413694
2019-02-05 22:11:12 [DEBUG   ] summary = ERROR
2019-02-05 22:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413694  13 58519 79872045 A  ERRORERROR'
2019-02-05 22:11:12 [DEBUG   ] Got command RPT from MCS: ref #1413695
2019-02-05 22:11:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 22:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413695  77 58519 79872046 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 22:11:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 22:11:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:11:16 [WARNING ] (13, 1, 'bot')
2019-02-05 22:11:16 [WARNING ] (13, 1, 'bot')
2019-02-05 22:11:16 [WARNING ] (13, 1, 'bot')
2019-02-05 22:11:16 [WARNING ] (13, 1, 'bot')
2019-02-05 22:11:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:11:16 [DEBUG   ] Finished updating board flags in 1.813 seconds
2019-02-05 22:11:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 22:11:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 22:12:10 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-05 22:12:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:12:16 [WARNING ] (13, 1, 'bot')
2019-02-05 22:12:16 [WARNING ] (13, 1, 'bot')
2019-02-05 22:12:16 [WARNING ] (13, 1, 'bot')
2019-02-05 22:12:16 [WARNING ] (13, 1, 'bot')
2019-02-05 22:12:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:12:16 [DEBUG   ] Finished updating board flags in 1.797 seconds
2019-02-05 22:12:30 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-05 22:12:51 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-02-05 22:13:10 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-02-05 22:13:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:13:16 [WARNING ] (13, 1, 'bot')
2019-02-05 22:13:16 [WARNING ] (13, 1, 'bot')
2019-02-05 22:13:16 [WARNING ] (13, 1, 'bot')
2019-02-05 22:13:16 [WARNING ] (13, 1, 'bot')
2019-02-05 22:13:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:13:16 [DEBUG   ] Finished updating board flags in 1.597 seconds
2019-02-05 22:13:30 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-02-05 22:13:51 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-02-05 22:14:11 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2019-02-05 22:14:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:14:16 [WARNING ] (13, 1, 'bot')
2019-02-05 22:14:16 [WARNING ] (13, 1, 'bot')
2019-02-05 22:14:16 [WARNING ] (13, 1, 'bot')
2019-02-05 22:14:16 [WARNING ] (13, 1, 'bot')
2019-02-05 22:14:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:14:16 [DEBUG   ] Finished updating board flags in 1.412 seconds
2019-02-05 22:14:31 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-02-05 22:14:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 22:14:58 [DEBUG   ] Got command RPT from MCS: ref #1413721
2019-02-05 22:14:58 [DEBUG   ] summary = ERROR
2019-02-05 22:14:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413721  13 58519 80098521 A  ERRORERROR'
2019-02-05 22:14:58 [DEBUG   ] Got command RPT from MCS: ref #1413722
2019-02-05 22:14:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 22:14:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413722  77 58519 80098725 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 22:14:58 [DEBUG   ] Got command RPT from MCS: ref #1413723
2019-02-05 22:14:58 [DEBUG   ] summary = ERROR
2019-02-05 22:14:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413723  13 58519 80098929 A  ERRORERROR'
2019-02-05 22:14:59 [DEBUG   ] Got command RPT from MCS: ref #1413725
2019-02-05 22:14:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 22:14:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413725  77 58519 80099133 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 22:14:59 [DEBUG   ] Got command RPT from MCS: ref #1413726
2019-02-05 22:14:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 22:14:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413726  12 58519 80099325 A  ERRORB˜™š'
2019-02-05 22:15:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 22:15:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:15:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 22:15:16 [WARNING ] (13, 1, 'bot')
2019-02-05 22:15:16 [WARNING ] (13, 1, 'bot')
2019-02-05 22:15:16 [WARNING ] (13, 1, 'bot')
2019-02-05 22:15:16 [WARNING ] (13, 1, 'bot')
2019-02-05 22:15:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:15:16 [DEBUG   ] Finished updating board flags in 1.379 seconds
2019-02-05 22:15:31 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-02-05 22:15:51 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-05 22:16:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 22:16:12 [DEBUG   ] Got command RPT from MCS: ref #1413731
2019-02-05 22:16:12 [DEBUG   ] summary = ERROR
2019-02-05 22:16:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413731  13 58519 80172057 A  ERRORERROR'
2019-02-05 22:16:12 [DEBUG   ] Got command RPT from MCS: ref #1413732
2019-02-05 22:16:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 22:16:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413732  77 58519 80172058 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 22:16:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 22:16:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:16:16 [WARNING ] (13, 1, 'bot')
2019-02-05 22:16:16 [WARNING ] (13, 1, 'bot')
2019-02-05 22:16:16 [WARNING ] (13, 1, 'bot')
2019-02-05 22:16:16 [WARNING ] (13, 1, 'bot')
2019-02-05 22:16:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:16:16 [DEBUG   ] Finished updating board flags in 1.351 seconds
2019-02-05 22:16:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 22:16:51 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-02-05 22:17:11 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-05 22:17:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:17:17 [WARNING ] (13, 1, 'bot')
2019-02-05 22:17:17 [WARNING ] (13, 1, 'bot')
2019-02-05 22:17:17 [WARNING ] (13, 1, 'bot')
2019-02-05 22:17:17 [WARNING ] (13, 1, 'bot')
2019-02-05 22:17:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:17:17 [DEBUG   ] Finished updating board flags in 2.085 seconds
2019-02-05 22:17:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 22:17:51 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-05 22:18:11 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-05 22:18:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:18:17 [WARNING ] (13, 1, 'bot')
2019-02-05 22:18:17 [WARNING ] (13, 1, 'bot')
2019-02-05 22:18:17 [WARNING ] (13, 1, 'bot')
2019-02-05 22:18:17 [WARNING ] (13, 1, 'bot')
2019-02-05 22:18:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:18:17 [DEBUG   ] Finished updating board flags in 1.989 seconds
2019-02-05 22:18:31 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-05 22:18:52 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-02-05 22:19:12 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2019-02-05 22:19:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:19:17 [WARNING ] (13, 1, 'bot')
2019-02-05 22:19:17 [WARNING ] (13, 1, 'bot')
2019-02-05 22:19:17 [WARNING ] (13, 1, 'bot')
2019-02-05 22:19:17 [WARNING ] (13, 1, 'bot')
2019-02-05 22:19:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:19:17 [DEBUG   ] Finished updating board flags in 1.790 seconds
2019-02-05 22:19:32 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-02-05 22:19:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 22:19:58 [DEBUG   ] Got command RPT from MCS: ref #1413752
2019-02-05 22:19:58 [DEBUG   ] summary = ERROR
2019-02-05 22:19:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413752  13 58519 80398609 A  ERRORERROR'
2019-02-05 22:19:58 [DEBUG   ] Got command RPT from MCS: ref #1413753
2019-02-05 22:19:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 22:19:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413753  77 58519 80398813 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 22:19:59 [DEBUG   ] Got command RPT from MCS: ref #1413754
2019-02-05 22:19:59 [DEBUG   ] summary = ERROR
2019-02-05 22:19:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413754  13 58519 80399005 A  ERRORERROR'
2019-02-05 22:19:59 [DEBUG   ] Got command RPT from MCS: ref #1413755
2019-02-05 22:19:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 22:19:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413755  77 58519 80399209 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 22:19:59 [DEBUG   ] Got command RPT from MCS: ref #1413756
2019-02-05 22:19:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 22:19:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413756  12 58519 80399413 A  ERRORB˜™š'
2019-02-05 22:20:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 22:20:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 22:20:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:20:17 [WARNING ] (13, 1, 'bot')
2019-02-05 22:20:17 [WARNING ] (13, 1, 'bot')
2019-02-05 22:20:17 [WARNING ] (13, 1, 'bot')
2019-02-05 22:20:17 [WARNING ] (13, 1, 'bot')
2019-02-05 22:20:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:20:17 [DEBUG   ] Finished updating board flags in 1.600 seconds
2019-02-05 22:20:32 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 22:20:52 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-05 22:21:12 [DEBUG   ] Got command RPT from MCS: ref #1413761
2019-02-05 22:21:12 [DEBUG   ] summary = ERROR
2019-02-05 22:21:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413761  13 58519 80472049 A  ERRORERROR'
2019-02-05 22:21:12 [DEBUG   ] Got command RPT from MCS: ref #1413762
2019-02-05 22:21:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 22:21:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413762  77 58519 80472050 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 22:21:12 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-05 22:21:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 22:21:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:21:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 22:21:18 [WARNING ] (13, 1, 'bot')
2019-02-05 22:21:18 [WARNING ] (13, 1, 'bot')
2019-02-05 22:21:18 [WARNING ] (13, 1, 'bot')
2019-02-05 22:21:18 [WARNING ] (13, 1, 'bot')
2019-02-05 22:21:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:21:18 [DEBUG   ] Finished updating board flags in 1.848 seconds
2019-02-05 22:21:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 22:21:52 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-05 22:22:12 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-05 22:22:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:22:17 [WARNING ] (13, 1, 'bot')
2019-02-05 22:22:17 [WARNING ] (13, 1, 'bot')
2019-02-05 22:22:17 [WARNING ] (13, 1, 'bot')
2019-02-05 22:22:17 [WARNING ] (13, 1, 'bot')
2019-02-05 22:22:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:22:17 [DEBUG   ] Finished updating board flags in 1.357 seconds
2019-02-05 22:22:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 22:22:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 22:23:12 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-02-05 22:23:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:23:18 [WARNING ] (13, 1, 'bot')
2019-02-05 22:23:18 [WARNING ] (13, 1, 'bot')
2019-02-05 22:23:18 [WARNING ] (13, 1, 'bot')
2019-02-05 22:23:18 [WARNING ] (13, 1, 'bot')
2019-02-05 22:23:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:23:18 [DEBUG   ] Finished updating board flags in 1.641 seconds
2019-02-05 22:23:32 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-02-05 22:23:52 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 22:24:13 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-02-05 22:24:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:24:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 22:24:18 [WARNING ] (13, 1, 'bot')
2019-02-05 22:24:18 [WARNING ] (13, 1, 'bot')
2019-02-05 22:24:18 [WARNING ] (13, 1, 'bot')
2019-02-05 22:24:18 [WARNING ] (13, 1, 'bot')
2019-02-05 22:24:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:24:18 [DEBUG   ] Finished updating board flags in 2.171 seconds
2019-02-05 22:24:32 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2019-02-05 22:24:53 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-02-05 22:24:58 [DEBUG   ] Got command RPT from MCS: ref #1413784
2019-02-05 22:24:58 [DEBUG   ] summary = ERROR
2019-02-05 22:24:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413784  13 58519 80698685 A  ERRORERROR'
2019-02-05 22:24:58 [DEBUG   ] Got command RPT from MCS: ref #1413785
2019-02-05 22:24:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 22:24:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413785  77 58519 80698889 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 22:24:59 [DEBUG   ] Got command RPT from MCS: ref #1413786
2019-02-05 22:24:59 [DEBUG   ] summary = ERROR
2019-02-05 22:24:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413786  13 58519 80699093 A  ERRORERROR'
2019-02-05 22:24:59 [DEBUG   ] Got command RPT from MCS: ref #1413788
2019-02-05 22:24:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 22:24:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413788  77 58519 80699285 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 22:24:59 [DEBUG   ] Got command RPT from MCS: ref #1413790
2019-02-05 22:24:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 22:24:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413790  12 58519 80699489 A  ERRORB˜™š'
2019-02-05 22:25:13 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-02-05 22:25:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:25:18 [WARNING ] (13, 1, 'bot')
2019-02-05 22:25:18 [WARNING ] (13, 1, 'bot')
2019-02-05 22:25:18 [WARNING ] (13, 1, 'bot')
2019-02-05 22:25:18 [WARNING ] (13, 1, 'bot')
2019-02-05 22:25:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:25:18 [DEBUG   ] Finished updating board flags in 1.984 seconds
2019-02-05 22:25:33 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-02-05 22:25:53 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-02-05 22:26:12 [DEBUG   ] Got command RPT from MCS: ref #1413794
2019-02-05 22:26:12 [DEBUG   ] summary = ERROR
2019-02-05 22:26:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413794  13 58519 80772053 A  ERRORERROR'
2019-02-05 22:26:12 [DEBUG   ] Got command RPT from MCS: ref #1413795
2019-02-05 22:26:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 22:26:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413795  77 58519 80772054 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 22:26:13 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-05 22:26:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:26:18 [WARNING ] (13, 1, 'bot')
2019-02-05 22:26:18 [WARNING ] (13, 1, 'bot')
2019-02-05 22:26:18 [WARNING ] (13, 1, 'bot')
2019-02-05 22:26:18 [WARNING ] (13, 1, 'bot')
2019-02-05 22:26:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:26:18 [DEBUG   ] Finished updating board flags in 1.818 seconds
2019-02-05 22:26:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 22:26:53 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-02-05 22:27:13 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-02-05 22:27:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:27:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-02-05 22:27:18 [WARNING ] (13, 1, 'bot')
2019-02-05 22:27:18 [WARNING ] (13, 1, 'bot')
2019-02-05 22:27:18 [WARNING ] (13, 1, 'bot')
2019-02-05 22:27:18 [WARNING ] (13, 1, 'bot')
2019-02-05 22:27:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:27:18 [DEBUG   ] Finished updating board flags in 1.790 seconds
2019-02-05 22:27:33 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-05 22:27:53 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 22:28:14 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-02-05 22:28:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:28:18 [WARNING ] (13, 1, 'bot')
2019-02-05 22:28:18 [WARNING ] (13, 1, 'bot')
2019-02-05 22:28:18 [WARNING ] (13, 1, 'bot')
2019-02-05 22:28:18 [WARNING ] (13, 1, 'bot')
2019-02-05 22:28:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:28:18 [DEBUG   ] Finished updating board flags in 1.607 seconds
2019-02-05 22:28:34 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-02-05 22:28:54 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-02-05 22:29:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-05 22:29:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:29:18 [WARNING ] (13, 1, 'bot')
2019-02-05 22:29:18 [WARNING ] (13, 1, 'bot')
2019-02-05 22:29:18 [WARNING ] (13, 1, 'bot')
2019-02-05 22:29:18 [WARNING ] (13, 1, 'bot')
2019-02-05 22:29:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:29:18 [DEBUG   ] Finished updating board flags in 1.590 seconds
2019-02-05 22:29:34 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2019-02-05 22:29:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 22:29:58 [DEBUG   ] Got command RPT from MCS: ref #1413819
2019-02-05 22:29:58 [DEBUG   ] summary = ERROR
2019-02-05 22:29:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413819  13 58519 80998769 A  ERRORERROR'
2019-02-05 22:29:58 [DEBUG   ] Got command RPT from MCS: ref #1413820
2019-02-05 22:29:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 22:29:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413820  77 58519 80998973 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 22:29:59 [DEBUG   ] Got command RPT from MCS: ref #1413821
2019-02-05 22:29:59 [DEBUG   ] summary = ERROR
2019-02-05 22:29:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413821  13 58519 80999165 A  ERRORERROR'
2019-02-05 22:29:59 [DEBUG   ] Got command RPT from MCS: ref #1413822
2019-02-05 22:29:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 22:29:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413822  77 58519 80999369 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 22:29:59 [DEBUG   ] Got command RPT from MCS: ref #1413823
2019-02-05 22:29:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 22:29:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413823  12 58519 80999573 A  ERRORB™™š'
2019-02-05 22:30:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 22:30:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:30:18 [WARNING ] (13, 1, 'bot')
2019-02-05 22:30:18 [WARNING ] (13, 1, 'bot')
2019-02-05 22:30:18 [WARNING ] (13, 1, 'bot')
2019-02-05 22:30:18 [WARNING ] (13, 1, 'bot')
2019-02-05 22:30:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:30:18 [DEBUG   ] Finished updating board flags in 1.420 seconds
2019-02-05 22:30:34 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-05 22:30:54 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-02-05 22:31:12 [DEBUG   ] Got command RPT from MCS: ref #1413824
2019-02-05 22:31:12 [DEBUG   ] summary = ERROR
2019-02-05 22:31:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413824  13 58519 81072049 A  ERRORERROR'
2019-02-05 22:31:12 [DEBUG   ] Got command RPT from MCS: ref #1413825
2019-02-05 22:31:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 22:31:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413825  77 58519 81072050 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 22:31:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 22:31:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:31:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 22:31:18 [WARNING ] (13, 1, 'bot')
2019-02-05 22:31:18 [WARNING ] (13, 1, 'bot')
2019-02-05 22:31:18 [WARNING ] (13, 1, 'bot')
2019-02-05 22:31:18 [WARNING ] (13, 1, 'bot')
2019-02-05 22:31:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:31:18 [DEBUG   ] Finished updating board flags in 1.390 seconds
2019-02-05 22:31:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-05 22:31:54 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-05 22:32:14 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-05 22:32:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:32:18 [WARNING ] (13, 1, 'bot')
2019-02-05 22:32:18 [WARNING ] (13, 1, 'bot')
2019-02-05 22:32:18 [WARNING ] (13, 1, 'bot')
2019-02-05 22:32:18 [WARNING ] (13, 1, 'bot')
2019-02-05 22:32:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:32:18 [DEBUG   ] Finished updating board flags in 1.430 seconds
2019-02-05 22:32:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 22:32:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 22:33:14 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-02-05 22:33:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:33:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 22:33:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-02-05 22:33:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:33:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:33:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:33:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:33:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:33:19 [DEBUG   ] Finished updating board flags in 2.229 seconds
2019-02-05 22:33:34 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-05 22:33:54 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 22:34:14 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-02-05 22:34:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:34:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-02-05 22:34:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:34:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:34:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:34:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:34:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:34:19 [DEBUG   ] Finished updating board flags in 2.143 seconds
2019-02-05 22:34:35 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-02-05 22:34:55 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-02-05 22:34:58 [DEBUG   ] Got command RPT from MCS: ref #1413847
2019-02-05 22:34:58 [DEBUG   ] summary = ERROR
2019-02-05 22:34:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413847  13 58519 81298849 A  ERRORERROR'
2019-02-05 22:34:59 [DEBUG   ] Got command RPT from MCS: ref #1413848
2019-02-05 22:34:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 22:34:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413848  77 58519 81299053 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 22:34:59 [DEBUG   ] Got command RPT from MCS: ref #1413849
2019-02-05 22:34:59 [DEBUG   ] summary = ERROR
2019-02-05 22:34:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413849  13 58519 81299245 A  ERRORERROR'
2019-02-05 22:34:59 [DEBUG   ] Got command RPT from MCS: ref #1413851
2019-02-05 22:34:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 22:34:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413851  77 58519 81299449 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 22:34:59 [DEBUG   ] Got command RPT from MCS: ref #1413853
2019-02-05 22:34:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 22:34:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413853  12 58519 81299653 A  ERRORBš™š'
2019-02-05 22:35:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-05 22:35:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 22:35:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:35:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-05 22:35:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:35:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:35:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:35:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:35:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:35:19 [DEBUG   ] Finished updating board flags in 2.012 seconds
2019-02-05 22:35:35 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-02-05 22:35:55 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-05 22:36:12 [DEBUG   ] Got command RPT from MCS: ref #1413861
2019-02-05 22:36:12 [DEBUG   ] summary = ERROR
2019-02-05 22:36:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413861  13 58519 81372053 A  ERRORERROR'
2019-02-05 22:36:12 [DEBUG   ] Got command RPT from MCS: ref #1413862
2019-02-05 22:36:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 22:36:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413862  77 58519 81372054 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 22:36:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 22:36:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:36:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-02-05 22:36:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:36:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:36:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:36:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:36:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:36:19 [DEBUG   ] Finished updating board flags in 2.000 seconds
2019-02-05 22:36:35 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-02-05 22:36:55 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-05 22:37:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 22:37:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:37:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-02-05 22:37:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:37:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:37:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:37:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:37:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:37:19 [DEBUG   ] Finished updating board flags in 2.000 seconds
2019-02-05 22:37:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 22:37:55 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-02-05 22:38:15 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-05 22:38:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:38:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:38:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:38:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:38:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:38:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:38:19 [DEBUG   ] Finished updating board flags in 1.798 seconds
2019-02-05 22:38:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 22:38:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 22:39:15 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-02-05 22:39:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 22:39:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:39:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:39:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:39:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:39:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:39:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:39:19 [DEBUG   ] Finished updating board flags in 1.604 seconds
2019-02-05 22:39:35 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-02-05 22:39:55 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-02-05 22:39:58 [DEBUG   ] Got command RPT from MCS: ref #1413882
2019-02-05 22:39:58 [DEBUG   ] summary = ERROR
2019-02-05 22:39:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413882  13 58519 81598933 A  ERRORERROR'
2019-02-05 22:39:59 [DEBUG   ] Got command RPT from MCS: ref #1413883
2019-02-05 22:39:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 22:39:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413883  77 58519 81599125 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 22:39:59 [DEBUG   ] Got command RPT from MCS: ref #1413884
2019-02-05 22:39:59 [DEBUG   ] summary = ERROR
2019-02-05 22:39:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413884  13 58519 81599329 A  ERRORERROR'
2019-02-05 22:39:59 [DEBUG   ] Got command RPT from MCS: ref #1413885
2019-02-05 22:39:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 22:39:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413885  77 58519 81599533 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 22:39:59 [DEBUG   ] Got command RPT from MCS: ref #1413886
2019-02-05 22:39:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 22:39:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413886  12 58519 81599725 A  ERRORBš™š'
2019-02-05 22:40:15 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-02-05 22:40:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:40:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:40:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:40:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:40:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:40:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:40:19 [DEBUG   ] Finished updating board flags in 1.614 seconds
2019-02-05 22:40:36 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2019-02-05 22:40:56 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-02-05 22:41:12 [DEBUG   ] Got command RPT from MCS: ref #1413887
2019-02-05 22:41:12 [DEBUG   ] summary = ERROR
2019-02-05 22:41:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413887  13 58519 81672057 A  ERRORERROR'
2019-02-05 22:41:12 [DEBUG   ] Got command RPT from MCS: ref #1413888
2019-02-05 22:41:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 22:41:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413888  77 58519 81672058 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 22:41:16 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 22:41:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:41:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 22:41:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:41:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:41:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:41:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:41:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:41:19 [DEBUG   ] Finished updating board flags in 1.578 seconds
2019-02-05 22:41:36 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-02-05 22:41:56 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-02-05 22:42:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 22:42:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:42:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:42:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:42:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:42:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:42:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:42:19 [DEBUG   ] Finished updating board flags in 1.416 seconds
2019-02-05 22:42:36 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 22:42:56 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-02-05 22:43:16 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-05 22:43:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:43:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 22:43:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-02-05 22:43:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:43:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:43:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:43:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:43:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:43:19 [DEBUG   ] Finished updating board flags in 1.404 seconds
2019-02-05 22:43:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 22:43:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 22:44:16 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-02-05 22:44:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 22:44:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:44:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 22:44:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:44:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:44:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:44:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:44:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:44:19 [DEBUG   ] Finished updating board flags in 1.390 seconds
2019-02-05 22:44:36 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-05 22:44:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 22:44:59 [DEBUG   ] Got command RPT from MCS: ref #1413914
2019-02-05 22:44:59 [DEBUG   ] summary = ERROR
2019-02-05 22:44:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413914  13 58519 81899001 A  ERRORERROR'
2019-02-05 22:44:59 [DEBUG   ] Got command RPT from MCS: ref #1413915
2019-02-05 22:44:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 22:44:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413915  77 58519 81899205 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 22:44:59 [DEBUG   ] Got command RPT from MCS: ref #1413916
2019-02-05 22:44:59 [DEBUG   ] summary = ERROR
2019-02-05 22:44:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413916  13 58519 81899409 A  ERRORERROR'
2019-02-05 22:44:59 [DEBUG   ] Got command RPT from MCS: ref #1413918
2019-02-05 22:44:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 22:44:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413918  77 58519 81899613 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 22:44:59 [DEBUG   ] Got command RPT from MCS: ref #1413919
2019-02-05 22:44:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 22:44:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413919  12 58519 81899805 A  ERRORB™™š'
2019-02-05 22:45:16 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-02-05 22:45:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:45:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:45:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:45:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:45:19 [WARNING ] (13, 1, 'bot')
2019-02-05 22:45:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:45:19 [DEBUG   ] Finished updating board flags in 1.349 seconds
2019-02-05 22:45:36 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-05 22:45:56 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-02-05 22:46:12 [DEBUG   ] Got command RPT from MCS: ref #1413924
2019-02-05 22:46:12 [DEBUG   ] summary = ERROR
2019-02-05 22:46:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413924  13 58519 81972061 A  ERRORERROR'
2019-02-05 22:46:12 [DEBUG   ] Got command RPT from MCS: ref #1413925
2019-02-05 22:46:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 22:46:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413925  77 58519 81972062 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 22:46:16 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-05 22:46:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 22:46:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:46:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 22:46:20 [WARNING ] (13, 1, 'bot')
2019-02-05 22:46:20 [WARNING ] (13, 1, 'bot')
2019-02-05 22:46:20 [WARNING ] (13, 1, 'bot')
2019-02-05 22:46:20 [WARNING ] (13, 1, 'bot')
2019-02-05 22:46:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:46:20 [DEBUG   ] Finished updating board flags in 2.062 seconds
2019-02-05 22:46:36 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 22:46:56 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2019-02-05 22:47:17 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-02-05 22:47:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:47:20 [WARNING ] (13, 1, 'bot')
2019-02-05 22:47:20 [WARNING ] (13, 1, 'bot')
2019-02-05 22:47:20 [WARNING ] (13, 1, 'bot')
2019-02-05 22:47:20 [WARNING ] (13, 1, 'bot')
2019-02-05 22:47:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:47:20 [DEBUG   ] Finished updating board flags in 1.992 seconds
2019-02-05 22:47:37 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-05 22:47:57 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-02-05 22:48:17 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-05 22:48:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:48:20 [WARNING ] (13, 1, 'bot')
2019-02-05 22:48:20 [WARNING ] (13, 1, 'bot')
2019-02-05 22:48:20 [WARNING ] (13, 1, 'bot')
2019-02-05 22:48:20 [WARNING ] (13, 1, 'bot')
2019-02-05 22:48:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:48:20 [DEBUG   ] Finished updating board flags in 1.817 seconds
2019-02-05 22:48:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 22:48:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 22:49:17 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 22:49:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 22:49:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:49:20 [WARNING ] (13, 1, 'bot')
2019-02-05 22:49:20 [WARNING ] (13, 1, 'bot')
2019-02-05 22:49:20 [WARNING ] (13, 1, 'bot')
2019-02-05 22:49:20 [WARNING ] (13, 1, 'bot')
2019-02-05 22:49:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:49:20 [DEBUG   ] Finished updating board flags in 1.812 seconds
2019-02-05 22:49:37 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-05 22:49:57 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-05 22:49:59 [DEBUG   ] Got command RPT from MCS: ref #1413945
2019-02-05 22:49:59 [DEBUG   ] summary = ERROR
2019-02-05 22:49:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413945  13 58519 82199093 A  ERRORERROR'
2019-02-05 22:49:59 [DEBUG   ] Got command RPT from MCS: ref #1413946
2019-02-05 22:49:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 22:49:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413946  77 58519 82199285 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 22:49:59 [DEBUG   ] Got command RPT from MCS: ref #1413947
2019-02-05 22:49:59 [DEBUG   ] summary = ERROR
2019-02-05 22:49:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413947  13 58519 82199489 A  ERRORERROR'
2019-02-05 22:49:59 [DEBUG   ] Got command RPT from MCS: ref #1413948
2019-02-05 22:49:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 22:49:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413948  77 58519 82199693 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 22:49:59 [DEBUG   ] Got command RPT from MCS: ref #1413949
2019-02-05 22:49:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 22:49:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413949  12 58519 82199885 A  ERRORB™™š'
2019-02-05 22:50:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 22:50:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:50:20 [WARNING ] (13, 1, 'bot')
2019-02-05 22:50:20 [WARNING ] (13, 1, 'bot')
2019-02-05 22:50:20 [WARNING ] (13, 1, 'bot')
2019-02-05 22:50:20 [WARNING ] (13, 1, 'bot')
2019-02-05 22:50:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:50:20 [DEBUG   ] Finished updating board flags in 1.793 seconds
2019-02-05 22:50:37 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-02-05 22:50:57 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-05 22:51:12 [DEBUG   ] Got command RPT from MCS: ref #1413954
2019-02-05 22:51:12 [DEBUG   ] summary = ERROR
2019-02-05 22:51:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413954  13 58519 82272061 A  ERRORERROR'
2019-02-05 22:51:12 [DEBUG   ] Got command RPT from MCS: ref #1413955
2019-02-05 22:51:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 22:51:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413955  77 58519 82272062 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 22:51:18 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-02-05 22:51:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:51:20 [WARNING ] (13, 1, 'bot')
2019-02-05 22:51:20 [WARNING ] (13, 1, 'bot')
2019-02-05 22:51:20 [WARNING ] (13, 1, 'bot')
2019-02-05 22:51:20 [WARNING ] (13, 1, 'bot')
2019-02-05 22:51:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:51:20 [DEBUG   ] Finished updating board flags in 1.595 seconds
2019-02-05 22:51:38 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-02-05 22:51:58 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-02-05 22:52:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 22:52:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 22:52:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:52:20 [WARNING ] (13, 1, 'bot')
2019-02-05 22:52:20 [WARNING ] (13, 1, 'bot')
2019-02-05 22:52:20 [WARNING ] (13, 1, 'bot')
2019-02-05 22:52:20 [WARNING ] (13, 1, 'bot')
2019-02-05 22:52:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:52:20 [DEBUG   ] Finished updating board flags in 1.393 seconds
2019-02-05 22:52:38 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 22:52:58 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-05 22:53:18 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-05 22:53:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:53:20 [WARNING ] (13, 1, 'bot')
2019-02-05 22:53:20 [WARNING ] (13, 1, 'bot')
2019-02-05 22:53:20 [WARNING ] (13, 1, 'bot')
2019-02-05 22:53:20 [WARNING ] (13, 1, 'bot')
2019-02-05 22:53:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:53:20 [DEBUG   ] Finished updating board flags in 1.350 seconds
2019-02-05 22:53:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 22:53:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 22:54:18 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-02-05 22:54:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:54:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 22:54:21 [WARNING ] (13, 1, 'bot')
2019-02-05 22:54:21 [WARNING ] (13, 1, 'bot')
2019-02-05 22:54:21 [WARNING ] (13, 1, 'bot')
2019-02-05 22:54:21 [WARNING ] (13, 1, 'bot')
2019-02-05 22:54:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:54:21 [DEBUG   ] Finished updating board flags in 2.071 seconds
2019-02-05 22:54:38 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-02-05 22:54:59 [DEBUG   ] Got command RPT from MCS: ref #1413977
2019-02-05 22:54:59 [DEBUG   ] summary = ERROR
2019-02-05 22:54:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413977  13 58519 82499161 A  ERRORERROR'
2019-02-05 22:54:59 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-02-05 22:54:59 [DEBUG   ] Got command RPT from MCS: ref #1413978
2019-02-05 22:54:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 22:54:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413978  77 58519 82499369 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 22:54:59 [DEBUG   ] Got command RPT from MCS: ref #1413979
2019-02-05 22:54:59 [DEBUG   ] summary = ERROR
2019-02-05 22:54:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413979  13 58519 82499569 A  ERRORERROR'
2019-02-05 22:54:59 [DEBUG   ] Got command RPT from MCS: ref #1413981
2019-02-05 22:54:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 22:54:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413981  77 58519 82499773 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 22:54:59 [DEBUG   ] Got command RPT from MCS: ref #1413982
2019-02-05 22:54:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 22:54:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413982  12 58519 82499965 A  ERRORB˜™š'
2019-02-05 22:55:19 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-05 22:55:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:55:21 [WARNING ] (13, 1, 'bot')
2019-02-05 22:55:21 [WARNING ] (13, 1, 'bot')
2019-02-05 22:55:21 [WARNING ] (13, 1, 'bot')
2019-02-05 22:55:21 [WARNING ] (13, 1, 'bot')
2019-02-05 22:55:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:55:21 [DEBUG   ] Finished updating board flags in 1.985 seconds
2019-02-05 22:55:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 22:55:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 22:56:12 [DEBUG   ] Got command RPT from MCS: ref #1413987
2019-02-05 22:56:12 [DEBUG   ] summary = ERROR
2019-02-05 22:56:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413987  13 58519 82572057 A  ERRORERROR'
2019-02-05 22:56:12 [DEBUG   ] Got command RPT from MCS: ref #1413988
2019-02-05 22:56:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 22:56:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1413988  77 58519 82572058 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 22:56:19 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-02-05 22:56:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:56:21 [WARNING ] (13, 1, 'bot')
2019-02-05 22:56:21 [WARNING ] (13, 1, 'bot')
2019-02-05 22:56:21 [WARNING ] (13, 1, 'bot')
2019-02-05 22:56:21 [WARNING ] (13, 1, 'bot')
2019-02-05 22:56:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:56:21 [DEBUG   ] Finished updating board flags in 1.895 seconds
2019-02-05 22:56:39 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-05 22:56:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 22:57:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 22:57:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:57:21 [WARNING ] (13, 1, 'bot')
2019-02-05 22:57:21 [WARNING ] (13, 1, 'bot')
2019-02-05 22:57:21 [WARNING ] (13, 1, 'bot')
2019-02-05 22:57:21 [WARNING ] (13, 1, 'bot')
2019-02-05 22:57:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:57:21 [DEBUG   ] Finished updating board flags in 1.719 seconds
2019-02-05 22:57:39 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 22:57:59 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-05 22:58:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 22:58:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:58:21 [WARNING ] (13, 1, 'bot')
2019-02-05 22:58:21 [WARNING ] (13, 1, 'bot')
2019-02-05 22:58:21 [WARNING ] (13, 1, 'bot')
2019-02-05 22:58:21 [WARNING ] (13, 1, 'bot')
2019-02-05 22:58:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:58:21 [DEBUG   ] Finished updating board flags in 1.608 seconds
2019-02-05 22:58:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 22:58:59 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-05 22:59:19 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-05 22:59:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 22:59:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 22:59:21 [WARNING ] (13, 1, 'bot')
2019-02-05 22:59:21 [WARNING ] (13, 1, 'bot')
2019-02-05 22:59:21 [WARNING ] (13, 1, 'bot')
2019-02-05 22:59:21 [WARNING ] (13, 1, 'bot')
2019-02-05 22:59:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 22:59:21 [DEBUG   ] Finished updating board flags in 1.592 seconds
2019-02-05 22:59:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 22:59:59 [DEBUG   ] Got command RPT from MCS: ref #1414012
2019-02-05 22:59:59 [DEBUG   ] summary = ERROR
2019-02-05 22:59:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414012  13 58519 82799245 A  ERRORERROR'
2019-02-05 22:59:59 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-05 22:59:59 [DEBUG   ] Got command RPT from MCS: ref #1414013
2019-02-05 22:59:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 22:59:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414013  77 58519 82799449 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 22:59:59 [DEBUG   ] Got command RPT from MCS: ref #1414014
2019-02-05 22:59:59 [DEBUG   ] summary = ERROR
2019-02-05 22:59:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414014  13 58519 82799653 A  ERRORERROR'
2019-02-05 22:59:59 [DEBUG   ] Got command RPT from MCS: ref #1414015
2019-02-05 22:59:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 22:59:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414015  77 58519 82799845 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 23:00:00 [DEBUG   ] Got command RPT from MCS: ref #1414016
2019-02-05 23:00:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 23:00:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414016  12 58519 82800049 A  ERRORB˜™š'
2019-02-05 23:00:19 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-05 23:00:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:00:21 [WARNING ] (13, 1, 'bot')
2019-02-05 23:00:21 [WARNING ] (13, 1, 'bot')
2019-02-05 23:00:21 [WARNING ] (13, 1, 'bot')
2019-02-05 23:00:21 [WARNING ] (13, 1, 'bot')
2019-02-05 23:00:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:00:21 [DEBUG   ] Finished updating board flags in 1.402 seconds
2019-02-05 23:00:39 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-05 23:01:00 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-02-05 23:01:12 [DEBUG   ] Got command RPT from MCS: ref #1414017
2019-02-05 23:01:12 [DEBUG   ] summary = ERROR
2019-02-05 23:01:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414017  13 58519 82872161 A  ERRORERROR'
2019-02-05 23:01:12 [DEBUG   ] Got command RPT from MCS: ref #1414018
2019-02-05 23:01:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 23:01:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414018  77 58519 82872162 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 23:01:19 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-05 23:01:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 23:01:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:01:21 [WARNING ] (13, 1, 'bot')
2019-02-05 23:01:21 [WARNING ] (13, 1, 'bot')
2019-02-05 23:01:21 [WARNING ] (13, 1, 'bot')
2019-02-05 23:01:21 [WARNING ] (13, 1, 'bot')
2019-02-05 23:01:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:01:21 [DEBUG   ] Finished updating board flags in 1.418 seconds
2019-02-05 23:01:40 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2019-02-05 23:02:00 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-05 23:02:20 [DEBUG   ] Finished updating ant stats in 1.233 seconds
2019-02-05 23:02:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:02:21 [WARNING ] (13, 1, 'bot')
2019-02-05 23:02:21 [WARNING ] (13, 1, 'bot')
2019-02-05 23:02:21 [WARNING ] (13, 1, 'bot')
2019-02-05 23:02:21 [WARNING ] (13, 1, 'bot')
2019-02-05 23:02:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:02:21 [DEBUG   ] Finished updating board flags in 1.383 seconds
2019-02-05 23:02:40 [DEBUG   ] Finished updating ant stats in 1.172 seconds
2019-02-05 23:03:00 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-05 23:03:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 23:03:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:03:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-02-05 23:03:21 [WARNING ] (13, 1, 'bot')
2019-02-05 23:03:21 [WARNING ] (13, 1, 'bot')
2019-02-05 23:03:21 [WARNING ] (13, 1, 'bot')
2019-02-05 23:03:21 [WARNING ] (13, 1, 'bot')
2019-02-05 23:03:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:03:21 [DEBUG   ] Finished updating board flags in 1.348 seconds
2019-02-05 23:03:40 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-05 23:04:00 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-02-05 23:04:20 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-05 23:04:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:04:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-02-05 23:04:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2019-02-05 23:04:22 [WARNING ] (13, 1, 'bot')
2019-02-05 23:04:22 [WARNING ] (13, 1, 'bot')
2019-02-05 23:04:22 [WARNING ] (13, 1, 'bot')
2019-02-05 23:04:22 [WARNING ] (13, 1, 'bot')
2019-02-05 23:04:22 [WARNING ] (25, 5, 'bot')
2019-02-05 23:04:22 [WARNING ] (25, 5, 'bot')
2019-02-05 23:04:22 [WARNING ] (25, 5, 'bot')
2019-02-05 23:04:22 [WARNING ] (25, 5, 'bot')
2019-02-05 23:04:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:04:22 [DEBUG   ] Finished updating board flags in 2.075 seconds
2019-02-05 23:04:41 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-02-05 23:04:59 [DEBUG   ] Got command RPT from MCS: ref #1414040
2019-02-05 23:04:59 [DEBUG   ] summary = ERROR
2019-02-05 23:04:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414040  13 58519 83099325 A  ERRORERROR'
2019-02-05 23:04:59 [DEBUG   ] Got command RPT from MCS: ref #1414041
2019-02-05 23:04:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 23:04:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414041  77 58519 83099529 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 23:04:59 [DEBUG   ] Got command RPT from MCS: ref #1414042
2019-02-05 23:04:59 [DEBUG   ] summary = ERROR
2019-02-05 23:04:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414042  13 58519 83099733 A  ERRORERROR'
2019-02-05 23:04:59 [DEBUG   ] Got command RPT from MCS: ref #1414044
2019-02-05 23:04:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 23:04:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414044  77 58519 83099925 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 23:05:00 [DEBUG   ] Got command RPT from MCS: ref #1414046
2019-02-05 23:05:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 23:05:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414046  12 58519 83100134 A  ERRORB™™š'
2019-02-05 23:05:01 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2019-02-05 23:05:21 [DEBUG   ] Finished updating ant stats in 1.245 seconds
2019-02-05 23:05:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:05:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 23:05:22 [WARNING ] (13, 1, 'bot')
2019-02-05 23:05:22 [WARNING ] (13, 1, 'bot')
2019-02-05 23:05:22 [WARNING ] (13, 1, 'bot')
2019-02-05 23:05:22 [WARNING ] (13, 1, 'bot')
2019-02-05 23:05:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:05:22 [DEBUG   ] Finished updating board flags in 1.983 seconds
2019-02-05 23:05:41 [DEBUG   ] Finished updating ant stats in 1.154 seconds
2019-02-05 23:06:01 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-02-05 23:06:12 [DEBUG   ] Got command RPT from MCS: ref #1414054
2019-02-05 23:06:12 [DEBUG   ] summary = ERROR
2019-02-05 23:06:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414054  13 58519 83172057 A  ERRORERROR'
2019-02-05 23:06:12 [DEBUG   ] Got command RPT from MCS: ref #1414055
2019-02-05 23:06:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 23:06:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414055  77 58519 83172058 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 23:06:21 [DEBUG   ] Finished updating ant stats in 1.047 seconds
2019-02-05 23:06:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:06:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 23:06:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-05 23:06:22 [WARNING ] (13, 1, 'bot')
2019-02-05 23:06:22 [WARNING ] (13, 1, 'bot')
2019-02-05 23:06:22 [WARNING ] (13, 1, 'bot')
2019-02-05 23:06:22 [WARNING ] (13, 1, 'bot')
2019-02-05 23:06:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:06:22 [DEBUG   ] Finished updating board flags in 1.824 seconds
2019-02-05 23:06:41 [DEBUG   ] Finished updating ant stats in 0.955 seconds
2019-02-05 23:07:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 23:07:21 [DEBUG   ] Finished updating ant stats in 0.847 seconds
2019-02-05 23:07:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:07:22 [WARNING ] (13, 1, 'bot')
2019-02-05 23:07:22 [WARNING ] (13, 1, 'bot')
2019-02-05 23:07:22 [WARNING ] (13, 1, 'bot')
2019-02-05 23:07:22 [WARNING ] (13, 1, 'bot')
2019-02-05 23:07:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:07:22 [DEBUG   ] Finished updating board flags in 1.783 seconds
2019-02-05 23:07:41 [DEBUG   ] Finished updating ant stats in 0.760 seconds
2019-02-05 23:08:01 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-02-05 23:08:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 23:08:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:08:22 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2019-02-05 23:08:22 [WARNING ] (13, 1, 'bot')
2019-02-05 23:08:22 [WARNING ] (13, 1, 'bot')
2019-02-05 23:08:22 [WARNING ] (13, 1, 'bot')
2019-02-05 23:08:22 [WARNING ] (13, 1, 'bot')
2019-02-05 23:08:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:08:22 [DEBUG   ] Finished updating board flags in 1.612 seconds
2019-02-05 23:08:42 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-02-05 23:09:02 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-05 23:09:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 23:09:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:09:22 [DEBUG   ] Finished updating ant stats in 1.045 seconds
2019-02-05 23:09:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-05 23:09:22 [WARNING ] (13, 1, 'bot')
2019-02-05 23:09:22 [WARNING ] (13, 1, 'bot')
2019-02-05 23:09:22 [WARNING ] (13, 1, 'bot')
2019-02-05 23:09:22 [WARNING ] (13, 1, 'bot')
2019-02-05 23:09:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:09:22 [DEBUG   ] Finished updating board flags in 1.657 seconds
2019-02-05 23:09:42 [DEBUG   ] Finished updating ant stats in 0.959 seconds
2019-02-05 23:09:59 [DEBUG   ] Got command RPT from MCS: ref #1414075
2019-02-05 23:09:59 [DEBUG   ] summary = ERROR
2019-02-05 23:09:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414075  13 58519 83399405 A  ERRORERROR'
2019-02-05 23:09:59 [DEBUG   ] Got command RPT from MCS: ref #1414076
2019-02-05 23:09:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 23:09:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414076  77 58519 83399609 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 23:09:59 [DEBUG   ] Got command RPT from MCS: ref #1414077
2019-02-05 23:09:59 [DEBUG   ] summary = ERROR
2019-02-05 23:09:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414077  13 58519 83399813 A  ERRORERROR'
2019-02-05 23:10:00 [DEBUG   ] Got command RPT from MCS: ref #1414078
2019-02-05 23:10:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 23:10:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414078  77 58519 83400017 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 23:10:00 [DEBUG   ] Got command RPT from MCS: ref #1414079
2019-02-05 23:10:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 23:10:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414079  12 58519 83400209 A  ERRORBš™š'
2019-02-05 23:10:02 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-05 23:10:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:10:22 [DEBUG   ] Finished updating ant stats in 0.838 seconds
2019-02-05 23:10:22 [WARNING ] (13, 1, 'bot')
2019-02-05 23:10:22 [WARNING ] (13, 1, 'bot')
2019-02-05 23:10:22 [WARNING ] (13, 1, 'bot')
2019-02-05 23:10:22 [WARNING ] (13, 1, 'bot')
2019-02-05 23:10:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:10:22 [DEBUG   ] Finished updating board flags in 1.469 seconds
2019-02-05 23:10:42 [DEBUG   ] Finished updating ant stats in 0.759 seconds
2019-02-05 23:11:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 23:11:12 [DEBUG   ] Got command RPT from MCS: ref #1414080
2019-02-05 23:11:12 [DEBUG   ] summary = ERROR
2019-02-05 23:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414080  13 58519 83472057 A  ERRORERROR'
2019-02-05 23:11:12 [DEBUG   ] Got command RPT from MCS: ref #1414081
2019-02-05 23:11:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 23:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414081  77 58519 83472058 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 23:11:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:11:22 [DEBUG   ] Finished updating ant stats in 0.649 seconds
2019-02-05 23:11:22 [WARNING ] (13, 1, 'bot')
2019-02-05 23:11:22 [WARNING ] (13, 1, 'bot')
2019-02-05 23:11:22 [WARNING ] (13, 1, 'bot')
2019-02-05 23:11:22 [WARNING ] (13, 1, 'bot')
2019-02-05 23:11:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:11:22 [DEBUG   ] Finished updating board flags in 1.478 seconds
2019-02-05 23:11:42 [DEBUG   ] Finished updating ant stats in 0.554 seconds
2019-02-05 23:12:02 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-05 23:12:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:12:22 [WARNING ] (13, 1, 'bot')
2019-02-05 23:12:22 [WARNING ] (13, 1, 'bot')
2019-02-05 23:12:22 [WARNING ] (13, 1, 'bot')
2019-02-05 23:12:22 [WARNING ] (13, 1, 'bot')
2019-02-05 23:12:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:12:22 [DEBUG   ] Finished updating board flags in 1.469 seconds
2019-02-05 23:12:23 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2019-02-05 23:12:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 23:13:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 23:13:23 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-05 23:13:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:13:24 [WARNING ] (13, 1, 'bot')
2019-02-05 23:13:24 [WARNING ] (13, 1, 'bot')
2019-02-05 23:13:24 [WARNING ] (13, 1, 'bot')
2019-02-05 23:13:24 [WARNING ] (13, 1, 'bot')
2019-02-05 23:13:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:13:24 [DEBUG   ] Finished updating board flags in 3.140 seconds
2019-02-05 23:13:43 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-05 23:14:03 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-05 23:14:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:14:23 [DEBUG   ] Finished updating ant stats in 1.041 seconds
2019-02-05 23:14:23 [WARNING ] (13, 1, 'bot')
2019-02-05 23:14:23 [WARNING ] (13, 1, 'bot')
2019-02-05 23:14:23 [WARNING ] (13, 1, 'bot')
2019-02-05 23:14:23 [WARNING ] (13, 1, 'bot')
2019-02-05 23:14:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:14:23 [DEBUG   ] Finished updating board flags in 2.045 seconds
2019-02-05 23:14:43 [DEBUG   ] Finished updating ant stats in 0.960 seconds
2019-02-05 23:14:59 [DEBUG   ] Got command RPT from MCS: ref #1414107
2019-02-05 23:14:59 [DEBUG   ] summary = ERROR
2019-02-05 23:14:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414107  13 58519 83699493 A  ERRORERROR'
2019-02-05 23:14:59 [DEBUG   ] Got command RPT from MCS: ref #1414108
2019-02-05 23:14:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 23:14:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414108  77 58519 83699685 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 23:14:59 [DEBUG   ] Got command RPT from MCS: ref #1414109
2019-02-05 23:14:59 [DEBUG   ] summary = ERROR
2019-02-05 23:14:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414109  13 58519 83699889 A  ERRORERROR'
2019-02-05 23:15:00 [DEBUG   ] Got command RPT from MCS: ref #1414111
2019-02-05 23:15:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 23:15:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414111  77 58519 83700093 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 23:15:00 [DEBUG   ] Got command RPT from MCS: ref #1414113
2019-02-05 23:15:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 23:15:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414113  12 58519 83700297 A  ERRORBš™š'
2019-02-05 23:15:03 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2019-02-05 23:15:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:15:23 [DEBUG   ] Finished updating ant stats in 0.646 seconds
2019-02-05 23:15:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-02-05 23:15:23 [WARNING ] (13, 1, 'bot')
2019-02-05 23:15:23 [WARNING ] (13, 1, 'bot')
2019-02-05 23:15:23 [WARNING ] (13, 1, 'bot')
2019-02-05 23:15:23 [WARNING ] (13, 1, 'bot')
2019-02-05 23:15:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:15:23 [DEBUG   ] Finished updating board flags in 2.020 seconds
2019-02-05 23:15:43 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2019-02-05 23:16:04 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-02-05 23:16:12 [DEBUG   ] Got command RPT from MCS: ref #1414117
2019-02-05 23:16:12 [DEBUG   ] summary = ERROR
2019-02-05 23:16:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414117  13 58519 83772061 A  ERRORERROR'
2019-02-05 23:16:12 [DEBUG   ] Got command RPT from MCS: ref #1414118
2019-02-05 23:16:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 23:16:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414118  77 58519 83772062 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 23:16:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:16:23 [WARNING ] (13, 1, 'bot')
2019-02-05 23:16:23 [WARNING ] (13, 1, 'bot')
2019-02-05 23:16:23 [WARNING ] (13, 1, 'bot')
2019-02-05 23:16:23 [WARNING ] (13, 1, 'bot')
2019-02-05 23:16:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:16:23 [DEBUG   ] Finished updating board flags in 1.976 seconds
2019-02-05 23:16:24 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-05 23:16:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 23:17:04 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 23:17:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:17:24 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-02-05 23:17:24 [WARNING ] (13, 1, 'bot')
2019-02-05 23:17:24 [WARNING ] (13, 1, 'bot')
2019-02-05 23:17:24 [WARNING ] (13, 1, 'bot')
2019-02-05 23:17:24 [WARNING ] (13, 1, 'bot')
2019-02-05 23:17:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:17:24 [DEBUG   ] Finished updating board flags in 2.919 seconds
2019-02-05 23:17:44 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-02-05 23:18:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 23:18:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 23:18:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:18:23 [WARNING ] (13, 1, 'bot')
2019-02-05 23:18:23 [WARNING ] (13, 1, 'bot')
2019-02-05 23:18:23 [WARNING ] (13, 1, 'bot')
2019-02-05 23:18:23 [WARNING ] (13, 1, 'bot')
2019-02-05 23:18:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:18:23 [DEBUG   ] Finished updating board flags in 1.681 seconds
2019-02-05 23:18:24 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 23:18:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 23:19:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 23:19:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:19:23 [WARNING ] (13, 1, 'bot')
2019-02-05 23:19:23 [WARNING ] (13, 1, 'bot')
2019-02-05 23:19:23 [WARNING ] (13, 1, 'bot')
2019-02-05 23:19:23 [WARNING ] (13, 1, 'bot')
2019-02-05 23:19:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:19:23 [DEBUG   ] Finished updating board flags in 1.667 seconds
2019-02-05 23:19:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 23:19:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 23:19:59 [DEBUG   ] Got command RPT from MCS: ref #1414138
2019-02-05 23:19:59 [DEBUG   ] summary = ERROR
2019-02-05 23:19:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414138  13 58519 83999569 A  ERRORERROR'
2019-02-05 23:19:59 [DEBUG   ] Got command RPT from MCS: ref #1414139
2019-02-05 23:19:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 23:19:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414139  77 58519 83999773 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 23:19:59 [DEBUG   ] Got command RPT from MCS: ref #1414140
2019-02-05 23:19:59 [DEBUG   ] summary = ERROR
2019-02-05 23:19:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414140  13 58519 83999977 A  ERRORERROR'
2019-02-05 23:20:00 [DEBUG   ] Got command RPT from MCS: ref #1414141
2019-02-05 23:20:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 23:20:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414141  77 58519 84000169 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 23:20:00 [DEBUG   ] Got command RPT from MCS: ref #1414142
2019-02-05 23:20:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 23:20:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414142  12 58519 84000373 A  ERRORB™™š'
2019-02-05 23:20:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 23:20:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:20:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 23:20:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 23:20:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-02-05 23:20:23 [WARNING ] (13, 1, 'bot')
2019-02-05 23:20:23 [WARNING ] (13, 1, 'bot')
2019-02-05 23:20:23 [WARNING ] (13, 1, 'bot')
2019-02-05 23:20:23 [WARNING ] (13, 1, 'bot')
2019-02-05 23:20:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:20:23 [DEBUG   ] Finished updating board flags in 1.550 seconds
2019-02-05 23:20:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 23:20:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 23:21:04 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 23:21:12 [DEBUG   ] Got command RPT from MCS: ref #1414147
2019-02-05 23:21:12 [DEBUG   ] summary = ERROR
2019-02-05 23:21:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414147  13 58519 84072065 A  ERRORERROR'
2019-02-05 23:21:12 [DEBUG   ] Got command RPT from MCS: ref #1414148
2019-02-05 23:21:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 23:21:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414148  77 58519 84072066 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 23:21:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:21:24 [DEBUG   ] Finished updating ant stats in 1.053 seconds
2019-02-05 23:21:24 [WARNING ] (13, 1, 'bot')
2019-02-05 23:21:24 [WARNING ] (13, 1, 'bot')
2019-02-05 23:21:24 [WARNING ] (13, 1, 'bot')
2019-02-05 23:21:24 [WARNING ] (13, 1, 'bot')
2019-02-05 23:21:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:21:24 [DEBUG   ] Finished updating board flags in 2.525 seconds
2019-02-05 23:21:44 [DEBUG   ] Finished updating ant stats in 0.950 seconds
2019-02-05 23:22:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 23:22:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:22:23 [WARNING ] (13, 1, 'bot')
2019-02-05 23:22:23 [WARNING ] (13, 1, 'bot')
2019-02-05 23:22:23 [WARNING ] (13, 1, 'bot')
2019-02-05 23:22:23 [WARNING ] (13, 1, 'bot')
2019-02-05 23:22:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:22:23 [DEBUG   ] Finished updating board flags in 1.345 seconds
2019-02-05 23:22:24 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-05 23:22:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-05 23:23:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 23:23:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:23:24 [DEBUG   ] Finished updating ant stats in 0.848 seconds
2019-02-05 23:23:24 [WARNING ] (13, 1, 'bot')
2019-02-05 23:23:24 [WARNING ] (13, 1, 'bot')
2019-02-05 23:23:24 [WARNING ] (13, 1, 'bot')
2019-02-05 23:23:24 [WARNING ] (13, 1, 'bot')
2019-02-05 23:23:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:23:24 [DEBUG   ] Finished updating board flags in 2.150 seconds
2019-02-05 23:23:44 [DEBUG   ] Finished updating ant stats in 0.760 seconds
2019-02-05 23:24:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 23:24:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:24:24 [DEBUG   ] Finished updating ant stats in 0.647 seconds
2019-02-05 23:24:24 [WARNING ] (13, 1, 'bot')
2019-02-05 23:24:24 [WARNING ] (13, 1, 'bot')
2019-02-05 23:24:24 [WARNING ] (13, 1, 'bot')
2019-02-05 23:24:24 [WARNING ] (13, 1, 'bot')
2019-02-05 23:24:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:24:24 [DEBUG   ] Finished updating board flags in 1.979 seconds
2019-02-05 23:24:44 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2019-02-05 23:24:59 [DEBUG   ] Got command RPT from MCS: ref #1414170
2019-02-05 23:24:59 [DEBUG   ] summary = ERROR
2019-02-05 23:24:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414170  13 58519 84299649 A  ERRORERROR'
2019-02-05 23:24:59 [DEBUG   ] Got command RPT from MCS: ref #1414171
2019-02-05 23:24:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 23:24:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414171  77 58519 84299853 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 23:25:00 [DEBUG   ] Got command RPT from MCS: ref #1414172
2019-02-05 23:25:00 [DEBUG   ] summary = ERROR
2019-02-05 23:25:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414172  13 58519 84300057 A  ERRORERROR'
2019-02-05 23:25:00 [DEBUG   ] Got command RPT from MCS: ref #1414174
2019-02-05 23:25:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 23:25:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414174  77 58519 84300249 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 23:25:00 [DEBUG   ] Got command RPT from MCS: ref #1414175
2019-02-05 23:25:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 23:25:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414175  12 58519 84300453 A  ERRORB™™š'
2019-02-05 23:25:04 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-02-05 23:25:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 23:25:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:25:24 [WARNING ] (13, 1, 'bot')
2019-02-05 23:25:24 [WARNING ] (13, 1, 'bot')
2019-02-05 23:25:24 [WARNING ] (13, 1, 'bot')
2019-02-05 23:25:24 [WARNING ] (13, 1, 'bot')
2019-02-05 23:25:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:25:24 [DEBUG   ] Finished updating board flags in 1.810 seconds
2019-02-05 23:25:25 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-02-05 23:25:45 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-05 23:26:05 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 23:26:12 [DEBUG   ] Got command RPT from MCS: ref #1414180
2019-02-05 23:26:12 [DEBUG   ] summary = ERROR
2019-02-05 23:26:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414180  13 58519 84372061 A  ERRORERROR'
2019-02-05 23:26:12 [DEBUG   ] Got command RPT from MCS: ref #1414181
2019-02-05 23:26:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 23:26:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414181  77 58519 84372062 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 23:26:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:26:24 [WARNING ] (13, 1, 'bot')
2019-02-05 23:26:24 [WARNING ] (13, 1, 'bot')
2019-02-05 23:26:24 [WARNING ] (13, 1, 'bot')
2019-02-05 23:26:24 [WARNING ] (13, 1, 'bot')
2019-02-05 23:26:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:26:24 [DEBUG   ] Finished updating board flags in 1.803 seconds
2019-02-05 23:26:25 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-05 23:26:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 23:27:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 23:27:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 23:27:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:27:24 [WARNING ] (13, 1, 'bot')
2019-02-05 23:27:24 [WARNING ] (13, 1, 'bot')
2019-02-05 23:27:24 [WARNING ] (13, 1, 'bot')
2019-02-05 23:27:24 [WARNING ] (13, 1, 'bot')
2019-02-05 23:27:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:27:24 [DEBUG   ] Finished updating board flags in 1.797 seconds
2019-02-05 23:27:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 23:27:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 23:28:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 23:28:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 23:28:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:28:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 23:28:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:28:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:28:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:28:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:28:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:28:25 [DEBUG   ] Finished updating board flags in 2.526 seconds
2019-02-05 23:28:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 23:29:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 23:29:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:29:24 [WARNING ] (13, 1, 'bot')
2019-02-05 23:29:24 [WARNING ] (13, 1, 'bot')
2019-02-05 23:29:24 [WARNING ] (13, 1, 'bot')
2019-02-05 23:29:24 [WARNING ] (13, 1, 'bot')
2019-02-05 23:29:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:29:24 [DEBUG   ] Finished updating board flags in 1.496 seconds
2019-02-05 23:29:25 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-02-05 23:29:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-05 23:29:59 [DEBUG   ] Got command RPT from MCS: ref #1414205
2019-02-05 23:29:59 [DEBUG   ] summary = ERROR
2019-02-05 23:29:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414205  13 58519 84599729 A  ERRORERROR'
2019-02-05 23:29:59 [DEBUG   ] Got command RPT from MCS: ref #1414206
2019-02-05 23:29:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 23:29:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414206  77 58519 84599933 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 23:30:00 [DEBUG   ] Got command RPT from MCS: ref #1414207
2019-02-05 23:30:00 [DEBUG   ] summary = ERROR
2019-02-05 23:30:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414207  13 58519 84600137 A  ERRORERROR'
2019-02-05 23:30:00 [DEBUG   ] Got command RPT from MCS: ref #1414208
2019-02-05 23:30:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 23:30:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414208  77 58519 84600329 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 23:30:00 [DEBUG   ] Got command RPT from MCS: ref #1414209
2019-02-05 23:30:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 23:30:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414209  12 58519 84600533 A  ERRORB˜™š'
2019-02-05 23:30:05 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-05 23:30:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 23:30:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-02-05 23:30:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:30:24 [WARNING ] (13, 1, 'bot')
2019-02-05 23:30:24 [WARNING ] (13, 1, 'bot')
2019-02-05 23:30:24 [WARNING ] (13, 1, 'bot')
2019-02-05 23:30:24 [WARNING ] (13, 1, 'bot')
2019-02-05 23:30:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:30:24 [DEBUG   ] Finished updating board flags in 1.496 seconds
2019-02-05 23:30:25 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-05 23:30:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-05 23:31:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 23:31:12 [DEBUG   ] Got command RPT from MCS: ref #1414210
2019-02-05 23:31:12 [DEBUG   ] summary = ERROR
2019-02-05 23:31:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414210  13 58519 84672069 A  ERRORERROR'
2019-02-05 23:31:12 [DEBUG   ] Got command RPT from MCS: ref #1414211
2019-02-05 23:31:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 23:31:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414211  77 58519 84672070 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 23:31:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:31:24 [WARNING ] (13, 1, 'bot')
2019-02-05 23:31:24 [WARNING ] (13, 1, 'bot')
2019-02-05 23:31:24 [WARNING ] (13, 1, 'bot')
2019-02-05 23:31:24 [WARNING ] (13, 1, 'bot')
2019-02-05 23:31:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:31:24 [DEBUG   ] Finished updating board flags in 1.473 seconds
2019-02-05 23:31:25 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-05 23:31:45 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-02-05 23:32:06 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-02-05 23:32:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:32:24 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-02-05 23:32:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-02-05 23:32:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-02-05 23:32:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:32:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:32:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:32:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:32:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:32:25 [DEBUG   ] Finished updating board flags in 2.231 seconds
2019-02-05 23:32:26 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-02-05 23:32:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 23:33:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 23:33:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 23:33:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:33:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-02-05 23:33:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:33:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:33:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:33:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:33:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:33:25 [DEBUG   ] Finished updating board flags in 2.219 seconds
2019-02-05 23:33:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 23:33:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 23:34:06 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-05 23:34:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:34:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 23:34:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-02-05 23:34:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:34:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:34:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:34:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:34:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:34:25 [DEBUG   ] Finished updating board flags in 2.209 seconds
2019-02-05 23:34:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 23:34:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 23:34:59 [DEBUG   ] Got command RPT from MCS: ref #1414233
2019-02-05 23:34:59 [DEBUG   ] summary = ERROR
2019-02-05 23:34:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414233  13 58519 84899809 A  ERRORERROR'
2019-02-05 23:35:00 [DEBUG   ] Got command RPT from MCS: ref #1414234
2019-02-05 23:35:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 23:35:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414234  77 58519 84900013 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 23:35:00 [DEBUG   ] Got command RPT from MCS: ref #1414235
2019-02-05 23:35:00 [DEBUG   ] summary = ERROR
2019-02-05 23:35:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414235  13 58519 84900217 A  ERRORERROR'
2019-02-05 23:35:00 [DEBUG   ] Got command RPT from MCS: ref #1414237
2019-02-05 23:35:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 23:35:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414237  77 58519 84900409 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 23:35:00 [DEBUG   ] Got command RPT from MCS: ref #1414239
2019-02-05 23:35:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 23:35:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414239  12 58519 84900613 A  ERRORB™™š'
2019-02-05 23:35:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 23:35:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:35:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:35:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:35:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:35:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:35:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:35:25 [DEBUG   ] Finished updating board flags in 2.251 seconds
2019-02-05 23:35:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 23:35:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 23:36:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 23:36:12 [DEBUG   ] Got command RPT from MCS: ref #1414247
2019-02-05 23:36:12 [DEBUG   ] summary = ERROR
2019-02-05 23:36:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414247  13 58519 84972061 A  ERRORERROR'
2019-02-05 23:36:12 [DEBUG   ] Got command RPT from MCS: ref #1414248
2019-02-05 23:36:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 23:36:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414248  77 58519 84972062 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 23:36:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:36:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:36:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:36:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:36:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:36:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:36:25 [DEBUG   ] Finished updating board flags in 2.147 seconds
2019-02-05 23:36:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 23:36:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 23:37:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 23:37:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-02-05 23:37:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:37:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-02-05 23:37:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-05 23:37:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-05 23:37:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:37:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:37:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:37:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:37:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:37:25 [DEBUG   ] Finished updating board flags in 1.989 seconds
2019-02-05 23:37:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 23:37:46 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 23:38:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 23:38:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:38:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:38:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:38:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:38:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:38:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:38:25 [DEBUG   ] Finished updating board flags in 1.818 seconds
2019-02-05 23:38:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 23:38:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 23:39:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 23:39:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:39:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:39:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:39:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:39:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:39:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:39:25 [DEBUG   ] Finished updating board flags in 1.766 seconds
2019-02-05 23:39:26 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-02-05 23:39:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 23:39:59 [DEBUG   ] Got command RPT from MCS: ref #1414268
2019-02-05 23:39:59 [DEBUG   ] summary = ERROR
2019-02-05 23:39:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414268  13 58519 85199897 A  ERRORERROR'
2019-02-05 23:40:00 [DEBUG   ] Got command RPT from MCS: ref #1414269
2019-02-05 23:40:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 23:40:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414269  77 58519 85200089 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 23:40:00 [DEBUG   ] Got command RPT from MCS: ref #1414270
2019-02-05 23:40:00 [DEBUG   ] summary = ERROR
2019-02-05 23:40:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414270  13 58519 85200293 A  ERRORERROR'
2019-02-05 23:40:00 [DEBUG   ] Got command RPT from MCS: ref #1414271
2019-02-05 23:40:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 23:40:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414271  77 58519 85200497 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 23:40:00 [DEBUG   ] Got command RPT from MCS: ref #1414272
2019-02-05 23:40:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 23:40:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414272  12 58519 85200689 A  ERRORBš™š'
2019-02-05 23:40:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 23:40:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:40:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:40:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:40:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:40:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:40:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:40:25 [DEBUG   ] Finished updating board flags in 1.619 seconds
2019-02-05 23:40:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 23:40:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 23:41:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 23:41:12 [DEBUG   ] Got command RPT from MCS: ref #1414273
2019-02-05 23:41:12 [DEBUG   ] summary = ERROR
2019-02-05 23:41:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414273  13 58519 85272073 A  ERRORERROR'
2019-02-05 23:41:12 [DEBUG   ] Got command RPT from MCS: ref #1414274
2019-02-05 23:41:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 23:41:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414274  77 58519 85272074 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 23:41:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 23:41:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:41:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:41:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:41:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:41:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:41:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:41:25 [DEBUG   ] Finished updating board flags in 1.649 seconds
2019-02-05 23:41:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 23:41:46 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 23:42:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 23:42:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 23:42:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:42:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:42:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:42:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:42:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:42:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:42:25 [DEBUG   ] Finished updating board flags in 1.544 seconds
2019-02-05 23:42:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 23:42:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 23:43:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 23:43:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 23:43:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:43:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:43:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:43:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:43:25 [WARNING ] (13, 1, 'bot')
2019-02-05 23:43:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:43:25 [DEBUG   ] Finished updating board flags in 1.526 seconds
2019-02-05 23:43:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 23:43:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 23:44:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 23:44:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 23:44:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:44:26 [WARNING ] (13, 1, 'bot')
2019-02-05 23:44:26 [WARNING ] (13, 1, 'bot')
2019-02-05 23:44:26 [WARNING ] (13, 1, 'bot')
2019-02-05 23:44:26 [WARNING ] (13, 1, 'bot')
2019-02-05 23:44:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:44:26 [DEBUG   ] Finished updating board flags in 1.587 seconds
2019-02-05 23:44:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 23:44:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 23:44:59 [DEBUG   ] Got command RPT from MCS: ref #1414300
2019-02-05 23:44:59 [DEBUG   ] summary = ERROR
2019-02-05 23:44:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414300  13 58519 85499973 A  ERRORERROR'
2019-02-05 23:45:00 [DEBUG   ] Got command RPT from MCS: ref #1414301
2019-02-05 23:45:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 23:45:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414301  77 58519 85500177 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 23:45:00 [DEBUG   ] Got command RPT from MCS: ref #1414302
2019-02-05 23:45:00 [DEBUG   ] summary = ERROR
2019-02-05 23:45:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414302  13 58519 85500369 A  ERRORERROR'
2019-02-05 23:45:00 [DEBUG   ] Got command RPT from MCS: ref #1414304
2019-02-05 23:45:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 23:45:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414304  77 58519 85500573 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 23:45:00 [DEBUG   ] Got command RPT from MCS: ref #1414305
2019-02-05 23:45:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 23:45:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414305  12 58519 85500777 A  ERRORBš™š'
2019-02-05 23:45:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 23:45:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:45:26 [DEBUG   ] Finished updating ant stats in 1.048 seconds
2019-02-05 23:45:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-02-05 23:45:26 [WARNING ] (13, 1, 'bot')
2019-02-05 23:45:26 [WARNING ] (13, 1, 'bot')
2019-02-05 23:45:26 [WARNING ] (13, 1, 'bot')
2019-02-05 23:45:26 [WARNING ] (13, 1, 'bot')
2019-02-05 23:45:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:45:26 [DEBUG   ] Finished updating board flags in 2.185 seconds
2019-02-05 23:45:46 [DEBUG   ] Finished updating ant stats in 0.960 seconds
2019-02-05 23:46:06 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-05 23:46:12 [DEBUG   ] Got command RPT from MCS: ref #1414310
2019-02-05 23:46:12 [DEBUG   ] summary = ERROR
2019-02-05 23:46:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414310  13 58519 85572069 A  ERRORERROR'
2019-02-05 23:46:12 [DEBUG   ] Got command RPT from MCS: ref #1414311
2019-02-05 23:46:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 23:46:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414311  77 58519 85572070 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 23:46:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:46:26 [DEBUG   ] Finished updating ant stats in 0.647 seconds
2019-02-05 23:46:26 [WARNING ] (13, 1, 'bot')
2019-02-05 23:46:26 [WARNING ] (13, 1, 'bot')
2019-02-05 23:46:26 [WARNING ] (13, 1, 'bot')
2019-02-05 23:46:26 [WARNING ] (13, 1, 'bot')
2019-02-05 23:46:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:46:26 [DEBUG   ] Finished updating board flags in 1.914 seconds
2019-02-05 23:46:46 [DEBUG   ] Finished updating ant stats in 0.559 seconds
2019-02-05 23:47:07 [DEBUG   ] Finished updating ant stats in 1.379 seconds
2019-02-05 23:47:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:47:26 [WARNING ] (13, 1, 'bot')
2019-02-05 23:47:26 [WARNING ] (13, 1, 'bot')
2019-02-05 23:47:26 [WARNING ] (13, 1, 'bot')
2019-02-05 23:47:26 [WARNING ] (13, 1, 'bot')
2019-02-05 23:47:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:47:26 [DEBUG   ] Finished updating board flags in 1.818 seconds
2019-02-05 23:47:27 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-02-05 23:47:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 23:48:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 23:48:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:48:26 [WARNING ] (13, 1, 'bot')
2019-02-05 23:48:26 [WARNING ] (13, 1, 'bot')
2019-02-05 23:48:26 [WARNING ] (13, 1, 'bot')
2019-02-05 23:48:26 [WARNING ] (13, 1, 'bot')
2019-02-05 23:48:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:48:26 [DEBUG   ] Finished updating board flags in 1.759 seconds
2019-02-05 23:48:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 23:48:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 23:49:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-05 23:49:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:49:26 [WARNING ] (13, 1, 'bot')
2019-02-05 23:49:26 [WARNING ] (13, 1, 'bot')
2019-02-05 23:49:26 [WARNING ] (13, 1, 'bot')
2019-02-05 23:49:26 [WARNING ] (13, 1, 'bot')
2019-02-05 23:49:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:49:26 [DEBUG   ] Finished updating board flags in 1.649 seconds
2019-02-05 23:49:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 23:49:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-05 23:50:00 [DEBUG   ] Got command RPT from MCS: ref #1414331
2019-02-05 23:50:00 [DEBUG   ] summary = ERROR
2019-02-05 23:50:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414331  13 58519 85800053 A  ERRORERROR'
2019-02-05 23:50:00 [DEBUG   ] Got command RPT from MCS: ref #1414332
2019-02-05 23:50:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 23:50:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414332  77 58519 85800257 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 23:50:00 [DEBUG   ] Got command RPT from MCS: ref #1414333
2019-02-05 23:50:00 [DEBUG   ] summary = ERROR
2019-02-05 23:50:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414333  13 58519 85800461 A  ERRORERROR'
2019-02-05 23:50:00 [DEBUG   ] Got command RPT from MCS: ref #1414334
2019-02-05 23:50:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 23:50:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414334  77 58519 85800653 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 23:50:00 [DEBUG   ] Got command RPT from MCS: ref #1414335
2019-02-05 23:50:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 23:50:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414335  12 58519 85800857 A  ERRORB™™š'
2019-02-05 23:50:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-05 23:50:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:50:26 [WARNING ] (13, 1, 'bot')
2019-02-05 23:50:26 [WARNING ] (13, 1, 'bot')
2019-02-05 23:50:26 [WARNING ] (13, 1, 'bot')
2019-02-05 23:50:26 [WARNING ] (13, 1, 'bot')
2019-02-05 23:50:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:50:26 [DEBUG   ] Finished updating board flags in 1.607 seconds
2019-02-05 23:50:27 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 23:50:47 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-02-05 23:51:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 23:51:12 [DEBUG   ] Got command RPT from MCS: ref #1414340
2019-02-05 23:51:12 [DEBUG   ] summary = ERROR
2019-02-05 23:51:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414340  13 58519 85872069 A  ERRORERROR'
2019-02-05 23:51:12 [DEBUG   ] Got command RPT from MCS: ref #1414341
2019-02-05 23:51:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 23:51:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414341  77 58519 85872070 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 23:51:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:51:26 [WARNING ] (13, 1, 'bot')
2019-02-05 23:51:26 [WARNING ] (13, 1, 'bot')
2019-02-05 23:51:26 [WARNING ] (13, 1, 'bot')
2019-02-05 23:51:26 [WARNING ] (13, 1, 'bot')
2019-02-05 23:51:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:51:26 [DEBUG   ] Finished updating board flags in 1.580 seconds
2019-02-05 23:51:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 23:51:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 23:52:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 23:52:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:52:26 [WARNING ] (13, 1, 'bot')
2019-02-05 23:52:26 [WARNING ] (13, 1, 'bot')
2019-02-05 23:52:26 [WARNING ] (13, 1, 'bot')
2019-02-05 23:52:26 [WARNING ] (13, 1, 'bot')
2019-02-05 23:52:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:52:26 [DEBUG   ] Finished updating board flags in 1.531 seconds
2019-02-05 23:52:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-05 23:52:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-05 23:53:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-05 23:53:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:53:26 [WARNING ] (13, 1, 'bot')
2019-02-05 23:53:26 [WARNING ] (13, 1, 'bot')
2019-02-05 23:53:26 [WARNING ] (13, 1, 'bot')
2019-02-05 23:53:26 [WARNING ] (13, 1, 'bot')
2019-02-05 23:53:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:53:26 [DEBUG   ] Finished updating board flags in 1.535 seconds
2019-02-05 23:53:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-05 23:53:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-05 23:54:07 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-05 23:54:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:54:27 [DEBUG   ] Finished updating ant stats in 1.047 seconds
2019-02-05 23:54:27 [WARNING ] (13, 1, 'bot')
2019-02-05 23:54:27 [WARNING ] (13, 1, 'bot')
2019-02-05 23:54:27 [WARNING ] (13, 1, 'bot')
2019-02-05 23:54:27 [WARNING ] (13, 1, 'bot')
2019-02-05 23:54:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:54:27 [DEBUG   ] Finished updating board flags in 2.226 seconds
2019-02-05 23:54:47 [DEBUG   ] Finished updating ant stats in 0.959 seconds
2019-02-05 23:55:00 [DEBUG   ] Got command RPT from MCS: ref #1414363
2019-02-05 23:55:00 [DEBUG   ] summary = ERROR
2019-02-05 23:55:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414363  13 58519 86100133 A  ERRORERROR'
2019-02-05 23:55:00 [DEBUG   ] Got command RPT from MCS: ref #1414364
2019-02-05 23:55:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 23:55:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414364  77 58519 86100337 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 23:55:00 [DEBUG   ] Got command RPT from MCS: ref #1414365
2019-02-05 23:55:00 [DEBUG   ] summary = ERROR
2019-02-05 23:55:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414365  13 58519 86100536 A  ERRORERROR'
2019-02-05 23:55:00 [DEBUG   ] Got command RPT from MCS: ref #1414367
2019-02-05 23:55:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 23:55:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414367  77 58519 86100737 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 23:55:00 [DEBUG   ] Got command RPT from MCS: ref #1414369
2019-02-05 23:55:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-05 23:55:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414369  12 58519 86100941 A  ERRORB˜™š'
2019-02-05 23:55:07 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-05 23:55:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:55:27 [DEBUG   ] Finished updating ant stats in 0.847 seconds
2019-02-05 23:55:27 [WARNING ] (13, 1, 'bot')
2019-02-05 23:55:27 [WARNING ] (13, 1, 'bot')
2019-02-05 23:55:27 [WARNING ] (13, 1, 'bot')
2019-02-05 23:55:27 [WARNING ] (13, 1, 'bot')
2019-02-05 23:55:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:55:27 [DEBUG   ] Finished updating board flags in 2.136 seconds
2019-02-05 23:55:47 [DEBUG   ] Finished updating ant stats in 0.759 seconds
2019-02-05 23:56:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-05 23:56:12 [DEBUG   ] Got command RPT from MCS: ref #1414373
2019-02-05 23:56:12 [DEBUG   ] summary = ERROR
2019-02-05 23:56:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414373  13 58519 86172065 A  ERRORERROR'
2019-02-05 23:56:12 [DEBUG   ] Got command RPT from MCS: ref #1414374
2019-02-05 23:56:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-05 23:56:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414374  77 58519 86172066 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-05 23:56:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:56:27 [DEBUG   ] Finished updating ant stats in 0.646 seconds
2019-02-05 23:56:27 [WARNING ] (13, 1, 'bot')
2019-02-05 23:56:27 [WARNING ] (13, 1, 'bot')
2019-02-05 23:56:27 [WARNING ] (13, 1, 'bot')
2019-02-05 23:56:27 [WARNING ] (13, 1, 'bot')
2019-02-05 23:56:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:56:27 [DEBUG   ] Finished updating board flags in 1.980 seconds
2019-02-05 23:56:47 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2019-02-05 23:57:07 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-02-05 23:57:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:57:27 [DEBUG   ] Finished updating ant stats in 0.446 seconds
2019-02-05 23:57:27 [WARNING ] (13, 1, 'bot')
2019-02-05 23:57:27 [WARNING ] (13, 1, 'bot')
2019-02-05 23:57:27 [WARNING ] (13, 1, 'bot')
2019-02-05 23:57:27 [WARNING ] (13, 1, 'bot')
2019-02-05 23:57:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:57:27 [DEBUG   ] Finished updating board flags in 1.823 seconds
2019-02-05 23:57:48 [DEBUG   ] Finished updating ant stats in 1.360 seconds
2019-02-05 23:58:08 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-05 23:58:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:58:27 [WARNING ] (13, 1, 'bot')
2019-02-05 23:58:27 [WARNING ] (13, 1, 'bot')
2019-02-05 23:58:27 [WARNING ] (13, 1, 'bot')
2019-02-05 23:58:27 [WARNING ] (13, 1, 'bot')
2019-02-05 23:58:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:58:27 [DEBUG   ] Finished updating board flags in 1.763 seconds
2019-02-05 23:58:28 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-02-05 23:58:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-05 23:59:08 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-05 23:59:26 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-05 23:59:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-05 23:59:27 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-05 23:59:27 [WARNING ] (13, 1, 'bot')
2019-02-05 23:59:27 [WARNING ] (13, 1, 'bot')
2019-02-05 23:59:27 [WARNING ] (13, 1, 'bot')
2019-02-05 23:59:27 [WARNING ] (13, 1, 'bot')
2019-02-05 23:59:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-05 23:59:27 [DEBUG   ] Finished updating board flags in 1.627 seconds
2019-02-05 23:59:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-05 23:59:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 00:00:00 [DEBUG   ] Got command RPT from MCS: ref #1414398
2019-02-06 00:00:00 [DEBUG   ] summary = ERROR
2019-02-06 00:00:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414398  13 58520      217 A  ERRORERROR'
2019-02-06 00:00:00 [DEBUG   ] Got command RPT from MCS: ref #1414399
2019-02-06 00:00:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 00:00:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414399  77 58520      421 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 00:00:00 [DEBUG   ] Got command RPT from MCS: ref #1414400
2019-02-06 00:00:00 [DEBUG   ] summary = ERROR
2019-02-06 00:00:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414400  13 58520      613 A  ERRORERROR'
2019-02-06 00:00:00 [DEBUG   ] Got command RPT from MCS: ref #1414401
2019-02-06 00:00:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 00:00:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414401  77 58520      817 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 00:00:01 [DEBUG   ] Got command RPT from MCS: ref #1414402
2019-02-06 00:00:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 00:00:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414402  12 58520     1021 A  ERRORB˜™š'
2019-02-06 00:00:08 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-06 00:00:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 00:00:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:00:27 [WARNING ] (13, 1, 'bot')
2019-02-06 00:00:27 [WARNING ] (13, 1, 'bot')
2019-02-06 00:00:27 [WARNING ] (13, 1, 'bot')
2019-02-06 00:00:27 [WARNING ] (13, 1, 'bot')
2019-02-06 00:00:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:00:27 [DEBUG   ] Finished updating board flags in 1.619 seconds
2019-02-06 00:00:28 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2019-02-06 00:00:48 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 00:01:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 00:01:12 [DEBUG   ] Got command RPT from MCS: ref #1414403
2019-02-06 00:01:12 [DEBUG   ] summary = ERROR
2019-02-06 00:01:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414403  13 58520    72073 A  ERRORERROR'
2019-02-06 00:01:12 [DEBUG   ] Got command RPT from MCS: ref #1414404
2019-02-06 00:01:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 00:01:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414404  77 58520    72074 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 00:01:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:01:27 [WARNING ] (13, 1, 'bot')
2019-02-06 00:01:27 [WARNING ] (13, 1, 'bot')
2019-02-06 00:01:27 [WARNING ] (13, 1, 'bot')
2019-02-06 00:01:27 [WARNING ] (13, 1, 'bot')
2019-02-06 00:01:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:01:27 [DEBUG   ] Finished updating board flags in 1.575 seconds
2019-02-06 00:01:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-06 00:01:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 00:02:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 00:02:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:02:27 [WARNING ] (13, 1, 'bot')
2019-02-06 00:02:27 [WARNING ] (13, 1, 'bot')
2019-02-06 00:02:27 [WARNING ] (13, 1, 'bot')
2019-02-06 00:02:27 [WARNING ] (13, 1, 'bot')
2019-02-06 00:02:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:02:27 [DEBUG   ] Finished updating board flags in 1.460 seconds
2019-02-06 00:02:28 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 00:02:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 00:03:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 00:03:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:03:28 [WARNING ] (13, 1, 'bot')
2019-02-06 00:03:28 [WARNING ] (13, 1, 'bot')
2019-02-06 00:03:28 [WARNING ] (13, 1, 'bot')
2019-02-06 00:03:28 [WARNING ] (13, 1, 'bot')
2019-02-06 00:03:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:03:28 [DEBUG   ] Finished updating board flags in 1.967 seconds
2019-02-06 00:03:28 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2019-02-06 00:03:48 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-02-06 00:04:08 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-06 00:04:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:04:28 [WARNING ] (13, 1, 'bot')
2019-02-06 00:04:28 [WARNING ] (13, 1, 'bot')
2019-02-06 00:04:28 [WARNING ] (13, 1, 'bot')
2019-02-06 00:04:28 [WARNING ] (13, 1, 'bot')
2019-02-06 00:04:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:04:28 [DEBUG   ] Finished updating board flags in 2.216 seconds
2019-02-06 00:04:29 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-02-06 00:04:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 00:05:00 [DEBUG   ] Got command RPT from MCS: ref #1414426
2019-02-06 00:05:00 [DEBUG   ] summary = ERROR
2019-02-06 00:05:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414426  13 58520   300297 A  ERRORERROR'
2019-02-06 00:05:00 [DEBUG   ] Got command RPT from MCS: ref #1414427
2019-02-06 00:05:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 00:05:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414427  77 58520   300501 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 00:05:00 [DEBUG   ] Got command RPT from MCS: ref #1414428
2019-02-06 00:05:00 [DEBUG   ] summary = ERROR
2019-02-06 00:05:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414428  13 58520   300693 A  ERRORERROR'
2019-02-06 00:05:00 [DEBUG   ] Got command RPT from MCS: ref #1414430
2019-02-06 00:05:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 00:05:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414430  77 58520   300897 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 00:05:01 [DEBUG   ] Got command RPT from MCS: ref #1414431
2019-02-06 00:05:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 00:05:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414431  12 58520   301101 A  ERRORB™™š'
2019-02-06 00:05:09 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-02-06 00:05:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 00:05:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:05:28 [WARNING ] (13, 1, 'bot')
2019-02-06 00:05:28 [WARNING ] (13, 1, 'bot')
2019-02-06 00:05:28 [WARNING ] (13, 1, 'bot')
2019-02-06 00:05:28 [WARNING ] (13, 1, 'bot')
2019-02-06 00:05:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:05:28 [DEBUG   ] Finished updating board flags in 2.222 seconds
2019-02-06 00:05:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 00:05:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 00:06:09 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-02-06 00:06:12 [DEBUG   ] Got command RPT from MCS: ref #1414440
2019-02-06 00:06:12 [DEBUG   ] summary = ERROR
2019-02-06 00:06:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414440  13 58520   372077 A  ERRORERROR'
2019-02-06 00:06:12 [DEBUG   ] Got command RPT from MCS: ref #1414441
2019-02-06 00:06:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 00:06:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414441  77 58520   372078 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 00:06:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:06:28 [WARNING ] (13, 1, 'bot')
2019-02-06 00:06:28 [WARNING ] (13, 1, 'bot')
2019-02-06 00:06:28 [WARNING ] (13, 1, 'bot')
2019-02-06 00:06:28 [WARNING ] (13, 1, 'bot')
2019-02-06 00:06:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:06:28 [DEBUG   ] Finished updating board flags in 2.173 seconds
2019-02-06 00:06:29 [DEBUG   ] Finished updating ant stats in 0.785 seconds
2019-02-06 00:06:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 00:07:09 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 00:07:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:07:28 [WARNING ] (13, 1, 'bot')
2019-02-06 00:07:28 [WARNING ] (13, 1, 'bot')
2019-02-06 00:07:28 [WARNING ] (13, 1, 'bot')
2019-02-06 00:07:28 [WARNING ] (13, 1, 'bot')
2019-02-06 00:07:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:07:28 [DEBUG   ] Finished updating board flags in 1.942 seconds
2019-02-06 00:07:29 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-02-06 00:07:49 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-06 00:08:09 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-06 00:08:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-02-06 00:08:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:08:28 [WARNING ] (13, 1, 'bot')
2019-02-06 00:08:28 [WARNING ] (13, 1, 'bot')
2019-02-06 00:08:28 [WARNING ] (13, 1, 'bot')
2019-02-06 00:08:28 [WARNING ] (13, 1, 'bot')
2019-02-06 00:08:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:08:28 [DEBUG   ] Finished updating board flags in 1.783 seconds
2019-02-06 00:08:30 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-02-06 00:08:50 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-06 00:09:10 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 00:09:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:09:28 [WARNING ] (13, 1, 'bot')
2019-02-06 00:09:28 [WARNING ] (13, 1, 'bot')
2019-02-06 00:09:28 [WARNING ] (13, 1, 'bot')
2019-02-06 00:09:28 [WARNING ] (13, 1, 'bot')
2019-02-06 00:09:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:09:28 [DEBUG   ] Finished updating board flags in 1.623 seconds
2019-02-06 00:09:30 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 00:09:50 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-06 00:10:00 [DEBUG   ] Got command RPT from MCS: ref #1414461
2019-02-06 00:10:00 [DEBUG   ] summary = ERROR
2019-02-06 00:10:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414461  13 58520   600385 A  ERRORERROR'
2019-02-06 00:10:00 [DEBUG   ] Got command RPT from MCS: ref #1414462
2019-02-06 00:10:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 00:10:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414462  77 58520   600577 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 00:10:00 [DEBUG   ] Got command RPT from MCS: ref #1414463
2019-02-06 00:10:00 [DEBUG   ] summary = ERROR
2019-02-06 00:10:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414463  13 58520   600781 A  ERRORERROR'
2019-02-06 00:10:00 [DEBUG   ] Got command RPT from MCS: ref #1414464
2019-02-06 00:10:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 00:10:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414464  77 58520   600985 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 00:10:01 [DEBUG   ] Got command RPT from MCS: ref #1414465
2019-02-06 00:10:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 00:10:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414465  12 58520   601177 A  ERRORBš™š'
2019-02-06 00:10:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 00:10:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:10:28 [WARNING ] (13, 1, 'bot')
2019-02-06 00:10:28 [WARNING ] (13, 1, 'bot')
2019-02-06 00:10:28 [WARNING ] (13, 1, 'bot')
2019-02-06 00:10:28 [WARNING ] (13, 1, 'bot')
2019-02-06 00:10:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:10:28 [DEBUG   ] Finished updating board flags in 1.596 seconds
2019-02-06 00:10:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 00:10:50 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 00:11:10 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-06 00:11:12 [DEBUG   ] Got command RPT from MCS: ref #1414466
2019-02-06 00:11:12 [DEBUG   ] summary = ERROR
2019-02-06 00:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414466  13 58520   672069 A  ERRORERROR'
2019-02-06 00:11:12 [DEBUG   ] Got command RPT from MCS: ref #1414467
2019-02-06 00:11:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 00:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414467  77 58520   672070 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 00:11:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:11:28 [WARNING ] (13, 1, 'bot')
2019-02-06 00:11:28 [WARNING ] (13, 1, 'bot')
2019-02-06 00:11:28 [WARNING ] (13, 1, 'bot')
2019-02-06 00:11:28 [WARNING ] (13, 1, 'bot')
2019-02-06 00:11:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:11:28 [DEBUG   ] Finished updating board flags in 1.466 seconds
2019-02-06 00:11:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 00:11:50 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 00:12:10 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 00:12:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:12:29 [WARNING ] (13, 1, 'bot')
2019-02-06 00:12:29 [WARNING ] (13, 1, 'bot')
2019-02-06 00:12:29 [WARNING ] (13, 1, 'bot')
2019-02-06 00:12:29 [WARNING ] (13, 1, 'bot')
2019-02-06 00:12:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:12:29 [DEBUG   ] Finished updating board flags in 2.397 seconds
2019-02-06 00:12:30 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-06 00:12:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 00:13:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 00:13:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 00:13:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:13:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-06 00:13:29 [WARNING ] (13, 1, 'bot')
2019-02-06 00:13:29 [WARNING ] (13, 1, 'bot')
2019-02-06 00:13:29 [WARNING ] (13, 1, 'bot')
2019-02-06 00:13:29 [WARNING ] (13, 1, 'bot')
2019-02-06 00:13:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:13:29 [DEBUG   ] Finished updating board flags in 2.174 seconds
2019-02-06 00:13:30 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 00:13:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 00:14:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 00:14:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:14:29 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-06 00:14:29 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-06 00:14:29 [WARNING ] (13, 1, 'bot')
2019-02-06 00:14:29 [WARNING ] (13, 1, 'bot')
2019-02-06 00:14:29 [WARNING ] (13, 1, 'bot')
2019-02-06 00:14:29 [WARNING ] (13, 1, 'bot')
2019-02-06 00:14:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:14:29 [DEBUG   ] Finished updating board flags in 2.052 seconds
2019-02-06 00:14:30 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 00:14:50 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 00:15:00 [DEBUG   ] Got command RPT from MCS: ref #1414493
2019-02-06 00:15:00 [DEBUG   ] summary = ERROR
2019-02-06 00:15:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414493  13 58520   900465 A  ERRORERROR'
2019-02-06 00:15:00 [DEBUG   ] Got command RPT from MCS: ref #1414494
2019-02-06 00:15:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 00:15:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414494  77 58520   900657 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 00:15:00 [DEBUG   ] Got command RPT from MCS: ref #1414495
2019-02-06 00:15:00 [DEBUG   ] summary = ERROR
2019-02-06 00:15:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414495  13 58520   900861 A  ERRORERROR'
2019-02-06 00:15:01 [DEBUG   ] Got command RPT from MCS: ref #1414497
2019-02-06 00:15:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 00:15:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414497  77 58520   901065 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 00:15:01 [DEBUG   ] Got command RPT from MCS: ref #1414499
2019-02-06 00:15:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 00:15:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414499  12 58520   901257 A  ERRORB™™š'
2019-02-06 00:15:10 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2019-02-06 00:15:28 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 00:15:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:15:29 [WARNING ] (13, 1, 'bot')
2019-02-06 00:15:29 [WARNING ] (13, 1, 'bot')
2019-02-06 00:15:29 [WARNING ] (13, 1, 'bot')
2019-02-06 00:15:29 [WARNING ] (13, 1, 'bot')
2019-02-06 00:15:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:15:29 [DEBUG   ] Finished updating board flags in 1.959 seconds
2019-02-06 00:15:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 00:15:50 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 00:16:10 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 00:16:12 [DEBUG   ] Got command RPT from MCS: ref #1414503
2019-02-06 00:16:12 [DEBUG   ] summary = ERROR
2019-02-06 00:16:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414503  13 58520   972081 A  ERRORERROR'
2019-02-06 00:16:12 [DEBUG   ] Got command RPT from MCS: ref #1414504
2019-02-06 00:16:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 00:16:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414504  77 58520   972082 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 00:16:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:16:29 [WARNING ] (13, 1, 'bot')
2019-02-06 00:16:29 [WARNING ] (13, 1, 'bot')
2019-02-06 00:16:29 [WARNING ] (13, 1, 'bot')
2019-02-06 00:16:29 [WARNING ] (13, 1, 'bot')
2019-02-06 00:16:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:16:29 [DEBUG   ] Finished updating board flags in 1.824 seconds
2019-02-06 00:16:30 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2019-02-06 00:16:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 00:17:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 00:17:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:17:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-06 00:17:29 [WARNING ] (13, 1, 'bot')
2019-02-06 00:17:29 [WARNING ] (13, 1, 'bot')
2019-02-06 00:17:29 [WARNING ] (13, 1, 'bot')
2019-02-06 00:17:29 [WARNING ] (13, 1, 'bot')
2019-02-06 00:17:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:17:29 [DEBUG   ] Finished updating board flags in 1.810 seconds
2019-02-06 00:17:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 00:17:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 00:18:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 00:18:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:18:29 [WARNING ] (13, 1, 'bot')
2019-02-06 00:18:29 [WARNING ] (13, 1, 'bot')
2019-02-06 00:18:29 [WARNING ] (13, 1, 'bot')
2019-02-06 00:18:29 [WARNING ] (13, 1, 'bot')
2019-02-06 00:18:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:18:29 [DEBUG   ] Finished updating board flags in 1.785 seconds
2019-02-06 00:18:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 00:18:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 00:19:10 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-06 00:19:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:19:29 [WARNING ] (13, 1, 'bot')
2019-02-06 00:19:29 [WARNING ] (13, 1, 'bot')
2019-02-06 00:19:29 [WARNING ] (13, 1, 'bot')
2019-02-06 00:19:29 [WARNING ] (13, 1, 'bot')
2019-02-06 00:19:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:19:29 [DEBUG   ] Finished updating board flags in 1.627 seconds
2019-02-06 00:19:30 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-06 00:19:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 00:20:00 [DEBUG   ] Got command RPT from MCS: ref #1414524
2019-02-06 00:20:00 [DEBUG   ] summary = ERROR
2019-02-06 00:20:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414524  13 58520  1200545 A  ERRORERROR'
2019-02-06 00:20:00 [DEBUG   ] Got command RPT from MCS: ref #1414525
2019-02-06 00:20:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 00:20:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414525  77 58520  1200749 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 00:20:00 [DEBUG   ] Got command RPT from MCS: ref #1414526
2019-02-06 00:20:00 [DEBUG   ] summary = ERROR
2019-02-06 00:20:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414526  13 58520  1200942 A  ERRORERROR'
2019-02-06 00:20:01 [DEBUG   ] Got command RPT from MCS: ref #1414527
2019-02-06 00:20:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 00:20:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414527  77 58520  1201149 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 00:20:01 [DEBUG   ] Got command RPT from MCS: ref #1414528
2019-02-06 00:20:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 00:20:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414528  12 58520  1201349 A  ERRORB˜™š'
2019-02-06 00:20:10 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 00:20:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:20:29 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-06 00:20:29 [WARNING ] (13, 1, 'bot')
2019-02-06 00:20:29 [WARNING ] (13, 1, 'bot')
2019-02-06 00:20:29 [WARNING ] (13, 1, 'bot')
2019-02-06 00:20:29 [WARNING ] (13, 1, 'bot')
2019-02-06 00:20:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:20:29 [DEBUG   ] Finished updating board flags in 1.535 seconds
2019-02-06 00:20:30 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-06 00:20:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 00:21:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 00:21:12 [DEBUG   ] Got command RPT from MCS: ref #1414533
2019-02-06 00:21:12 [DEBUG   ] summary = ERROR
2019-02-06 00:21:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414533  13 58520  1272077 A  ERRORERROR'
2019-02-06 00:21:12 [DEBUG   ] Got command RPT from MCS: ref #1414534
2019-02-06 00:21:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 00:21:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414534  77 58520  1272078 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 00:21:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:21:29 [WARNING ] (13, 1, 'bot')
2019-02-06 00:21:29 [WARNING ] (13, 1, 'bot')
2019-02-06 00:21:29 [WARNING ] (13, 1, 'bot')
2019-02-06 00:21:29 [WARNING ] (13, 1, 'bot')
2019-02-06 00:21:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:21:29 [DEBUG   ] Finished updating board flags in 1.466 seconds
2019-02-06 00:21:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 00:21:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 00:22:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 00:22:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:22:29 [WARNING ] (13, 1, 'bot')
2019-02-06 00:22:29 [WARNING ] (13, 1, 'bot')
2019-02-06 00:22:29 [WARNING ] (13, 1, 'bot')
2019-02-06 00:22:29 [WARNING ] (13, 1, 'bot')
2019-02-06 00:22:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:22:29 [DEBUG   ] Finished updating board flags in 1.549 seconds
2019-02-06 00:22:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 00:22:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 00:23:10 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-06 00:23:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:23:30 [DEBUG   ] Finished updating ant stats in 0.645 seconds
2019-02-06 00:23:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-06 00:23:30 [WARNING ] (13, 1, 'bot')
2019-02-06 00:23:30 [WARNING ] (13, 1, 'bot')
2019-02-06 00:23:30 [WARNING ] (13, 1, 'bot')
2019-02-06 00:23:30 [WARNING ] (13, 1, 'bot')
2019-02-06 00:23:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:23:30 [DEBUG   ] Finished updating board flags in 2.242 seconds
2019-02-06 00:23:50 [DEBUG   ] Finished updating ant stats in 0.559 seconds
2019-02-06 00:24:10 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-02-06 00:24:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:24:30 [WARNING ] (13, 1, 'bot')
2019-02-06 00:24:30 [WARNING ] (13, 1, 'bot')
2019-02-06 00:24:30 [WARNING ] (13, 1, 'bot')
2019-02-06 00:24:30 [WARNING ] (13, 1, 'bot')
2019-02-06 00:24:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:24:30 [DEBUG   ] Finished updating board flags in 2.224 seconds
2019-02-06 00:24:31 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-02-06 00:24:51 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-02-06 00:25:00 [DEBUG   ] Got command RPT from MCS: ref #1414556
2019-02-06 00:25:00 [DEBUG   ] summary = ERROR
2019-02-06 00:25:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414556  13 58520  1500618 A  ERRORERROR'
2019-02-06 00:25:00 [DEBUG   ] Got command RPT from MCS: ref #1414557
2019-02-06 00:25:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 00:25:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414557  77 58520  1500822 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 00:25:01 [DEBUG   ] Got command RPT from MCS: ref #1414558
2019-02-06 00:25:01 [DEBUG   ] summary = ERROR
2019-02-06 00:25:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414558  13 58520  1501026 A  ERRORERROR'
2019-02-06 00:25:01 [DEBUG   ] Got command RPT from MCS: ref #1414560
2019-02-06 00:25:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 00:25:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414560  77 58520  1501229 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 00:25:01 [DEBUG   ] Got command RPT from MCS: ref #1414561
2019-02-06 00:25:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 00:25:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414561  12 58520  1501422 A  ERRORB˜™š'
2019-02-06 00:25:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 00:25:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:25:30 [WARNING ] (13, 1, 'bot')
2019-02-06 00:25:30 [WARNING ] (13, 1, 'bot')
2019-02-06 00:25:30 [WARNING ] (13, 1, 'bot')
2019-02-06 00:25:30 [WARNING ] (13, 1, 'bot')
2019-02-06 00:25:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:25:30 [DEBUG   ] Finished updating board flags in 2.145 seconds
2019-02-06 00:25:31 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-06 00:25:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 00:26:11 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 00:26:12 [DEBUG   ] Got command RPT from MCS: ref #1414566
2019-02-06 00:26:12 [DEBUG   ] summary = ERROR
2019-02-06 00:26:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414566  13 58520  1572077 A  ERRORERROR'
2019-02-06 00:26:12 [DEBUG   ] Got command RPT from MCS: ref #1414567
2019-02-06 00:26:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 00:26:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414567  77 58520  1572078 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 00:26:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-02-06 00:26:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:26:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2019-02-06 00:26:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-06 00:26:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-06 00:26:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-06 00:26:30 [WARNING ] (13, 1, 'bot')
2019-02-06 00:26:30 [WARNING ] (13, 1, 'bot')
2019-02-06 00:26:30 [WARNING ] (13, 1, 'bot')
2019-02-06 00:26:30 [WARNING ] (13, 1, 'bot')
2019-02-06 00:26:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:26:30 [DEBUG   ] Finished updating board flags in 2.089 seconds
2019-02-06 00:26:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 00:26:51 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-06 00:27:11 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2019-02-06 00:27:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:27:30 [WARNING ] (13, 1, 'bot')
2019-02-06 00:27:30 [WARNING ] (13, 1, 'bot')
2019-02-06 00:27:30 [WARNING ] (13, 1, 'bot')
2019-02-06 00:27:30 [WARNING ] (13, 1, 'bot')
2019-02-06 00:27:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:27:30 [DEBUG   ] Finished updating board flags in 1.931 seconds
2019-02-06 00:27:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 00:27:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 00:28:11 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-06 00:28:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:28:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-06 00:28:30 [WARNING ] (13, 1, 'bot')
2019-02-06 00:28:30 [WARNING ] (13, 1, 'bot')
2019-02-06 00:28:30 [WARNING ] (13, 1, 'bot')
2019-02-06 00:28:30 [WARNING ] (13, 1, 'bot')
2019-02-06 00:28:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:28:30 [DEBUG   ] Finished updating board flags in 1.803 seconds
2019-02-06 00:28:31 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2019-02-06 00:28:51 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 00:29:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 00:29:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:29:30 [WARNING ] (13, 1, 'bot')
2019-02-06 00:29:30 [WARNING ] (13, 1, 'bot')
2019-02-06 00:29:30 [WARNING ] (13, 1, 'bot')
2019-02-06 00:29:30 [WARNING ] (13, 1, 'bot')
2019-02-06 00:29:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:29:30 [DEBUG   ] Finished updating board flags in 1.806 seconds
2019-02-06 00:29:31 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-06 00:29:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 00:30:00 [DEBUG   ] Got command RPT from MCS: ref #1414591
2019-02-06 00:30:00 [DEBUG   ] summary = ERROR
2019-02-06 00:30:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414591  13 58520  1800705 A  ERRORERROR'
2019-02-06 00:30:00 [DEBUG   ] Got command RPT from MCS: ref #1414592
2019-02-06 00:30:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 00:30:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414592  77 58520  1800897 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 00:30:01 [DEBUG   ] Got command RPT from MCS: ref #1414593
2019-02-06 00:30:01 [DEBUG   ] summary = ERROR
2019-02-06 00:30:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414593  13 58520  1801101 A  ERRORERROR'
2019-02-06 00:30:01 [DEBUG   ] Got command RPT from MCS: ref #1414594
2019-02-06 00:30:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 00:30:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414594  77 58520  1801305 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 00:30:01 [DEBUG   ] Got command RPT from MCS: ref #1414595
2019-02-06 00:30:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 00:30:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414595  12 58520  1801509 A  ERRORBš™š'
2019-02-06 00:30:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 00:30:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:30:30 [WARNING ] (13, 1, 'bot')
2019-02-06 00:30:30 [WARNING ] (13, 1, 'bot')
2019-02-06 00:30:30 [WARNING ] (13, 1, 'bot')
2019-02-06 00:30:30 [WARNING ] (13, 1, 'bot')
2019-02-06 00:30:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:30:30 [DEBUG   ] Finished updating board flags in 1.812 seconds
2019-02-06 00:30:31 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-06 00:30:51 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2019-02-06 00:31:12 [DEBUG   ] Got command RPT from MCS: ref #1414596
2019-02-06 00:31:12 [DEBUG   ] summary = ERROR
2019-02-06 00:31:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414596  13 58520  1872077 A  ERRORERROR'
2019-02-06 00:31:12 [DEBUG   ] Got command RPT from MCS: ref #1414597
2019-02-06 00:31:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 00:31:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414597  77 58520  1872078 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 00:31:12 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2019-02-06 00:31:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 00:31:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:31:30 [WARNING ] (13, 1, 'bot')
2019-02-06 00:31:30 [WARNING ] (13, 1, 'bot')
2019-02-06 00:31:30 [WARNING ] (13, 1, 'bot')
2019-02-06 00:31:30 [WARNING ] (13, 1, 'bot')
2019-02-06 00:31:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:31:30 [DEBUG   ] Finished updating board flags in 1.750 seconds
2019-02-06 00:31:32 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-06 00:31:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 00:32:12 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-06 00:32:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:32:30 [WARNING ] (13, 1, 'bot')
2019-02-06 00:32:30 [WARNING ] (13, 1, 'bot')
2019-02-06 00:32:30 [WARNING ] (13, 1, 'bot')
2019-02-06 00:32:30 [WARNING ] (13, 1, 'bot')
2019-02-06 00:32:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:32:30 [DEBUG   ] Finished updating board flags in 1.598 seconds
2019-02-06 00:32:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 00:32:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 00:33:12 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-06 00:33:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:33:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-02-06 00:33:30 [WARNING ] (13, 1, 'bot')
2019-02-06 00:33:30 [WARNING ] (13, 1, 'bot')
2019-02-06 00:33:30 [WARNING ] (13, 1, 'bot')
2019-02-06 00:33:30 [WARNING ] (13, 1, 'bot')
2019-02-06 00:33:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:33:30 [DEBUG   ] Finished updating board flags in 1.515 seconds
2019-02-06 00:33:32 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-06 00:33:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 00:34:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 00:34:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 00:34:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-02-06 00:34:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:34:30 [WARNING ] (13, 1, 'bot')
2019-02-06 00:34:30 [WARNING ] (13, 1, 'bot')
2019-02-06 00:34:30 [WARNING ] (13, 1, 'bot')
2019-02-06 00:34:30 [WARNING ] (13, 1, 'bot')
2019-02-06 00:34:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:34:30 [DEBUG   ] Finished updating board flags in 1.566 seconds
2019-02-06 00:34:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 00:34:52 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-06 00:35:00 [DEBUG   ] Got command RPT from MCS: ref #1414619
2019-02-06 00:35:00 [DEBUG   ] summary = ERROR
2019-02-06 00:35:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414619  13 58520  2100785 A  ERRORERROR'
2019-02-06 00:35:00 [DEBUG   ] Got command RPT from MCS: ref #1414620
2019-02-06 00:35:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 00:35:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414620  77 58520  2100977 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 00:35:01 [DEBUG   ] Got command RPT from MCS: ref #1414621
2019-02-06 00:35:01 [DEBUG   ] summary = ERROR
2019-02-06 00:35:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414621  13 58520  2101181 A  ERRORERROR'
2019-02-06 00:35:01 [DEBUG   ] Got command RPT from MCS: ref #1414622
2019-02-06 00:35:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 00:35:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414622  77 58520  2101385 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 00:35:01 [DEBUG   ] Got command RPT from MCS: ref #1414624
2019-02-06 00:35:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 00:35:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414624  12 58520  2101577 A  ERRORBš™š'
2019-02-06 00:35:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 00:35:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:35:31 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-06 00:35:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-02-06 00:35:31 [WARNING ] (13, 1, 'bot')
2019-02-06 00:35:31 [WARNING ] (13, 1, 'bot')
2019-02-06 00:35:31 [WARNING ] (13, 1, 'bot')
2019-02-06 00:35:31 [WARNING ] (13, 1, 'bot')
2019-02-06 00:35:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:35:31 [DEBUG   ] Finished updating board flags in 2.189 seconds
2019-02-06 00:35:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 00:35:52 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-06 00:36:12 [DEBUG   ] Got command RPT from MCS: ref #1414633
2019-02-06 00:36:12 [DEBUG   ] summary = ERROR
2019-02-06 00:36:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414633  13 58520  2172074 A  ERRORERROR'
2019-02-06 00:36:12 [DEBUG   ] Got command RPT from MCS: ref #1414634
2019-02-06 00:36:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 00:36:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414634  77 58520  2172074 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 00:36:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 00:36:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:36:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2019-02-06 00:36:31 [WARNING ] (13, 1, 'bot')
2019-02-06 00:36:31 [WARNING ] (13, 1, 'bot')
2019-02-06 00:36:31 [WARNING ] (13, 1, 'bot')
2019-02-06 00:36:31 [WARNING ] (13, 1, 'bot')
2019-02-06 00:36:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:36:31 [DEBUG   ] Finished updating board flags in 2.084 seconds
2019-02-06 00:36:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 00:36:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 00:37:12 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-06 00:37:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:37:31 [WARNING ] (13, 1, 'bot')
2019-02-06 00:37:31 [WARNING ] (13, 1, 'bot')
2019-02-06 00:37:31 [WARNING ] (13, 1, 'bot')
2019-02-06 00:37:31 [WARNING ] (13, 1, 'bot')
2019-02-06 00:37:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:37:31 [DEBUG   ] Finished updating board flags in 1.908 seconds
2019-02-06 00:37:32 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-06 00:37:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 00:38:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 00:38:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 00:38:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:38:31 [WARNING ] (13, 1, 'bot')
2019-02-06 00:38:31 [WARNING ] (13, 1, 'bot')
2019-02-06 00:38:31 [WARNING ] (13, 1, 'bot')
2019-02-06 00:38:31 [WARNING ] (13, 1, 'bot')
2019-02-06 00:38:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:38:31 [DEBUG   ] Finished updating board flags in 1.802 seconds
2019-02-06 00:38:32 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-06 00:38:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 00:39:12 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 00:39:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:39:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-02-06 00:39:31 [WARNING ] (13, 1, 'bot')
2019-02-06 00:39:31 [WARNING ] (13, 1, 'bot')
2019-02-06 00:39:31 [WARNING ] (13, 1, 'bot')
2019-02-06 00:39:31 [WARNING ] (13, 1, 'bot')
2019-02-06 00:39:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:39:31 [DEBUG   ] Finished updating board flags in 1.773 seconds
2019-02-06 00:39:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 00:39:52 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-06 00:40:00 [DEBUG   ] Got command RPT from MCS: ref #1414654
2019-02-06 00:40:00 [DEBUG   ] summary = ERROR
2019-02-06 00:40:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414654  13 58520  2400861 A  ERRORERROR'
2019-02-06 00:40:01 [DEBUG   ] Got command RPT from MCS: ref #1414655
2019-02-06 00:40:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 00:40:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414655  77 58520  2401065 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 00:40:01 [DEBUG   ] Got command RPT from MCS: ref #1414656
2019-02-06 00:40:01 [DEBUG   ] summary = ERROR
2019-02-06 00:40:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414656  13 58520  2401257 A  ERRORERROR'
2019-02-06 00:40:01 [DEBUG   ] Got command RPT from MCS: ref #1414657
2019-02-06 00:40:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 00:40:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414657  77 58520  2401461 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 00:40:01 [DEBUG   ] Got command RPT from MCS: ref #1414658
2019-02-06 00:40:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 00:40:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414658  12 58520  2401665 A  ERRORB™™š'
2019-02-06 00:40:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 00:40:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 00:40:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:40:31 [WARNING ] (13, 1, 'bot')
2019-02-06 00:40:31 [WARNING ] (13, 1, 'bot')
2019-02-06 00:40:31 [WARNING ] (13, 1, 'bot')
2019-02-06 00:40:31 [WARNING ] (13, 1, 'bot')
2019-02-06 00:40:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:40:31 [DEBUG   ] Finished updating board flags in 1.619 seconds
2019-02-06 00:40:32 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 00:40:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 00:41:12 [DEBUG   ] Got command RPT from MCS: ref #1414659
2019-02-06 00:41:12 [DEBUG   ] summary = ERROR
2019-02-06 00:41:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414659  13 58520  2472081 A  ERRORERROR'
2019-02-06 00:41:12 [DEBUG   ] Got command RPT from MCS: ref #1414660
2019-02-06 00:41:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 00:41:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414660  77 58520  2472082 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 00:41:12 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-06 00:41:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 00:41:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:41:31 [WARNING ] (13, 1, 'bot')
2019-02-06 00:41:31 [WARNING ] (13, 1, 'bot')
2019-02-06 00:41:31 [WARNING ] (13, 1, 'bot')
2019-02-06 00:41:31 [WARNING ] (13, 1, 'bot')
2019-02-06 00:41:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:41:31 [DEBUG   ] Finished updating board flags in 1.687 seconds
2019-02-06 00:41:32 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-06 00:41:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 00:42:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 00:42:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:42:31 [WARNING ] (13, 1, 'bot')
2019-02-06 00:42:31 [WARNING ] (13, 1, 'bot')
2019-02-06 00:42:31 [WARNING ] (13, 1, 'bot')
2019-02-06 00:42:31 [WARNING ] (13, 1, 'bot')
2019-02-06 00:42:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:42:31 [DEBUG   ] Finished updating board flags in 1.653 seconds
2019-02-06 00:42:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 00:42:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 00:43:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 00:43:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:43:31 [WARNING ] (13, 1, 'bot')
2019-02-06 00:43:31 [WARNING ] (13, 1, 'bot')
2019-02-06 00:43:31 [WARNING ] (13, 1, 'bot')
2019-02-06 00:43:31 [WARNING ] (13, 1, 'bot')
2019-02-06 00:43:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:43:31 [DEBUG   ] Finished updating board flags in 1.640 seconds
2019-02-06 00:43:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 00:43:52 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-06 00:44:12 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-06 00:44:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:44:31 [WARNING ] (13, 1, 'bot')
2019-02-06 00:44:31 [WARNING ] (13, 1, 'bot')
2019-02-06 00:44:31 [WARNING ] (13, 1, 'bot')
2019-02-06 00:44:31 [WARNING ] (13, 1, 'bot')
2019-02-06 00:44:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:44:31 [DEBUG   ] Finished updating board flags in 1.644 seconds
2019-02-06 00:44:32 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 00:44:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 00:45:00 [DEBUG   ] Got command RPT from MCS: ref #1414686
2019-02-06 00:45:00 [DEBUG   ] summary = ERROR
2019-02-06 00:45:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414686  13 58520  2700937 A  ERRORERROR'
2019-02-06 00:45:01 [DEBUG   ] Got command RPT from MCS: ref #1414687
2019-02-06 00:45:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 00:45:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414687  77 58520  2701141 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 00:45:01 [DEBUG   ] Got command RPT from MCS: ref #1414688
2019-02-06 00:45:01 [DEBUG   ] summary = ERROR
2019-02-06 00:45:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414688  13 58520  2701345 A  ERRORERROR'
2019-02-06 00:45:01 [DEBUG   ] Got command RPT from MCS: ref #1414689
2019-02-06 00:45:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 00:45:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414689  77 58520  2701549 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 00:45:01 [DEBUG   ] Got command RPT from MCS: ref #1414691
2019-02-06 00:45:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 00:45:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414691  12 58520  2701741 A  ERRORB˜™š'
2019-02-06 00:45:12 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-06 00:45:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:45:31 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-06 00:45:31 [WARNING ] (13, 1, 'bot')
2019-02-06 00:45:31 [WARNING ] (13, 1, 'bot')
2019-02-06 00:45:31 [WARNING ] (13, 1, 'bot')
2019-02-06 00:45:31 [WARNING ] (13, 1, 'bot')
2019-02-06 00:45:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:45:31 [DEBUG   ] Finished updating board flags in 1.654 seconds
2019-02-06 00:45:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 00:45:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 00:46:12 [DEBUG   ] Got command RPT from MCS: ref #1414696
2019-02-06 00:46:12 [DEBUG   ] summary = ERROR
2019-02-06 00:46:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414696  13 58520  2772085 A  ERRORERROR'
2019-02-06 00:46:12 [DEBUG   ] Got command RPT from MCS: ref #1414697
2019-02-06 00:46:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 00:46:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414697  77 58520  2772086 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 00:46:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 00:46:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:46:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:46:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:46:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:46:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:46:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:46:32 [DEBUG   ] Finished updating board flags in 1.677 seconds
2019-02-06 00:46:32 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-06 00:46:52 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-06 00:47:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 00:47:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 00:47:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:47:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-06 00:47:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:47:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:47:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:47:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:47:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:47:32 [DEBUG   ] Finished updating board flags in 1.717 seconds
2019-02-06 00:47:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 00:47:52 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-06 00:48:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 00:48:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:48:32 [DEBUG   ] Finished updating ant stats in 1.257 seconds
2019-02-06 00:48:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:48:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:48:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:48:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:48:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:48:32 [DEBUG   ] Finished updating board flags in 2.305 seconds
2019-02-06 00:48:52 [DEBUG   ] Finished updating ant stats in 1.146 seconds
2019-02-06 00:49:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 00:49:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:49:32 [DEBUG   ] Finished updating ant stats in 1.057 seconds
2019-02-06 00:49:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:49:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:49:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:49:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:49:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:49:32 [DEBUG   ] Finished updating board flags in 2.211 seconds
2019-02-06 00:49:52 [DEBUG   ] Finished updating ant stats in 0.947 seconds
2019-02-06 00:50:01 [DEBUG   ] Got command RPT from MCS: ref #1414717
2019-02-06 00:50:01 [DEBUG   ] summary = ERROR
2019-02-06 00:50:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414717  13 58520  3001025 A  ERRORERROR'
2019-02-06 00:50:01 [DEBUG   ] Got command RPT from MCS: ref #1414718
2019-02-06 00:50:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 00:50:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414718  77 58520  3001217 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 00:50:01 [DEBUG   ] Got command RPT from MCS: ref #1414719
2019-02-06 00:50:01 [DEBUG   ] summary = ERROR
2019-02-06 00:50:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414719  13 58520  3001421 A  ERRORERROR'
2019-02-06 00:50:01 [DEBUG   ] Got command RPT from MCS: ref #1414720
2019-02-06 00:50:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 00:50:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414720  77 58520  3001626 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 00:50:01 [DEBUG   ] Got command RPT from MCS: ref #1414721
2019-02-06 00:50:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 00:50:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414721  12 58520  3001829 A  ERRORB™™š'
2019-02-06 00:50:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 00:50:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:50:32 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-06 00:50:32 [DEBUG   ] Finished updating ant stats in 0.845 seconds
2019-02-06 00:50:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:50:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:50:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:50:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:50:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:50:32 [DEBUG   ] Finished updating board flags in 2.047 seconds
2019-02-06 00:50:52 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2019-02-06 00:51:12 [DEBUG   ] Got command RPT from MCS: ref #1414726
2019-02-06 00:51:12 [DEBUG   ] summary = ERROR
2019-02-06 00:51:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414726  13 58520  3072085 A  ERRORERROR'
2019-02-06 00:51:12 [DEBUG   ] Got command RPT from MCS: ref #1414727
2019-02-06 00:51:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 00:51:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414727  77 58520  3072086 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 00:51:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 00:51:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-02-06 00:51:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:51:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-06 00:51:32 [DEBUG   ] Finished updating ant stats in 0.647 seconds
2019-02-06 00:51:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:51:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:51:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:51:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:51:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:51:32 [DEBUG   ] Finished updating board flags in 2.027 seconds
2019-02-06 00:51:52 [DEBUG   ] Finished updating ant stats in 0.557 seconds
2019-02-06 00:52:12 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2019-02-06 00:52:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:52:32 [DEBUG   ] Finished updating ant stats in 0.447 seconds
2019-02-06 00:52:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:52:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:52:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:52:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:52:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:52:32 [DEBUG   ] Finished updating board flags in 1.965 seconds
2019-02-06 00:52:53 [DEBUG   ] Finished updating ant stats in 1.357 seconds
2019-02-06 00:53:13 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-06 00:53:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 00:53:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:53:32 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-06 00:53:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:53:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:53:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:53:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:53:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:53:32 [DEBUG   ] Finished updating board flags in 1.805 seconds
2019-02-06 00:53:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 00:53:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 00:54:13 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-06 00:54:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 00:54:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-02-06 00:54:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:54:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:54:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:54:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:54:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:54:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:54:32 [DEBUG   ] Finished updating board flags in 1.775 seconds
2019-02-06 00:54:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 00:54:53 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 00:55:01 [DEBUG   ] Got command RPT from MCS: ref #1414749
2019-02-06 00:55:01 [DEBUG   ] summary = ERROR
2019-02-06 00:55:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414749  13 58520  3301101 A  ERRORERROR'
2019-02-06 00:55:01 [DEBUG   ] Got command RPT from MCS: ref #1414750
2019-02-06 00:55:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 00:55:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414750  77 58520  3301305 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 00:55:01 [DEBUG   ] Got command RPT from MCS: ref #1414751
2019-02-06 00:55:01 [DEBUG   ] summary = ERROR
2019-02-06 00:55:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414751  13 58520  3301509 A  ERRORERROR'
2019-02-06 00:55:01 [DEBUG   ] Got command RPT from MCS: ref #1414753
2019-02-06 00:55:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 00:55:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414753  77 58520  3301701 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 00:55:01 [DEBUG   ] Got command RPT from MCS: ref #1414754
2019-02-06 00:55:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 00:55:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414754  12 58520  3301905 A  ERRORBš™š'
2019-02-06 00:55:13 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 00:55:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:55:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-06 00:55:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2019-02-06 00:55:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:55:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:55:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:55:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:55:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:55:32 [DEBUG   ] Finished updating board flags in 1.627 seconds
2019-02-06 00:55:33 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-06 00:55:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 00:56:12 [DEBUG   ] Got command RPT from MCS: ref #1414759
2019-02-06 00:56:12 [DEBUG   ] summary = ERROR
2019-02-06 00:56:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414759  13 58520  3372081 A  ERRORERROR'
2019-02-06 00:56:12 [DEBUG   ] Got command RPT from MCS: ref #1414760
2019-02-06 00:56:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 00:56:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414760  77 58520  3372082 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 00:56:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 00:56:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:56:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:56:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:56:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:56:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:56:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:56:32 [DEBUG   ] Finished updating board flags in 1.587 seconds
2019-02-06 00:56:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 00:56:53 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-06 00:57:13 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-06 00:57:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:57:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-06 00:57:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:57:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:57:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:57:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:57:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:57:32 [DEBUG   ] Finished updating board flags in 1.472 seconds
2019-02-06 00:57:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 00:57:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 00:58:13 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-06 00:58:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:58:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:58:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:58:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:58:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:58:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:58:32 [DEBUG   ] Finished updating board flags in 1.607 seconds
2019-02-06 00:58:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 00:58:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 00:59:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 00:59:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 00:59:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:59:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:59:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:59:32 [WARNING ] (13, 1, 'bot')
2019-02-06 00:59:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 00:59:32 [DEBUG   ] Finished updating board flags in 1.378 seconds
2019-02-06 00:59:33 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-06 00:59:53 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-06 01:00:01 [DEBUG   ] Got command RPT from MCS: ref #1414784
2019-02-06 01:00:01 [DEBUG   ] summary = ERROR
2019-02-06 01:00:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414784  13 58520  3601181 A  ERRORERROR'
2019-02-06 01:00:01 [DEBUG   ] Got command RPT from MCS: ref #1414785
2019-02-06 01:00:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 01:00:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414785  77 58520  3601385 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 01:00:01 [DEBUG   ] Got command RPT from MCS: ref #1414786
2019-02-06 01:00:01 [DEBUG   ] summary = ERROR
2019-02-06 01:00:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414786  13 58520  3601589 A  ERRORERROR'
2019-02-06 01:00:01 [DEBUG   ] Got command RPT from MCS: ref #1414787
2019-02-06 01:00:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 01:00:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414787  77 58520  3601785 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 01:00:01 [DEBUG   ] Got command RPT from MCS: ref #1414788
2019-02-06 01:00:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 01:00:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414788  12 58520  3601989 A  ERRORB™™š'
2019-02-06 01:00:13 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 01:00:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:00:33 [DEBUG   ] Finished updating ant stats in 1.043 seconds
2019-02-06 01:00:33 [WARNING ] (13, 1, 'bot')
2019-02-06 01:00:33 [WARNING ] (13, 1, 'bot')
2019-02-06 01:00:33 [WARNING ] (13, 1, 'bot')
2019-02-06 01:00:33 [WARNING ] (13, 1, 'bot')
2019-02-06 01:00:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:00:33 [DEBUG   ] Finished updating board flags in 2.177 seconds
2019-02-06 01:00:53 [DEBUG   ] Finished updating ant stats in 0.953 seconds
2019-02-06 01:01:12 [DEBUG   ] Got command RPT from MCS: ref #1414789
2019-02-06 01:01:12 [DEBUG   ] summary = ERROR
2019-02-06 01:01:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414789  13 58520  3672085 A  ERRORERROR'
2019-02-06 01:01:12 [DEBUG   ] Got command RPT from MCS: ref #1414790
2019-02-06 01:01:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 01:01:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414790  77 58520  3672086 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 01:01:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 01:01:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:01:33 [DEBUG   ] Finished updating ant stats in 0.847 seconds
2019-02-06 01:01:33 [WARNING ] (13, 1, 'bot')
2019-02-06 01:01:33 [WARNING ] (13, 1, 'bot')
2019-02-06 01:01:33 [WARNING ] (13, 1, 'bot')
2019-02-06 01:01:33 [WARNING ] (13, 1, 'bot')
2019-02-06 01:01:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:01:33 [DEBUG   ] Finished updating board flags in 2.008 seconds
2019-02-06 01:01:53 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2019-02-06 01:02:13 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-06 01:02:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:02:33 [DEBUG   ] Finished updating ant stats in 0.645 seconds
2019-02-06 01:02:33 [WARNING ] (13, 1, 'bot')
2019-02-06 01:02:33 [WARNING ] (13, 1, 'bot')
2019-02-06 01:02:33 [WARNING ] (13, 1, 'bot')
2019-02-06 01:02:33 [WARNING ] (13, 1, 'bot')
2019-02-06 01:02:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:02:33 [DEBUG   ] Finished updating board flags in 1.989 seconds
2019-02-06 01:02:53 [DEBUG   ] Finished updating ant stats in 0.559 seconds
2019-02-06 01:03:13 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-06 01:03:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 01:03:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:03:33 [WARNING ] (13, 1, 'bot')
2019-02-06 01:03:33 [WARNING ] (13, 1, 'bot')
2019-02-06 01:03:33 [WARNING ] (13, 1, 'bot')
2019-02-06 01:03:33 [WARNING ] (13, 1, 'bot')
2019-02-06 01:03:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:03:33 [DEBUG   ] Finished updating board flags in 1.818 seconds
2019-02-06 01:03:34 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2019-02-06 01:03:54 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-02-06 01:04:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-06 01:04:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:04:34 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 01:04:34 [WARNING ] (13, 1, 'bot')
2019-02-06 01:04:34 [WARNING ] (13, 1, 'bot')
2019-02-06 01:04:34 [WARNING ] (13, 1, 'bot')
2019-02-06 01:04:34 [WARNING ] (13, 1, 'bot')
2019-02-06 01:04:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:04:34 [DEBUG   ] Finished updating board flags in 2.889 seconds
2019-02-06 01:04:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 01:05:01 [DEBUG   ] Got command RPT from MCS: ref #1414812
2019-02-06 01:05:01 [DEBUG   ] summary = ERROR
2019-02-06 01:05:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414812  13 58520  3901262 A  ERRORERROR'
2019-02-06 01:05:01 [DEBUG   ] Got command RPT from MCS: ref #1414813
2019-02-06 01:05:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 01:05:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414813  77 58520  3901465 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 01:05:01 [DEBUG   ] Got command RPT from MCS: ref #1414814
2019-02-06 01:05:01 [DEBUG   ] summary = ERROR
2019-02-06 01:05:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414814  13 58520  3901669 A  ERRORERROR'
2019-02-06 01:05:01 [DEBUG   ] Got command RPT from MCS: ref #1414816
2019-02-06 01:05:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 01:05:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414816  77 58520  3901873 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 01:05:02 [DEBUG   ] Got command RPT from MCS: ref #1414818
2019-02-06 01:05:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 01:05:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414818  12 58520  3902065 A  ERRORB˜™š'
2019-02-06 01:05:14 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 01:05:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:05:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-06 01:05:33 [WARNING ] (13, 1, 'bot')
2019-02-06 01:05:33 [WARNING ] (13, 1, 'bot')
2019-02-06 01:05:33 [WARNING ] (13, 1, 'bot')
2019-02-06 01:05:33 [WARNING ] (13, 1, 'bot')
2019-02-06 01:05:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:05:33 [DEBUG   ] Finished updating board flags in 1.680 seconds
2019-02-06 01:05:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 01:05:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 01:06:12 [DEBUG   ] Got command RPT from MCS: ref #1414826
2019-02-06 01:06:12 [DEBUG   ] summary = ERROR
2019-02-06 01:06:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414826  13 58520  3972085 A  ERRORERROR'
2019-02-06 01:06:12 [DEBUG   ] Got command RPT from MCS: ref #1414827
2019-02-06 01:06:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 01:06:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414827  77 58520  3972086 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 01:06:14 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 01:06:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:06:33 [WARNING ] (13, 1, 'bot')
2019-02-06 01:06:33 [WARNING ] (13, 1, 'bot')
2019-02-06 01:06:33 [WARNING ] (13, 1, 'bot')
2019-02-06 01:06:33 [WARNING ] (13, 1, 'bot')
2019-02-06 01:06:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:06:33 [DEBUG   ] Finished updating board flags in 1.611 seconds
2019-02-06 01:06:34 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 01:06:54 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-06 01:07:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 01:07:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:07:33 [WARNING ] (13, 1, 'bot')
2019-02-06 01:07:33 [WARNING ] (13, 1, 'bot')
2019-02-06 01:07:33 [WARNING ] (13, 1, 'bot')
2019-02-06 01:07:33 [WARNING ] (13, 1, 'bot')
2019-02-06 01:07:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:07:33 [DEBUG   ] Finished updating board flags in 1.625 seconds
2019-02-06 01:07:34 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 01:07:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 01:08:00 [DEBUG   ] Got command TBN from MCS: ref #1414843
2019-02-06 01:08:00 [DEBUG   ] spawn_process: at 2019-02-06 01:08:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1549415281']
2019-02-06 01:08:00 [DEBUG   ] spawn_process: at 2019-02-06 01:08:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1549415281']
2019-02-06 01:08:00 [DEBUG   ] tbn = exited with status True, code 0x00
2019-02-06 01:08:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN  1414843   8 58520  4080385 A  ERROR'
2019-02-06 01:08:00 [DEBUG   ] spawn_process: at 2019-02-06 01:08:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1549415281']
2019-02-06 01:08:00 [DEBUG   ] spawn_process: at 2019-02-06 01:08:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1549415281']
2019-02-06 01:08:00 [DEBUG   ] spawn_process: at 2019-02-06 01:08:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1549415281']
2019-02-06 01:08:00 [DEBUG   ] spawn_process: at 2019-02-06 01:08:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1549415281']
2019-02-06 01:08:00 [DEBUG   ] spawn_process: at 2019-02-06 01:08:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1549415281']
2019-02-06 01:08:00 [DEBUG   ] spawn_process: at 2019-02-06 01:08:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1549415281']
2019-02-06 01:08:00 [DEBUG   ] spawn_process: at 2019-02-06 01:08:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1549415281']
2019-02-06 01:08:00 [DEBUG   ] spawn_process: at 2019-02-06 01:08:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1549415281']
2019-02-06 01:08:00 [DEBUG   ] spawn_process: at 2019-02-06 01:08:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1549415281']
2019-02-06 01:08:00 [DEBUG   ] spawn_process: at 2019-02-06 01:08:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1549415281']
2019-02-06 01:08:00 [DEBUG   ] spawn_process: at 2019-02-06 01:08:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1549415281']
2019-02-06 01:08:00 [DEBUG   ] spawn_process: at 2019-02-06 01:08:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1549415281']
2019-02-06 01:08:00 [DEBUG   ] spawn_process: at 2019-02-06 01:08:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1549415281']
2019-02-06 01:08:00 [DEBUG   ] spawn_process: at 2019-02-06 01:08:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1549415281']
2019-02-06 01:08:00 [DEBUG   ] spawn_process: at 2019-02-06 01:08:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1549415281']
2019-02-06 01:08:00 [DEBUG   ] spawn_process: at 2019-02-06 01:08:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1549415281']
2019-02-06 01:08:00 [DEBUG   ] spawn_process: at 2019-02-06 01:08:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1549415281']
2019-02-06 01:08:00 [DEBUG   ] spawn_process: at 2019-02-06 01:08:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1549415281']
2019-02-06 01:08:00 [DEBUG   ] spawn_process: at 2019-02-06 01:08:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1549415281']
2019-02-06 01:08:00 [DEBUG   ] spawn_process: at 2019-02-06 01:08:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1549415281']
2019-02-06 01:08:00 [DEBUG   ] spawn_process: at 2019-02-06 01:08:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1549415281']
2019-02-06 01:08:00 [DEBUG   ] spawn_process: at 2019-02-06 01:08:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1549415281']
2019-02-06 01:08:00 [DEBUG   ] spawn_process: at 2019-02-06 01:08:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1549415281']
2019-02-06 01:08:00 [DEBUG   ] spawn_process: at 2019-02-06 01:08:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1549415281']
2019-02-06 01:08:00 [INFO    ] Finished spawning TBN in 0.052 s
2019-02-06 01:08:14 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 01:08:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:08:33 [WARNING ] (13, 1, 'bot')
2019-02-06 01:08:33 [WARNING ] (13, 1, 'bot')
2019-02-06 01:08:33 [WARNING ] (13, 1, 'bot')
2019-02-06 01:08:33 [WARNING ] (13, 1, 'bot')
2019-02-06 01:08:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:08:33 [DEBUG   ] Finished updating board flags in 1.594 seconds
2019-02-06 01:08:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 01:08:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 01:09:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-06 01:09:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:09:33 [WARNING ] (13, 1, 'bot')
2019-02-06 01:09:33 [WARNING ] (13, 1, 'bot')
2019-02-06 01:09:33 [WARNING ] (13, 1, 'bot')
2019-02-06 01:09:33 [WARNING ] (13, 1, 'bot')
2019-02-06 01:09:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:09:33 [DEBUG   ] Finished updating board flags in 1.572 seconds
2019-02-06 01:09:34 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 01:09:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 01:10:01 [DEBUG   ] Got command RPT from MCS: ref #1414848
2019-02-06 01:10:01 [DEBUG   ] summary = ERROR
2019-02-06 01:10:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414848  13 58520  4201341 A  ERRORERROR'
2019-02-06 01:10:01 [DEBUG   ] Got command RPT from MCS: ref #1414849
2019-02-06 01:10:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 01:10:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414849  77 58520  4201545 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 01:10:01 [DEBUG   ] Got command RPT from MCS: ref #1414850
2019-02-06 01:10:01 [DEBUG   ] summary = ERROR
2019-02-06 01:10:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414850  13 58520  4201749 A  ERRORERROR'
2019-02-06 01:10:01 [DEBUG   ] Got command RPT from MCS: ref #1414851
2019-02-06 01:10:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 01:10:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414851  77 58520  4201953 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 01:10:02 [DEBUG   ] Got command RPT from MCS: ref #1414852
2019-02-06 01:10:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 01:10:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414852  12 58520  4202145 A  ERRORB˜™š'
2019-02-06 01:10:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 01:10:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:10:34 [DEBUG   ] Finished updating ant stats in 1.048 seconds
2019-02-06 01:10:34 [WARNING ] (13, 1, 'bot')
2019-02-06 01:10:34 [WARNING ] (13, 1, 'bot')
2019-02-06 01:10:34 [WARNING ] (13, 1, 'bot')
2019-02-06 01:10:34 [WARNING ] (13, 1, 'bot')
2019-02-06 01:10:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:10:34 [DEBUG   ] Finished updating board flags in 2.271 seconds
2019-02-06 01:10:54 [DEBUG   ] Finished updating ant stats in 0.956 seconds
2019-02-06 01:11:12 [DEBUG   ] Got command RPT from MCS: ref #1414853
2019-02-06 01:11:12 [DEBUG   ] summary = ERROR
2019-02-06 01:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414853  13 58520  4272085 A  ERRORERROR'
2019-02-06 01:11:12 [DEBUG   ] Got command RPT from MCS: ref #1414854
2019-02-06 01:11:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 01:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414854  77 58520  4272086 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 01:11:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 01:11:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:11:34 [DEBUG   ] Finished updating ant stats in 0.845 seconds
2019-02-06 01:11:34 [WARNING ] (13, 1, 'bot')
2019-02-06 01:11:34 [WARNING ] (13, 1, 'bot')
2019-02-06 01:11:34 [WARNING ] (13, 1, 'bot')
2019-02-06 01:11:34 [WARNING ] (13, 1, 'bot')
2019-02-06 01:11:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:11:34 [DEBUG   ] Finished updating board flags in 2.215 seconds
2019-02-06 01:11:54 [DEBUG   ] Finished updating ant stats in 0.757 seconds
2019-02-06 01:12:11 [DEBUG   ] Got command TBW from MCS: ref #1414875
2019-02-06 01:12:11 [DEBUG   ] tbw = exited with status True, code 0x00
2019-02-06 01:12:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW  1414875   8 58520  4331466 A  ERROR'
2019-02-06 01:12:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2019-02-06 01:12:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2019-02-06 01:12:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2019-02-06 01:12:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2019-02-06 01:12:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2019-02-06 01:12:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2019-02-06 01:12:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2019-02-06 01:12:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2019-02-06 01:12:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2019-02-06 01:12:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2019-02-06 01:12:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2019-02-06 01:12:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2019-02-06 01:12:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2019-02-06 01:12:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2019-02-06 01:12:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2019-02-06 01:12:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2019-02-06 01:12:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2019-02-06 01:12:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2019-02-06 01:12:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2019-02-06 01:12:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2019-02-06 01:12:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2019-02-06 01:12:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2019-02-06 01:12:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2019-02-06 01:12:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2019-02-06 01:12:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2019-02-06 01:12:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2019-02-06 01:12:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2019-02-06 01:12:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2019-02-06 01:12:14 [DEBUG   ] spawn_process: at 2019-02-06 01:12:14 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2019-02-06 01:12:14 [DEBUG   ] spawn_process: at 2019-02-06 01:12:14 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2019-02-06 01:12:14 [DEBUG   ] spawn_process: at 2019-02-06 01:12:14 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2019-02-06 01:12:14 [DEBUG   ] spawn_process: at 2019-02-06 01:12:14 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2019-02-06 01:12:14 [DEBUG   ] spawn_process: at 2019-02-06 01:12:14 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2019-02-06 01:12:14 [DEBUG   ] spawn_process: at 2019-02-06 01:12:14 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2019-02-06 01:12:14 [DEBUG   ] spawn_process: at 2019-02-06 01:12:14 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2019-02-06 01:12:14 [DEBUG   ] spawn_process: at 2019-02-06 01:12:14 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2019-02-06 01:12:14 [DEBUG   ] spawn_process: at 2019-02-06 01:12:14 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2019-02-06 01:12:14 [DEBUG   ] spawn_process: at 2019-02-06 01:12:14 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2019-02-06 01:12:14 [DEBUG   ] spawn_process: at 2019-02-06 01:12:14 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2019-02-06 01:12:14 [DEBUG   ] spawn_process: at 2019-02-06 01:12:14 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2019-02-06 01:12:14 [DEBUG   ] spawn_process: at 2019-02-06 01:12:14 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2019-02-06 01:12:14 [DEBUG   ] spawn_process: at 2019-02-06 01:12:14 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2019-02-06 01:12:14 [DEBUG   ] spawn_process: at 2019-02-06 01:12:14 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2019-02-06 01:12:15 [DEBUG   ] spawn_process: at 2019-02-06 01:12:15 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2019-02-06 01:12:15 [DEBUG   ] spawn_process: at 2019-02-06 01:12:15 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2019-02-06 01:12:15 [DEBUG   ] spawn_process: at 2019-02-06 01:12:15 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2019-02-06 01:12:15 [DEBUG   ] spawn_process: at 2019-02-06 01:12:15 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2019-02-06 01:12:15 [DEBUG   ] spawn_process: at 2019-02-06 01:12:15 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2019-02-06 01:12:15 [DEBUG   ] spawn_process: at 2019-02-06 01:12:15 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2019-02-06 01:12:15 [DEBUG   ] spawn_process: at 2019-02-06 01:12:15 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2019-02-06 01:12:15 [DEBUG   ] spawn_process: at 2019-02-06 01:12:15 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2019-02-06 01:12:15 [DEBUG   ] spawn_process: at 2019-02-06 01:12:15 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2019-02-06 01:12:15 [DEBUG   ] spawn_process: at 2019-02-06 01:12:15 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2019-02-06 01:12:15 [DEBUG   ] spawn_process: at 2019-02-06 01:12:15 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2019-02-06 01:12:15 [INFO    ] Finished spawning TBW
2019-02-06 01:12:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:12:34 [WARNING ] (13, 1, 'bot')
2019-02-06 01:12:34 [WARNING ] (13, 1, 'bot')
2019-02-06 01:12:34 [WARNING ] (13, 1, 'bot')
2019-02-06 01:12:34 [WARNING ] (13, 1, 'bot')
2019-02-06 01:12:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:12:34 [DEBUG   ] Finished updating board flags in 1.917 seconds
2019-02-06 01:13:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:13:34 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-06 01:13:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-06 01:13:34 [WARNING ] (13, 1, 'bot')
2019-02-06 01:13:34 [WARNING ] (13, 1, 'bot')
2019-02-06 01:13:34 [WARNING ] (13, 1, 'bot')
2019-02-06 01:13:34 [WARNING ] (13, 1, 'bot')
2019-02-06 01:13:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:13:34 [DEBUG   ] Finished updating board flags in 1.940 seconds
2019-02-06 01:14:03 [INFO    ] __waitForTBW - TBW finished in 108.898 s
2019-02-06 01:14:04 [DEBUG   ] Finished updating ant stats in 0.376 seconds
2019-02-06 01:14:04 [INFO    ] Started antennas statistics background thread
2019-02-06 01:14:04 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2019-02-06 01:14:04 [DEBUG   ] spawn_process: at 2019-02-06 01:14:04 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1549415646']
2019-02-06 01:14:04 [DEBUG   ] spawn_process: at 2019-02-06 01:14:04 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1549415646']
2019-02-06 01:14:04 [DEBUG   ] spawn_process: at 2019-02-06 01:14:04 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1549415646']
2019-02-06 01:14:04 [DEBUG   ] spawn_process: at 2019-02-06 01:14:04 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1549415646']
2019-02-06 01:14:04 [DEBUG   ] spawn_process: at 2019-02-06 01:14:04 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1549415646']
2019-02-06 01:14:04 [DEBUG   ] spawn_process: at 2019-02-06 01:14:04 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1549415646']
2019-02-06 01:14:04 [DEBUG   ] spawn_process: at 2019-02-06 01:14:04 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1549415646']
2019-02-06 01:14:04 [DEBUG   ] spawn_process: at 2019-02-06 01:14:04 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1549415646']
2019-02-06 01:14:04 [DEBUG   ] spawn_process: at 2019-02-06 01:14:04 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1549415646']
2019-02-06 01:14:04 [DEBUG   ] spawn_process: at 2019-02-06 01:14:04 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1549415646']
2019-02-06 01:14:04 [DEBUG   ] spawn_process: at 2019-02-06 01:14:04 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1549415646']
2019-02-06 01:14:04 [DEBUG   ] spawn_process: at 2019-02-06 01:14:04 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1549415646']
2019-02-06 01:14:04 [DEBUG   ] spawn_process: at 2019-02-06 01:14:04 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1549415646']
2019-02-06 01:14:04 [DEBUG   ] spawn_process: at 2019-02-06 01:14:04 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1549415646']
2019-02-06 01:14:04 [DEBUG   ] spawn_process: at 2019-02-06 01:14:04 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1549415646']
2019-02-06 01:14:04 [DEBUG   ] spawn_process: at 2019-02-06 01:14:04 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1549415646']
2019-02-06 01:14:04 [DEBUG   ] spawn_process: at 2019-02-06 01:14:04 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1549415646']
2019-02-06 01:14:04 [DEBUG   ] spawn_process: at 2019-02-06 01:14:04 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1549415646']
2019-02-06 01:14:04 [DEBUG   ] spawn_process: at 2019-02-06 01:14:04 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1549415646']
2019-02-06 01:14:04 [DEBUG   ] spawn_process: at 2019-02-06 01:14:04 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1549415646']
2019-02-06 01:14:04 [DEBUG   ] spawn_process: at 2019-02-06 01:14:04 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1549415646']
2019-02-06 01:14:04 [DEBUG   ] spawn_process: at 2019-02-06 01:14:04 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1549415646']
2019-02-06 01:14:04 [DEBUG   ] spawn_process: at 2019-02-06 01:14:04 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1549415646']
2019-02-06 01:14:04 [DEBUG   ] spawn_process: at 2019-02-06 01:14:04 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1549415646']
2019-02-06 01:14:04 [DEBUG   ] spawn_process: at 2019-02-06 01:14:04 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1549415646']
2019-02-06 01:14:04 [DEBUG   ] spawn_process: at 2019-02-06 01:14:04 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1549415646']
2019-02-06 01:14:04 [INFO    ] Finished spawning TBN in 0.052 s
2019-02-06 01:14:25 [DEBUG   ] Finished updating ant stats in 1.270 seconds
2019-02-06 01:14:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:14:34 [WARNING ] (13, 1, 'bot')
2019-02-06 01:14:34 [WARNING ] (13, 1, 'bot')
2019-02-06 01:14:34 [WARNING ] (13, 1, 'bot')
2019-02-06 01:14:34 [WARNING ] (13, 1, 'bot')
2019-02-06 01:14:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:14:34 [DEBUG   ] Finished updating board flags in 1.972 seconds
2019-02-06 01:14:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 01:15:01 [DEBUG   ] Got command RPT from MCS: ref #1414889
2019-02-06 01:15:01 [DEBUG   ] summary = ERROR
2019-02-06 01:15:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414889  13 58520  4501433 A  ERRORERROR'
2019-02-06 01:15:01 [DEBUG   ] Got command RPT from MCS: ref #1414890
2019-02-06 01:15:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 01:15:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414890  77 58520  4501625 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 01:15:01 [DEBUG   ] Got command RPT from MCS: ref #1414891
2019-02-06 01:15:01 [DEBUG   ] summary = ERROR
2019-02-06 01:15:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414891  13 58520  4501829 A  ERRORERROR'
2019-02-06 01:15:02 [DEBUG   ] Got command RPT from MCS: ref #1414893
2019-02-06 01:15:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 01:15:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414893  77 58520  4502033 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 01:15:02 [DEBUG   ] Got command RPT from MCS: ref #1414894
2019-02-06 01:15:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 01:15:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414894  12 58520  4502237 A  ERRORB™™š'
2019-02-06 01:15:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 01:15:25 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-06 01:15:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:15:34 [WARNING ] (13, 1, 'bot')
2019-02-06 01:15:34 [WARNING ] (13, 1, 'bot')
2019-02-06 01:15:34 [WARNING ] (13, 1, 'bot')
2019-02-06 01:15:34 [WARNING ] (13, 1, 'bot')
2019-02-06 01:15:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:15:34 [DEBUG   ] Finished updating board flags in 1.653 seconds
2019-02-06 01:15:45 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2019-02-06 01:16:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 01:16:12 [DEBUG   ] Got command RPT from MCS: ref #1414899
2019-02-06 01:16:12 [DEBUG   ] summary = ERROR
2019-02-06 01:16:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414899  13 58520  4572089 A  ERRORERROR'
2019-02-06 01:16:12 [DEBUG   ] Got command RPT from MCS: ref #1414900
2019-02-06 01:16:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 01:16:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414900  77 58520  4572090 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 01:16:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 01:16:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 01:16:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:16:34 [WARNING ] (13, 1, 'bot')
2019-02-06 01:16:34 [WARNING ] (13, 1, 'bot')
2019-02-06 01:16:34 [WARNING ] (13, 1, 'bot')
2019-02-06 01:16:34 [WARNING ] (13, 1, 'bot')
2019-02-06 01:16:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:16:34 [DEBUG   ] Finished updating board flags in 1.615 seconds
2019-02-06 01:16:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 01:17:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 01:17:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 01:17:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:17:34 [WARNING ] (13, 1, 'bot')
2019-02-06 01:17:34 [WARNING ] (13, 1, 'bot')
2019-02-06 01:17:34 [WARNING ] (13, 1, 'bot')
2019-02-06 01:17:34 [WARNING ] (13, 1, 'bot')
2019-02-06 01:17:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:17:34 [DEBUG   ] Finished updating board flags in 1.607 seconds
2019-02-06 01:17:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 01:18:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-06 01:18:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 01:18:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:18:34 [WARNING ] (13, 1, 'bot')
2019-02-06 01:18:34 [WARNING ] (13, 1, 'bot')
2019-02-06 01:18:34 [WARNING ] (13, 1, 'bot')
2019-02-06 01:18:34 [WARNING ] (13, 1, 'bot')
2019-02-06 01:18:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:18:34 [DEBUG   ] Finished updating board flags in 1.597 seconds
2019-02-06 01:18:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 01:19:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 01:19:25 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-06 01:19:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 01:19:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:19:34 [WARNING ] (13, 1, 'bot')
2019-02-06 01:19:34 [WARNING ] (13, 1, 'bot')
2019-02-06 01:19:34 [WARNING ] (13, 1, 'bot')
2019-02-06 01:19:34 [WARNING ] (13, 1, 'bot')
2019-02-06 01:19:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:19:34 [DEBUG   ] Finished updating board flags in 1.399 seconds
2019-02-06 01:19:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 01:20:01 [DEBUG   ] Got command RPT from MCS: ref #1414920
2019-02-06 01:20:01 [DEBUG   ] summary = ERROR
2019-02-06 01:20:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414920  13 58520  4801513 A  ERRORERROR'
2019-02-06 01:20:01 [DEBUG   ] Got command RPT from MCS: ref #1414921
2019-02-06 01:20:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 01:20:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414921  77 58520  4801717 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 01:20:01 [DEBUG   ] Got command RPT from MCS: ref #1414922
2019-02-06 01:20:01 [DEBUG   ] summary = ERROR
2019-02-06 01:20:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414922  13 58520  4801909 A  ERRORERROR'
2019-02-06 01:20:02 [DEBUG   ] Got command RPT from MCS: ref #1414923
2019-02-06 01:20:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 01:20:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414923  77 58520  4802113 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 01:20:02 [DEBUG   ] Got command RPT from MCS: ref #1414924
2019-02-06 01:20:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 01:20:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414924  12 58520  4802318 A  ERRORB—™š'
2019-02-06 01:20:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 01:20:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 01:20:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:20:34 [WARNING ] (13, 1, 'bot')
2019-02-06 01:20:34 [WARNING ] (13, 1, 'bot')
2019-02-06 01:20:34 [WARNING ] (13, 1, 'bot')
2019-02-06 01:20:34 [WARNING ] (13, 1, 'bot')
2019-02-06 01:20:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:20:34 [DEBUG   ] Finished updating board flags in 1.455 seconds
2019-02-06 01:20:45 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-06 01:21:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-06 01:21:12 [DEBUG   ] Got command RPT from MCS: ref #1414929
2019-02-06 01:21:12 [DEBUG   ] summary = ERROR
2019-02-06 01:21:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414929  13 58520  4872093 A  ERRORERROR'
2019-02-06 01:21:12 [DEBUG   ] Got command RPT from MCS: ref #1414930
2019-02-06 01:21:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 01:21:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414930  77 58520  4872094 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 01:21:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 01:21:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 01:21:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:21:35 [WARNING ] (13, 1, 'bot')
2019-02-06 01:21:35 [WARNING ] (13, 1, 'bot')
2019-02-06 01:21:35 [WARNING ] (13, 1, 'bot')
2019-02-06 01:21:35 [WARNING ] (13, 1, 'bot')
2019-02-06 01:21:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:21:35 [DEBUG   ] Finished updating board flags in 2.253 seconds
2019-02-06 01:21:45 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-02-06 01:22:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 01:22:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 01:22:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:22:35 [WARNING ] (13, 1, 'bot')
2019-02-06 01:22:35 [WARNING ] (13, 1, 'bot')
2019-02-06 01:22:35 [WARNING ] (13, 1, 'bot')
2019-02-06 01:22:35 [WARNING ] (13, 1, 'bot')
2019-02-06 01:22:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:22:35 [DEBUG   ] Finished updating board flags in 2.095 seconds
2019-02-06 01:22:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 01:23:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 01:23:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 01:23:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:23:35 [WARNING ] (13, 1, 'bot')
2019-02-06 01:23:35 [WARNING ] (13, 1, 'bot')
2019-02-06 01:23:35 [WARNING ] (13, 1, 'bot')
2019-02-06 01:23:35 [WARNING ] (13, 1, 'bot')
2019-02-06 01:23:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:23:35 [DEBUG   ] Finished updating board flags in 2.033 seconds
2019-02-06 01:23:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 01:24:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 01:24:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 01:24:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:24:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-06 01:24:35 [WARNING ] (13, 1, 'bot')
2019-02-06 01:24:35 [WARNING ] (13, 1, 'bot')
2019-02-06 01:24:35 [WARNING ] (13, 1, 'bot')
2019-02-06 01:24:35 [WARNING ] (13, 1, 'bot')
2019-02-06 01:24:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:24:35 [DEBUG   ] Finished updating board flags in 2.019 seconds
2019-02-06 01:24:45 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-06 01:25:01 [DEBUG   ] Got command RPT from MCS: ref #1414952
2019-02-06 01:25:01 [DEBUG   ] summary = ERROR
2019-02-06 01:25:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414952  13 58520  5101589 A  ERRORERROR'
2019-02-06 01:25:01 [DEBUG   ] Got command RPT from MCS: ref #1414953
2019-02-06 01:25:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 01:25:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414953  77 58520  5101793 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 01:25:01 [DEBUG   ] Got command RPT from MCS: ref #1414954
2019-02-06 01:25:01 [DEBUG   ] summary = ERROR
2019-02-06 01:25:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414954  13 58520  5101997 A  ERRORERROR'
2019-02-06 01:25:02 [DEBUG   ] Got command RPT from MCS: ref #1414956
2019-02-06 01:25:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 01:25:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414956  77 58520  5102189 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 01:25:02 [DEBUG   ] Got command RPT from MCS: ref #1414957
2019-02-06 01:25:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 01:25:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414957  12 58520  5102393 A  ERRORB˜™š'
2019-02-06 01:25:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 01:25:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 01:25:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:25:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-06 01:25:35 [WARNING ] (13, 1, 'bot')
2019-02-06 01:25:35 [WARNING ] (13, 1, 'bot')
2019-02-06 01:25:35 [WARNING ] (13, 1, 'bot')
2019-02-06 01:25:35 [WARNING ] (13, 1, 'bot')
2019-02-06 01:25:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:25:35 [DEBUG   ] Finished updating board flags in 1.980 seconds
2019-02-06 01:25:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 01:26:05 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-06 01:26:12 [DEBUG   ] Got command RPT from MCS: ref #1414962
2019-02-06 01:26:12 [DEBUG   ] summary = ERROR
2019-02-06 01:26:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414962  13 58520  5172085 A  ERRORERROR'
2019-02-06 01:26:12 [DEBUG   ] Got command RPT from MCS: ref #1414963
2019-02-06 01:26:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 01:26:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414963  77 58520  5172086 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 01:26:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-06 01:26:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:26:35 [WARNING ] (13, 1, 'bot')
2019-02-06 01:26:35 [WARNING ] (13, 1, 'bot')
2019-02-06 01:26:35 [WARNING ] (13, 1, 'bot')
2019-02-06 01:26:35 [WARNING ] (13, 1, 'bot')
2019-02-06 01:26:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:26:35 [DEBUG   ] Finished updating board flags in 1.881 seconds
2019-02-06 01:26:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 01:27:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 01:27:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-06 01:27:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:27:35 [WARNING ] (13, 1, 'bot')
2019-02-06 01:27:35 [WARNING ] (13, 1, 'bot')
2019-02-06 01:27:35 [WARNING ] (13, 1, 'bot')
2019-02-06 01:27:35 [WARNING ] (13, 1, 'bot')
2019-02-06 01:27:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:27:35 [DEBUG   ] Finished updating board flags in 1.714 seconds
2019-02-06 01:27:45 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-06 01:28:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 01:28:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 01:28:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:28:35 [WARNING ] (13, 1, 'bot')
2019-02-06 01:28:35 [WARNING ] (13, 1, 'bot')
2019-02-06 01:28:35 [WARNING ] (13, 1, 'bot')
2019-02-06 01:28:35 [WARNING ] (13, 1, 'bot')
2019-02-06 01:28:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:28:35 [DEBUG   ] Finished updating board flags in 1.619 seconds
2019-02-06 01:28:45 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-06 01:29:05 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-06 01:29:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 01:29:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:29:35 [WARNING ] (13, 1, 'bot')
2019-02-06 01:29:35 [WARNING ] (13, 1, 'bot')
2019-02-06 01:29:35 [WARNING ] (13, 1, 'bot')
2019-02-06 01:29:35 [WARNING ] (13, 1, 'bot')
2019-02-06 01:29:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:29:35 [DEBUG   ] Finished updating board flags in 1.616 seconds
2019-02-06 01:29:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 01:30:01 [DEBUG   ] Got command RPT from MCS: ref #1414997
2019-02-06 01:30:01 [DEBUG   ] summary = ERROR
2019-02-06 01:30:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414997  13 58520  5401669 A  ERRORERROR'
2019-02-06 01:30:01 [DEBUG   ] Got command RPT from MCS: ref #1414998
2019-02-06 01:30:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 01:30:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414998  77 58520  5401873 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 01:30:02 [DEBUG   ] Got command RPT from MCS: ref #1414999
2019-02-06 01:30:02 [DEBUG   ] summary = ERROR
2019-02-06 01:30:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1414999  13 58520  5402077 A  ERRORERROR'
2019-02-06 01:30:02 [DEBUG   ] Got command RPT from MCS: ref #1415000
2019-02-06 01:30:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 01:30:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415000  77 58520  5402269 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 01:30:02 [DEBUG   ] Got command RPT from MCS: ref #1415001
2019-02-06 01:30:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 01:30:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415001  12 58520  5402473 A  ERRORB—™š'
2019-02-06 01:30:05 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-06 01:30:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-06 01:30:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:30:35 [WARNING ] (13, 1, 'bot')
2019-02-06 01:30:35 [WARNING ] (13, 1, 'bot')
2019-02-06 01:30:35 [WARNING ] (13, 1, 'bot')
2019-02-06 01:30:35 [WARNING ] (13, 1, 'bot')
2019-02-06 01:30:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:30:35 [DEBUG   ] Finished updating board flags in 1.553 seconds
2019-02-06 01:30:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 01:31:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 01:31:12 [DEBUG   ] Got command RPT from MCS: ref #1415002
2019-02-06 01:31:12 [DEBUG   ] summary = ERROR
2019-02-06 01:31:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415002  13 58520  5472089 A  ERRORERROR'
2019-02-06 01:31:12 [DEBUG   ] Got command RPT from MCS: ref #1415003
2019-02-06 01:31:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 01:31:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415003  77 58520  5472090 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 01:31:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-06 01:31:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:31:35 [WARNING ] (13, 1, 'bot')
2019-02-06 01:31:35 [WARNING ] (13, 1, 'bot')
2019-02-06 01:31:35 [WARNING ] (13, 1, 'bot')
2019-02-06 01:31:35 [WARNING ] (13, 1, 'bot')
2019-02-06 01:31:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:31:35 [DEBUG   ] Finished updating board flags in 1.513 seconds
2019-02-06 01:31:45 [DEBUG   ] Finished updating ant stats in 0.790 seconds
2019-02-06 01:32:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 01:32:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 01:32:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:32:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-02-06 01:32:35 [WARNING ] (13, 1, 'bot')
2019-02-06 01:32:35 [WARNING ] (13, 1, 'bot')
2019-02-06 01:32:35 [WARNING ] (13, 1, 'bot')
2019-02-06 01:32:35 [WARNING ] (13, 1, 'bot')
2019-02-06 01:32:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:32:35 [DEBUG   ] Finished updating board flags in 1.514 seconds
2019-02-06 01:32:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 01:33:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 01:33:25 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 01:33:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:33:36 [WARNING ] (13, 1, 'bot')
2019-02-06 01:33:36 [WARNING ] (13, 1, 'bot')
2019-02-06 01:33:36 [WARNING ] (13, 1, 'bot')
2019-02-06 01:33:36 [WARNING ] (13, 1, 'bot')
2019-02-06 01:33:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:33:36 [DEBUG   ] Finished updating board flags in 2.275 seconds
2019-02-06 01:33:45 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 01:34:06 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-02-06 01:34:26 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-02-06 01:34:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:34:36 [WARNING ] (13, 1, 'bot')
2019-02-06 01:34:36 [WARNING ] (13, 1, 'bot')
2019-02-06 01:34:36 [WARNING ] (13, 1, 'bot')
2019-02-06 01:34:36 [WARNING ] (13, 1, 'bot')
2019-02-06 01:34:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:34:36 [DEBUG   ] Finished updating board flags in 2.107 seconds
2019-02-06 01:34:46 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-06 01:35:01 [DEBUG   ] Got command RPT from MCS: ref #1415025
2019-02-06 01:35:01 [DEBUG   ] summary = ERROR
2019-02-06 01:35:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415025  13 58520  5701745 A  ERRORERROR'
2019-02-06 01:35:01 [DEBUG   ] Got command RPT from MCS: ref #1415026
2019-02-06 01:35:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 01:35:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415026  77 58520  5701949 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 01:35:02 [DEBUG   ] Got command RPT from MCS: ref #1415027
2019-02-06 01:35:02 [DEBUG   ] summary = ERROR
2019-02-06 01:35:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415027  13 58520  5702153 A  ERRORERROR'
2019-02-06 01:35:02 [DEBUG   ] Got command RPT from MCS: ref #1415028
2019-02-06 01:35:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 01:35:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415028  77 58520  5702345 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 01:35:02 [DEBUG   ] Got command RPT from MCS: ref #1415030
2019-02-06 01:35:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 01:35:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415030  12 58520  5702549 A  ERRORB—™š'
2019-02-06 01:35:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 01:35:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 01:35:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:35:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-06 01:35:36 [WARNING ] (13, 1, 'bot')
2019-02-06 01:35:36 [WARNING ] (13, 1, 'bot')
2019-02-06 01:35:36 [WARNING ] (13, 1, 'bot')
2019-02-06 01:35:36 [WARNING ] (13, 1, 'bot')
2019-02-06 01:35:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:35:36 [DEBUG   ] Finished updating board flags in 2.014 seconds
2019-02-06 01:35:46 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 01:36:06 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2019-02-06 01:36:12 [DEBUG   ] Got command RPT from MCS: ref #1415039
2019-02-06 01:36:12 [DEBUG   ] summary = ERROR
2019-02-06 01:36:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415039  13 58520  5772089 A  ERRORERROR'
2019-02-06 01:36:12 [DEBUG   ] Got command RPT from MCS: ref #1415040
2019-02-06 01:36:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 01:36:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415040  77 58520  5772090 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 01:36:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 01:36:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:36:36 [WARNING ] (13, 1, 'bot')
2019-02-06 01:36:36 [WARNING ] (13, 1, 'bot')
2019-02-06 01:36:36 [WARNING ] (13, 1, 'bot')
2019-02-06 01:36:36 [WARNING ] (13, 1, 'bot')
2019-02-06 01:36:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:36:36 [DEBUG   ] Finished updating board flags in 1.986 seconds
2019-02-06 01:36:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 01:37:06 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 01:37:26 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-06 01:37:35 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 01:37:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:37:36 [WARNING ] (13, 1, 'bot')
2019-02-06 01:37:36 [WARNING ] (13, 1, 'bot')
2019-02-06 01:37:36 [WARNING ] (13, 1, 'bot')
2019-02-06 01:37:36 [WARNING ] (13, 1, 'bot')
2019-02-06 01:37:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:37:36 [DEBUG   ] Finished updating board flags in 1.829 seconds
2019-02-06 01:37:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 01:38:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 01:38:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 01:38:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:38:36 [WARNING ] (13, 1, 'bot')
2019-02-06 01:38:36 [WARNING ] (13, 1, 'bot')
2019-02-06 01:38:36 [WARNING ] (13, 1, 'bot')
2019-02-06 01:38:36 [WARNING ] (13, 1, 'bot')
2019-02-06 01:38:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:38:36 [DEBUG   ] Finished updating board flags in 1.771 seconds
2019-02-06 01:38:46 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2019-02-06 01:39:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 01:39:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 01:39:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:39:36 [WARNING ] (13, 1, 'bot')
2019-02-06 01:39:36 [WARNING ] (13, 1, 'bot')
2019-02-06 01:39:36 [WARNING ] (13, 1, 'bot')
2019-02-06 01:39:36 [WARNING ] (13, 1, 'bot')
2019-02-06 01:39:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:39:36 [DEBUG   ] Finished updating board flags in 1.617 seconds
2019-02-06 01:39:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 01:40:01 [DEBUG   ] Got command RPT from MCS: ref #1415060
2019-02-06 01:40:01 [DEBUG   ] summary = ERROR
2019-02-06 01:40:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415060  13 58520  6001833 A  ERRORERROR'
2019-02-06 01:40:02 [DEBUG   ] Got command RPT from MCS: ref #1415061
2019-02-06 01:40:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 01:40:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415061  77 58520  6002025 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 01:40:02 [DEBUG   ] Got command RPT from MCS: ref #1415062
2019-02-06 01:40:02 [DEBUG   ] summary = ERROR
2019-02-06 01:40:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415062  13 58520  6002229 A  ERRORERROR'
2019-02-06 01:40:02 [DEBUG   ] Got command RPT from MCS: ref #1415063
2019-02-06 01:40:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 01:40:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415063  77 58520  6002433 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 01:40:02 [DEBUG   ] Got command RPT from MCS: ref #1415064
2019-02-06 01:40:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 01:40:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415064  12 58520  6002637 A  ERRORB˜™š'
2019-02-06 01:40:06 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-06 01:40:26 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-06 01:40:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:40:36 [WARNING ] (13, 1, 'bot')
2019-02-06 01:40:36 [WARNING ] (13, 1, 'bot')
2019-02-06 01:40:36 [WARNING ] (13, 1, 'bot')
2019-02-06 01:40:36 [WARNING ] (13, 1, 'bot')
2019-02-06 01:40:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:40:36 [DEBUG   ] Finished updating board flags in 1.683 seconds
2019-02-06 01:40:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 01:41:06 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 01:41:12 [DEBUG   ] Got command RPT from MCS: ref #1415065
2019-02-06 01:41:12 [DEBUG   ] summary = ERROR
2019-02-06 01:41:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415065  13 58520  6072089 A  ERRORERROR'
2019-02-06 01:41:12 [DEBUG   ] Got command RPT from MCS: ref #1415066
2019-02-06 01:41:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 01:41:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415066  77 58520  6072090 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 01:41:26 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-06 01:41:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:41:36 [WARNING ] (13, 1, 'bot')
2019-02-06 01:41:36 [WARNING ] (13, 1, 'bot')
2019-02-06 01:41:36 [WARNING ] (13, 1, 'bot')
2019-02-06 01:41:36 [WARNING ] (13, 1, 'bot')
2019-02-06 01:41:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:41:36 [DEBUG   ] Finished updating board flags in 1.603 seconds
2019-02-06 01:41:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 01:42:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 01:42:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 01:42:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:42:36 [WARNING ] (13, 1, 'bot')
2019-02-06 01:42:36 [WARNING ] (13, 1, 'bot')
2019-02-06 01:42:36 [WARNING ] (13, 1, 'bot')
2019-02-06 01:42:36 [WARNING ] (13, 1, 'bot')
2019-02-06 01:42:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:42:36 [DEBUG   ] Finished updating board flags in 1.503 seconds
2019-02-06 01:42:46 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-06 01:43:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 01:43:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 01:43:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:43:36 [WARNING ] (13, 1, 'bot')
2019-02-06 01:43:36 [WARNING ] (13, 1, 'bot')
2019-02-06 01:43:36 [WARNING ] (13, 1, 'bot')
2019-02-06 01:43:36 [WARNING ] (13, 1, 'bot')
2019-02-06 01:43:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:43:36 [DEBUG   ] Finished updating board flags in 1.429 seconds
2019-02-06 01:43:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 01:44:06 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-06 01:44:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 01:44:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:44:36 [WARNING ] (13, 1, 'bot')
2019-02-06 01:44:36 [WARNING ] (13, 1, 'bot')
2019-02-06 01:44:36 [WARNING ] (13, 1, 'bot')
2019-02-06 01:44:36 [WARNING ] (13, 1, 'bot')
2019-02-06 01:44:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:44:36 [DEBUG   ] Finished updating board flags in 1.381 seconds
2019-02-06 01:44:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 01:45:01 [DEBUG   ] Got command RPT from MCS: ref #1415092
2019-02-06 01:45:01 [DEBUG   ] summary = ERROR
2019-02-06 01:45:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415092  13 58520  6301913 A  ERRORERROR'
2019-02-06 01:45:02 [DEBUG   ] Got command RPT from MCS: ref #1415093
2019-02-06 01:45:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 01:45:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415093  77 58520  6302117 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 01:45:02 [DEBUG   ] Got command RPT from MCS: ref #1415094
2019-02-06 01:45:02 [DEBUG   ] summary = ERROR
2019-02-06 01:45:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415094  13 58520  6302309 A  ERRORERROR'
2019-02-06 01:45:02 [DEBUG   ] Got command RPT from MCS: ref #1415096
2019-02-06 01:45:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 01:45:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415096  77 58520  6302513 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 01:45:02 [DEBUG   ] Got command RPT from MCS: ref #1415098
2019-02-06 01:45:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 01:45:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415098  12 58520  6302718 A  ERRORB—™š'
2019-02-06 01:45:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 01:45:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 01:45:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:45:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:45:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:45:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:45:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:45:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:45:37 [DEBUG   ] Finished updating board flags in 2.219 seconds
2019-02-06 01:45:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 01:46:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 01:46:12 [DEBUG   ] Got command RPT from MCS: ref #1415102
2019-02-06 01:46:12 [DEBUG   ] summary = ERROR
2019-02-06 01:46:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415102  13 58520  6372093 A  ERRORERROR'
2019-02-06 01:46:12 [DEBUG   ] Got command RPT from MCS: ref #1415103
2019-02-06 01:46:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 01:46:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415103  77 58520  6372094 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 01:46:26 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 01:46:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:46:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-02-06 01:46:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:46:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:46:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:46:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:46:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:46:37 [DEBUG   ] Finished updating board flags in 2.288 seconds
2019-02-06 01:46:46 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-02-06 01:47:06 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-06 01:47:27 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-02-06 01:47:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:47:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:47:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:47:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:47:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:47:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:47:37 [DEBUG   ] Finished updating board flags in 2.099 seconds
2019-02-06 01:47:47 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-02-06 01:48:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 01:48:27 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 01:48:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:48:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:48:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:48:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:48:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:48:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:48:37 [DEBUG   ] Finished updating board flags in 2.003 seconds
2019-02-06 01:48:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 01:49:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-06 01:49:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 01:49:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:49:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:49:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:49:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:49:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:49:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:49:37 [DEBUG   ] Finished updating board flags in 2.015 seconds
2019-02-06 01:49:47 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-02-06 01:50:01 [DEBUG   ] Got command RPT from MCS: ref #1415123
2019-02-06 01:50:01 [DEBUG   ] summary = ERROR
2019-02-06 01:50:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415123  13 58520  6601990 A  ERRORERROR'
2019-02-06 01:50:02 [DEBUG   ] Got command RPT from MCS: ref #1415124
2019-02-06 01:50:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 01:50:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415124  77 58520  6602194 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 01:50:02 [DEBUG   ] Got command RPT from MCS: ref #1415125
2019-02-06 01:50:02 [DEBUG   ] summary = ERROR
2019-02-06 01:50:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415125  13 58520  6602397 A  ERRORERROR'
2019-02-06 01:50:02 [DEBUG   ] Got command RPT from MCS: ref #1415126
2019-02-06 01:50:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 01:50:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415126  77 58520  6602589 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 01:50:02 [DEBUG   ] Got command RPT from MCS: ref #1415127
2019-02-06 01:50:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 01:50:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415127  12 58520  6602793 A  ERRORB–™š'
2019-02-06 01:50:07 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-02-06 01:50:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 01:50:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:50:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-02-06 01:50:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:50:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:50:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:50:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:50:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:50:37 [DEBUG   ] Finished updating board flags in 1.986 seconds
2019-02-06 01:50:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-06 01:51:07 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 01:51:12 [DEBUG   ] Got command RPT from MCS: ref #1415132
2019-02-06 01:51:12 [DEBUG   ] summary = ERROR
2019-02-06 01:51:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415132  13 58520  6672097 A  ERRORERROR'
2019-02-06 01:51:12 [DEBUG   ] Got command RPT from MCS: ref #1415133
2019-02-06 01:51:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 01:51:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415133  77 58520  6672098 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 01:51:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 01:51:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:51:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-06 01:51:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:51:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:51:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:51:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:51:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:51:37 [DEBUG   ] Finished updating board flags in 1.843 seconds
2019-02-06 01:51:47 [DEBUG   ] Finished updating ant stats in 0.869 seconds
2019-02-06 01:52:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 01:52:27 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 01:52:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:52:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-02-06 01:52:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:52:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:52:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:52:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:52:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:52:37 [DEBUG   ] Finished updating board flags in 1.757 seconds
2019-02-06 01:52:47 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 01:53:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 01:53:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-06 01:53:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:53:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:53:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:53:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:53:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:53:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:53:37 [DEBUG   ] Finished updating board flags in 1.618 seconds
2019-02-06 01:53:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 01:54:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 01:54:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-06 01:54:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:54:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:54:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:54:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:54:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:54:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:54:37 [DEBUG   ] Finished updating board flags in 1.584 seconds
2019-02-06 01:54:47 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-02-06 01:55:02 [DEBUG   ] Got command RPT from MCS: ref #1415155
2019-02-06 01:55:02 [DEBUG   ] summary = ERROR
2019-02-06 01:55:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415155  13 58520  6902069 A  ERRORERROR'
2019-02-06 01:55:02 [DEBUG   ] Got command RPT from MCS: ref #1415156
2019-02-06 01:55:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 01:55:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415156  77 58520  6902273 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 01:55:02 [DEBUG   ] Got command RPT from MCS: ref #1415157
2019-02-06 01:55:02 [DEBUG   ] summary = ERROR
2019-02-06 01:55:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415157  13 58520  6902477 A  ERRORERROR'
2019-02-06 01:55:02 [DEBUG   ] Got command RPT from MCS: ref #1415159
2019-02-06 01:55:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 01:55:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415159  77 58520  6902681 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 01:55:02 [DEBUG   ] Got command RPT from MCS: ref #1415160
2019-02-06 01:55:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 01:55:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415160  12 58520  6902873 A  ERRORB˜™š'
2019-02-06 01:55:08 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-02-06 01:55:28 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-02-06 01:55:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:55:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:55:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:55:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:55:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:55:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:55:37 [DEBUG   ] Finished updating board flags in 1.407 seconds
2019-02-06 01:55:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 01:56:08 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 01:56:12 [DEBUG   ] Got command RPT from MCS: ref #1415165
2019-02-06 01:56:12 [DEBUG   ] summary = ERROR
2019-02-06 01:56:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415165  13 58520  6972097 A  ERRORERROR'
2019-02-06 01:56:12 [DEBUG   ] Got command RPT from MCS: ref #1415166
2019-02-06 01:56:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 01:56:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415166  77 58520  6972098 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 01:56:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 01:56:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:56:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:56:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:56:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:56:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:56:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:56:37 [DEBUG   ] Finished updating board flags in 1.398 seconds
2019-02-06 01:56:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 01:57:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 01:57:28 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 01:57:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:57:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:57:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:57:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:57:37 [WARNING ] (13, 1, 'bot')
2019-02-06 01:57:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:57:37 [DEBUG   ] Finished updating board flags in 1.363 seconds
2019-02-06 01:57:48 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 01:58:08 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-06 01:58:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 01:58:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:58:38 [WARNING ] (13, 1, 'bot')
2019-02-06 01:58:38 [WARNING ] (13, 1, 'bot')
2019-02-06 01:58:38 [WARNING ] (13, 1, 'bot')
2019-02-06 01:58:38 [WARNING ] (13, 1, 'bot')
2019-02-06 01:58:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:58:38 [DEBUG   ] Finished updating board flags in 2.052 seconds
2019-02-06 01:58:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 01:59:08 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-06 01:59:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-06 01:59:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 01:59:38 [WARNING ] (13, 1, 'bot')
2019-02-06 01:59:38 [WARNING ] (13, 1, 'bot')
2019-02-06 01:59:38 [WARNING ] (13, 1, 'bot')
2019-02-06 01:59:38 [WARNING ] (13, 1, 'bot')
2019-02-06 01:59:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 01:59:38 [DEBUG   ] Finished updating board flags in 1.990 seconds
2019-02-06 01:59:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 02:00:02 [DEBUG   ] Got command RPT from MCS: ref #1415190
2019-02-06 02:00:02 [DEBUG   ] summary = ERROR
2019-02-06 02:00:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415190  13 58520  7202588 A  ERRORERROR'
2019-02-06 02:00:02 [DEBUG   ] Got command RPT from MCS: ref #1415191
2019-02-06 02:00:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 02:00:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415191  77 58520  7202754 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 02:00:02 [DEBUG   ] Got command RPT from MCS: ref #1415192
2019-02-06 02:00:02 [DEBUG   ] summary = ERROR
2019-02-06 02:00:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415192  13 58520  7202957 A  ERRORERROR'
2019-02-06 02:00:03 [DEBUG   ] Got command RPT from MCS: ref #1415193
2019-02-06 02:00:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 02:00:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415193  77 58520  7203161 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 02:00:03 [DEBUG   ] Got command RPT from MCS: ref #1415194
2019-02-06 02:00:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 02:00:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415194  12 58520  7203354 A  ERRORB—™š'
2019-02-06 02:00:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 02:00:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 02:00:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:00:38 [WARNING ] (13, 1, 'bot')
2019-02-06 02:00:38 [WARNING ] (13, 1, 'bot')
2019-02-06 02:00:38 [WARNING ] (13, 1, 'bot')
2019-02-06 02:00:38 [WARNING ] (13, 1, 'bot')
2019-02-06 02:00:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:00:38 [DEBUG   ] Finished updating board flags in 1.911 seconds
2019-02-06 02:00:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 02:01:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 02:01:12 [DEBUG   ] Got command RPT from MCS: ref #1415195
2019-02-06 02:01:12 [DEBUG   ] summary = ERROR
2019-02-06 02:01:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415195  13 58520  7272093 A  ERRORERROR'
2019-02-06 02:01:12 [DEBUG   ] Got command RPT from MCS: ref #1415196
2019-02-06 02:01:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 02:01:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415196  77 58520  7272094 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 02:01:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 02:01:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:01:38 [WARNING ] (13, 1, 'bot')
2019-02-06 02:01:38 [WARNING ] (13, 1, 'bot')
2019-02-06 02:01:38 [WARNING ] (13, 1, 'bot')
2019-02-06 02:01:38 [WARNING ] (13, 1, 'bot')
2019-02-06 02:01:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:01:38 [DEBUG   ] Finished updating board flags in 1.689 seconds
2019-02-06 02:01:48 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 02:02:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 02:02:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 02:02:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:02:38 [WARNING ] (13, 1, 'bot')
2019-02-06 02:02:38 [WARNING ] (13, 1, 'bot')
2019-02-06 02:02:38 [WARNING ] (13, 1, 'bot')
2019-02-06 02:02:38 [WARNING ] (13, 1, 'bot')
2019-02-06 02:02:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:02:38 [DEBUG   ] Finished updating board flags in 1.610 seconds
2019-02-06 02:02:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 02:03:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 02:03:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 02:03:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:03:38 [WARNING ] (13, 1, 'bot')
2019-02-06 02:03:38 [WARNING ] (13, 1, 'bot')
2019-02-06 02:03:38 [WARNING ] (13, 1, 'bot')
2019-02-06 02:03:38 [WARNING ] (13, 1, 'bot')
2019-02-06 02:03:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:03:38 [DEBUG   ] Finished updating board flags in 1.593 seconds
2019-02-06 02:03:48 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-02-06 02:04:09 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-02-06 02:04:29 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-02-06 02:04:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:04:38 [WARNING ] (13, 1, 'bot')
2019-02-06 02:04:38 [WARNING ] (13, 1, 'bot')
2019-02-06 02:04:38 [WARNING ] (13, 1, 'bot')
2019-02-06 02:04:38 [WARNING ] (13, 1, 'bot')
2019-02-06 02:04:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:04:38 [DEBUG   ] Finished updating board flags in 1.471 seconds
2019-02-06 02:04:49 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-06 02:05:02 [DEBUG   ] Got command RPT from MCS: ref #1415218
2019-02-06 02:05:02 [DEBUG   ] summary = ERROR
2019-02-06 02:05:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415218  13 58520  7502233 A  ERRORERROR'
2019-02-06 02:05:02 [DEBUG   ] Got command RPT from MCS: ref #1415219
2019-02-06 02:05:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 02:05:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415219  77 58520  7502437 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 02:05:02 [DEBUG   ] Got command RPT from MCS: ref #1415220
2019-02-06 02:05:02 [DEBUG   ] summary = ERROR
2019-02-06 02:05:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415220  13 58520  7502641 A  ERRORERROR'
2019-02-06 02:05:02 [DEBUG   ] Got command RPT from MCS: ref #1415222
2019-02-06 02:05:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 02:05:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415222  77 58520  7502833 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 02:05:03 [DEBUG   ] Got command RPT from MCS: ref #1415223
2019-02-06 02:05:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 02:05:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415223  12 58520  7503047 A  ERRORB•™š'
2019-02-06 02:05:09 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 02:05:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 02:05:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:05:38 [WARNING ] (13, 1, 'bot')
2019-02-06 02:05:38 [WARNING ] (13, 1, 'bot')
2019-02-06 02:05:38 [WARNING ] (13, 1, 'bot')
2019-02-06 02:05:38 [WARNING ] (13, 1, 'bot')
2019-02-06 02:05:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:05:38 [DEBUG   ] Finished updating board flags in 1.486 seconds
2019-02-06 02:05:49 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-02-06 02:06:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 02:06:12 [DEBUG   ] Got command RPT from MCS: ref #1415232
2019-02-06 02:06:12 [DEBUG   ] summary = ERROR
2019-02-06 02:06:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415232  13 58520  7572097 A  ERRORERROR'
2019-02-06 02:06:12 [DEBUG   ] Got command RPT from MCS: ref #1415233
2019-02-06 02:06:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 02:06:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415233  77 58520  7572098 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 02:06:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 02:06:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:06:38 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-02-06 02:06:38 [WARNING ] (13, 1, 'bot')
2019-02-06 02:06:38 [WARNING ] (13, 1, 'bot')
2019-02-06 02:06:38 [WARNING ] (13, 1, 'bot')
2019-02-06 02:06:38 [WARNING ] (13, 1, 'bot')
2019-02-06 02:06:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:06:38 [DEBUG   ] Finished updating board flags in 1.486 seconds
2019-02-06 02:06:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 02:07:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 02:07:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 02:07:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:07:39 [WARNING ] (13, 1, 'bot')
2019-02-06 02:07:39 [WARNING ] (13, 1, 'bot')
2019-02-06 02:07:39 [WARNING ] (13, 1, 'bot')
2019-02-06 02:07:39 [WARNING ] (13, 1, 'bot')
2019-02-06 02:07:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:07:39 [DEBUG   ] Finished updating board flags in 2.187 seconds
2019-02-06 02:07:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 02:08:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 02:08:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 02:08:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:08:39 [WARNING ] (13, 1, 'bot')
2019-02-06 02:08:39 [WARNING ] (13, 1, 'bot')
2019-02-06 02:08:39 [WARNING ] (13, 1, 'bot')
2019-02-06 02:08:39 [WARNING ] (13, 1, 'bot')
2019-02-06 02:08:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:08:39 [DEBUG   ] Finished updating board flags in 2.067 seconds
2019-02-06 02:08:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 02:09:09 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 02:09:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 02:09:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:09:39 [WARNING ] (13, 1, 'bot')
2019-02-06 02:09:39 [WARNING ] (13, 1, 'bot')
2019-02-06 02:09:39 [WARNING ] (13, 1, 'bot')
2019-02-06 02:09:39 [WARNING ] (13, 1, 'bot')
2019-02-06 02:09:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:09:39 [DEBUG   ] Finished updating board flags in 1.914 seconds
2019-02-06 02:09:49 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-06 02:10:02 [DEBUG   ] Got command RPT from MCS: ref #1415253
2019-02-06 02:10:02 [DEBUG   ] summary = ERROR
2019-02-06 02:10:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415253  13 58520  7802313 A  ERRORERROR'
2019-02-06 02:10:02 [DEBUG   ] Got command RPT from MCS: ref #1415254
2019-02-06 02:10:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 02:10:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415254  77 58520  7802517 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 02:10:02 [DEBUG   ] Got command RPT from MCS: ref #1415255
2019-02-06 02:10:02 [DEBUG   ] summary = ERROR
2019-02-06 02:10:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415255  13 58520  7802721 A  ERRORERROR'
2019-02-06 02:10:02 [DEBUG   ] Got command RPT from MCS: ref #1415256
2019-02-06 02:10:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 02:10:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415256  77 58520  7802925 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 02:10:03 [DEBUG   ] Got command RPT from MCS: ref #1415257
2019-02-06 02:10:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 02:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415257  12 58520  7803117 A  ERRORB—™š'
2019-02-06 02:10:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 02:10:29 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 02:10:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:10:39 [WARNING ] (13, 1, 'bot')
2019-02-06 02:10:39 [WARNING ] (13, 1, 'bot')
2019-02-06 02:10:39 [WARNING ] (13, 1, 'bot')
2019-02-06 02:10:39 [WARNING ] (13, 1, 'bot')
2019-02-06 02:10:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:10:39 [DEBUG   ] Finished updating board flags in 1.868 seconds
2019-02-06 02:10:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 02:11:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 02:11:12 [DEBUG   ] Got command RPT from MCS: ref #1415258
2019-02-06 02:11:12 [DEBUG   ] summary = ERROR
2019-02-06 02:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415258  13 58520  7872097 A  ERRORERROR'
2019-02-06 02:11:12 [DEBUG   ] Got command RPT from MCS: ref #1415259
2019-02-06 02:11:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 02:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415259  77 58520  7872098 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 02:11:29 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-02-06 02:11:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:11:39 [WARNING ] (13, 1, 'bot')
2019-02-06 02:11:39 [WARNING ] (13, 1, 'bot')
2019-02-06 02:11:39 [WARNING ] (13, 1, 'bot')
2019-02-06 02:11:39 [WARNING ] (13, 1, 'bot')
2019-02-06 02:11:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:11:39 [DEBUG   ] Finished updating board flags in 1.737 seconds
2019-02-06 02:11:49 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 02:12:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 02:12:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 02:12:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:12:39 [WARNING ] (13, 1, 'bot')
2019-02-06 02:12:39 [WARNING ] (13, 1, 'bot')
2019-02-06 02:12:39 [WARNING ] (13, 1, 'bot')
2019-02-06 02:12:39 [WARNING ] (13, 1, 'bot')
2019-02-06 02:12:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:12:39 [DEBUG   ] Finished updating board flags in 1.619 seconds
2019-02-06 02:12:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 02:13:09 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 02:13:29 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-02-06 02:13:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:13:39 [WARNING ] (13, 1, 'bot')
2019-02-06 02:13:39 [WARNING ] (13, 1, 'bot')
2019-02-06 02:13:39 [WARNING ] (13, 1, 'bot')
2019-02-06 02:13:39 [WARNING ] (13, 1, 'bot')
2019-02-06 02:13:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:13:39 [DEBUG   ] Finished updating board flags in 1.582 seconds
2019-02-06 02:13:49 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-06 02:14:09 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-06 02:14:30 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-02-06 02:14:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:14:39 [WARNING ] (13, 1, 'bot')
2019-02-06 02:14:39 [WARNING ] (13, 1, 'bot')
2019-02-06 02:14:39 [WARNING ] (13, 1, 'bot')
2019-02-06 02:14:39 [WARNING ] (13, 1, 'bot')
2019-02-06 02:14:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:14:39 [DEBUG   ] Finished updating board flags in 1.417 seconds
2019-02-06 02:14:50 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-06 02:15:02 [DEBUG   ] Got command RPT from MCS: ref #1415285
2019-02-06 02:15:02 [DEBUG   ] summary = ERROR
2019-02-06 02:15:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415285  13 58520  8102401 A  ERRORERROR'
2019-02-06 02:15:02 [DEBUG   ] Got command RPT from MCS: ref #1415286
2019-02-06 02:15:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 02:15:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415286  77 58520  8102605 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 02:15:02 [DEBUG   ] Got command RPT from MCS: ref #1415287
2019-02-06 02:15:02 [DEBUG   ] summary = ERROR
2019-02-06 02:15:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415287  13 58520  8102797 A  ERRORERROR'
2019-02-06 02:15:03 [DEBUG   ] Got command RPT from MCS: ref #1415289
2019-02-06 02:15:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 02:15:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415289  77 58520  8103001 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 02:15:03 [DEBUG   ] Got command RPT from MCS: ref #1415291
2019-02-06 02:15:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 02:15:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415291  12 58520  8103205 A  ERRORB—™š'
2019-02-06 02:15:10 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 02:15:30 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 02:15:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:15:39 [WARNING ] (13, 1, 'bot')
2019-02-06 02:15:39 [WARNING ] (13, 1, 'bot')
2019-02-06 02:15:39 [WARNING ] (13, 1, 'bot')
2019-02-06 02:15:39 [WARNING ] (13, 1, 'bot')
2019-02-06 02:15:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:15:39 [DEBUG   ] Finished updating board flags in 1.397 seconds
2019-02-06 02:15:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 02:16:10 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-02-06 02:16:12 [DEBUG   ] Got command RPT from MCS: ref #1415295
2019-02-06 02:16:12 [DEBUG   ] summary = ERROR
2019-02-06 02:16:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415295  13 58520  8172097 A  ERRORERROR'
2019-02-06 02:16:12 [DEBUG   ] Got command RPT from MCS: ref #1415296
2019-02-06 02:16:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 02:16:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415296  77 58520  8172098 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 02:16:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 02:16:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:16:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:16:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:16:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:16:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:16:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:16:40 [DEBUG   ] Finished updating board flags in 2.205 seconds
2019-02-06 02:16:50 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 02:17:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 02:17:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 02:17:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:17:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:17:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:17:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:17:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:17:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:17:40 [DEBUG   ] Finished updating board flags in 2.260 seconds
2019-02-06 02:17:50 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 02:18:10 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 02:18:30 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-02-06 02:18:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:18:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:18:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:18:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:18:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:18:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:18:40 [DEBUG   ] Finished updating board flags in 2.133 seconds
2019-02-06 02:18:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 02:19:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 02:19:30 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 02:19:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:19:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:19:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:19:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:19:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:19:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:19:40 [DEBUG   ] Finished updating board flags in 2.008 seconds
2019-02-06 02:19:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 02:20:02 [DEBUG   ] Got command RPT from MCS: ref #1415316
2019-02-06 02:20:02 [DEBUG   ] summary = ERROR
2019-02-06 02:20:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415316  13 58520  8402486 A  ERRORERROR'
2019-02-06 02:20:02 [DEBUG   ] Got command RPT from MCS: ref #1415317
2019-02-06 02:20:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 02:20:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415317  77 58520  8402677 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 02:20:02 [DEBUG   ] Got command RPT from MCS: ref #1415318
2019-02-06 02:20:02 [DEBUG   ] summary = ERROR
2019-02-06 02:20:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415318  13 58520  8402881 A  ERRORERROR'
2019-02-06 02:20:03 [DEBUG   ] Got command RPT from MCS: ref #1415319
2019-02-06 02:20:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 02:20:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415319  77 58520  8403085 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 02:20:03 [DEBUG   ] Got command RPT from MCS: ref #1415320
2019-02-06 02:20:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 02:20:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415320  12 58520  8403289 A  ERRORB–™š'
2019-02-06 02:20:10 [DEBUG   ] Finished updating ant stats in 0.791 seconds
2019-02-06 02:20:30 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 02:20:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:20:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:20:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:20:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:20:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:20:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:20:40 [DEBUG   ] Finished updating board flags in 1.996 seconds
2019-02-06 02:20:50 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 02:21:10 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-02-06 02:21:12 [DEBUG   ] Got command RPT from MCS: ref #1415325
2019-02-06 02:21:12 [DEBUG   ] summary = ERROR
2019-02-06 02:21:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415325  13 58520  8472097 A  ERRORERROR'
2019-02-06 02:21:12 [DEBUG   ] Got command RPT from MCS: ref #1415326
2019-02-06 02:21:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 02:21:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415326  77 58520  8472098 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 02:21:30 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-06 02:21:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:21:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:21:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:21:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:21:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:21:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:21:40 [DEBUG   ] Finished updating board flags in 1.804 seconds
2019-02-06 02:21:51 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-02-06 02:22:11 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-02-06 02:22:31 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 02:22:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:22:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:22:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:22:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:22:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:22:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:22:40 [DEBUG   ] Finished updating board flags in 1.814 seconds
2019-02-06 02:22:51 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 02:23:11 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-02-06 02:23:31 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-06 02:23:39 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 02:23:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:23:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:23:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:23:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:23:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:23:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:23:40 [DEBUG   ] Finished updating board flags in 1.787 seconds
2019-02-06 02:23:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 02:24:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 02:24:31 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-06 02:24:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:24:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:24:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:24:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:24:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:24:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:24:40 [DEBUG   ] Finished updating board flags in 1.613 seconds
2019-02-06 02:24:51 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-06 02:25:02 [DEBUG   ] Got command RPT from MCS: ref #1415348
2019-02-06 02:25:02 [DEBUG   ] summary = ERROR
2019-02-06 02:25:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415348  13 58520  8702565 A  ERRORERROR'
2019-02-06 02:25:02 [DEBUG   ] Got command RPT from MCS: ref #1415349
2019-02-06 02:25:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 02:25:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415349  77 58520  8702757 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 02:25:02 [DEBUG   ] Got command RPT from MCS: ref #1415350
2019-02-06 02:25:02 [DEBUG   ] summary = ERROR
2019-02-06 02:25:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415350  13 58520  8702961 A  ERRORERROR'
2019-02-06 02:25:03 [DEBUG   ] Got command RPT from MCS: ref #1415352
2019-02-06 02:25:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 02:25:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415352  77 58520  8703170 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 02:25:03 [DEBUG   ] Got command RPT from MCS: ref #1415353
2019-02-06 02:25:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 02:25:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415353  12 58520  8703361 A  ERRORB—™š'
2019-02-06 02:25:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 02:25:31 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 02:25:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:25:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:25:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:25:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:25:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:25:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:25:40 [DEBUG   ] Finished updating board flags in 1.605 seconds
2019-02-06 02:25:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 02:26:11 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-06 02:26:12 [DEBUG   ] Got command RPT from MCS: ref #1415358
2019-02-06 02:26:12 [DEBUG   ] summary = ERROR
2019-02-06 02:26:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415358  13 58520  8772101 A  ERRORERROR'
2019-02-06 02:26:12 [DEBUG   ] Got command RPT from MCS: ref #1415359
2019-02-06 02:26:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 02:26:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415359  77 58520  8772102 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 02:26:31 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-06 02:26:39 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 02:26:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:26:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:26:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:26:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:26:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:26:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:26:40 [DEBUG   ] Finished updating board flags in 1.594 seconds
2019-02-06 02:26:51 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 02:27:11 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2019-02-06 02:27:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 02:27:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:27:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-06 02:27:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:27:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:27:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:27:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:27:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:27:40 [DEBUG   ] Finished updating board flags in 1.417 seconds
2019-02-06 02:27:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 02:28:11 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 02:28:31 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 02:28:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:28:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:28:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:28:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:28:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:28:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:28:40 [DEBUG   ] Finished updating board flags in 1.454 seconds
2019-02-06 02:28:51 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-06 02:29:11 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-06 02:29:32 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2019-02-06 02:29:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:29:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-06 02:29:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:29:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:29:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:29:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:29:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:29:40 [DEBUG   ] Finished updating board flags in 1.428 seconds
2019-02-06 02:29:52 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-06 02:30:02 [DEBUG   ] Got command RPT from MCS: ref #1415383
2019-02-06 02:30:02 [DEBUG   ] summary = ERROR
2019-02-06 02:30:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415383  13 58520  9002641 A  ERRORERROR'
2019-02-06 02:30:02 [DEBUG   ] Got command RPT from MCS: ref #1415384
2019-02-06 02:30:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 02:30:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415384  77 58520  9002845 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 02:30:03 [DEBUG   ] Got command RPT from MCS: ref #1415385
2019-02-06 02:30:03 [DEBUG   ] summary = ERROR
2019-02-06 02:30:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415385  13 58520  9003049 A  ERRORERROR'
2019-02-06 02:30:03 [DEBUG   ] Got command RPT from MCS: ref #1415386
2019-02-06 02:30:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 02:30:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415386  77 58520  9003241 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 02:30:03 [DEBUG   ] Got command RPT from MCS: ref #1415387
2019-02-06 02:30:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 02:30:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415387  12 58520  9003445 A  ERRORB˜™š'
2019-02-06 02:30:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 02:30:32 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 02:30:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:30:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:30:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:30:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:30:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:30:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:30:40 [DEBUG   ] Finished updating board flags in 1.427 seconds
2019-02-06 02:30:52 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-02-06 02:31:12 [DEBUG   ] Got command RPT from MCS: ref #1415388
2019-02-06 02:31:12 [DEBUG   ] summary = ERROR
2019-02-06 02:31:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415388  13 58520  9072105 A  ERRORERROR'
2019-02-06 02:31:12 [DEBUG   ] Got command RPT from MCS: ref #1415389
2019-02-06 02:31:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 02:31:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415389  77 58520  9072106 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 02:31:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 02:31:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 02:31:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:31:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:31:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:31:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:31:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:31:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:31:40 [DEBUG   ] Finished updating board flags in 1.430 seconds
2019-02-06 02:31:52 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 02:32:12 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-06 02:32:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 02:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:32:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:32:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:32:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:32:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:32:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:32:40 [DEBUG   ] Finished updating board flags in 1.430 seconds
2019-02-06 02:32:52 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-06 02:33:12 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 02:33:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 02:33:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:33:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:33:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:33:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:33:40 [WARNING ] (13, 1, 'bot')
2019-02-06 02:33:40 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:33:40 [DEBUG   ] Finished updating board flags in 1.434 seconds
2019-02-06 02:33:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 02:34:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 02:34:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 02:34:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:34:41 [WARNING ] (13, 1, 'bot')
2019-02-06 02:34:41 [WARNING ] (13, 1, 'bot')
2019-02-06 02:34:41 [WARNING ] (13, 1, 'bot')
2019-02-06 02:34:41 [WARNING ] (13, 1, 'bot')
2019-02-06 02:34:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:34:41 [DEBUG   ] Finished updating board flags in 2.299 seconds
2019-02-06 02:34:52 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 02:35:02 [DEBUG   ] Got command RPT from MCS: ref #1415411
2019-02-06 02:35:02 [DEBUG   ] summary = ERROR
2019-02-06 02:35:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415411  13 58520  9302721 A  ERRORERROR'
2019-02-06 02:35:02 [DEBUG   ] Got command RPT from MCS: ref #1415412
2019-02-06 02:35:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 02:35:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415412  77 58520  9302925 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 02:35:03 [DEBUG   ] Got command RPT from MCS: ref #1415413
2019-02-06 02:35:03 [DEBUG   ] summary = ERROR
2019-02-06 02:35:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415413  13 58520  9303118 A  ERRORERROR'
2019-02-06 02:35:03 [DEBUG   ] Got command RPT from MCS: ref #1415415
2019-02-06 02:35:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 02:35:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415415  77 58520  9303322 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 02:35:03 [DEBUG   ] Got command RPT from MCS: ref #1415417
2019-02-06 02:35:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 02:35:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415417  12 58520  9303525 A  ERRORB–™š'
2019-02-06 02:35:12 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-06 02:35:32 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-06 02:35:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:35:41 [WARNING ] (13, 1, 'bot')
2019-02-06 02:35:41 [WARNING ] (13, 1, 'bot')
2019-02-06 02:35:41 [WARNING ] (13, 1, 'bot')
2019-02-06 02:35:41 [WARNING ] (13, 1, 'bot')
2019-02-06 02:35:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:35:41 [DEBUG   ] Finished updating board flags in 2.094 seconds
2019-02-06 02:35:53 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-02-06 02:36:12 [DEBUG   ] Got command RPT from MCS: ref #1415425
2019-02-06 02:36:12 [DEBUG   ] summary = ERROR
2019-02-06 02:36:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415425  13 58520  9372109 A  ERRORERROR'
2019-02-06 02:36:12 [DEBUG   ] Got command RPT from MCS: ref #1415426
2019-02-06 02:36:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 02:36:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415426  77 58520  9372111 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 02:36:13 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-02-06 02:36:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 02:36:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:36:41 [WARNING ] (13, 1, 'bot')
2019-02-06 02:36:41 [WARNING ] (13, 1, 'bot')
2019-02-06 02:36:41 [WARNING ] (13, 1, 'bot')
2019-02-06 02:36:41 [WARNING ] (13, 1, 'bot')
2019-02-06 02:36:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:36:41 [DEBUG   ] Finished updating board flags in 2.026 seconds
2019-02-06 02:36:53 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 02:37:13 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 02:37:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 02:37:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 02:37:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:37:41 [WARNING ] (13, 1, 'bot')
2019-02-06 02:37:41 [WARNING ] (13, 1, 'bot')
2019-02-06 02:37:41 [WARNING ] (13, 1, 'bot')
2019-02-06 02:37:41 [WARNING ] (13, 1, 'bot')
2019-02-06 02:37:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:37:41 [DEBUG   ] Finished updating board flags in 1.987 seconds
2019-02-06 02:37:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 02:38:13 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 02:38:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 02:38:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:38:41 [WARNING ] (13, 1, 'bot')
2019-02-06 02:38:41 [WARNING ] (13, 1, 'bot')
2019-02-06 02:38:41 [WARNING ] (13, 1, 'bot')
2019-02-06 02:38:41 [WARNING ] (13, 1, 'bot')
2019-02-06 02:38:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:38:41 [DEBUG   ] Finished updating board flags in 1.878 seconds
2019-02-06 02:38:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 02:39:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 02:39:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 02:39:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:39:41 [WARNING ] (13, 1, 'bot')
2019-02-06 02:39:41 [WARNING ] (13, 1, 'bot')
2019-02-06 02:39:41 [WARNING ] (13, 1, 'bot')
2019-02-06 02:39:41 [WARNING ] (13, 1, 'bot')
2019-02-06 02:39:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:39:41 [DEBUG   ] Finished updating board flags in 1.733 seconds
2019-02-06 02:39:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 02:40:02 [DEBUG   ] Got command RPT from MCS: ref #1415446
2019-02-06 02:40:02 [DEBUG   ] summary = ERROR
2019-02-06 02:40:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415446  13 58520  9602801 A  ERRORERROR'
2019-02-06 02:40:03 [DEBUG   ] Got command RPT from MCS: ref #1415447
2019-02-06 02:40:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 02:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415447  77 58520  9603005 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 02:40:03 [DEBUG   ] Got command RPT from MCS: ref #1415448
2019-02-06 02:40:03 [DEBUG   ] summary = ERROR
2019-02-06 02:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415448  13 58520  9603197 A  ERRORERROR'
2019-02-06 02:40:03 [DEBUG   ] Got command RPT from MCS: ref #1415449
2019-02-06 02:40:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 02:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415449  77 58520  9603401 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 02:40:03 [DEBUG   ] Got command RPT from MCS: ref #1415450
2019-02-06 02:40:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 02:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415450  12 58520  9603605 A  ERRORB—™š'
2019-02-06 02:40:13 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-02-06 02:40:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 02:40:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:40:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-06 02:40:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-06 02:40:41 [WARNING ] (13, 1, 'bot')
2019-02-06 02:40:41 [WARNING ] (13, 1, 'bot')
2019-02-06 02:40:41 [WARNING ] (13, 1, 'bot')
2019-02-06 02:40:41 [WARNING ] (13, 1, 'bot')
2019-02-06 02:40:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:40:41 [DEBUG   ] Finished updating board flags in 1.653 seconds
2019-02-06 02:40:53 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 02:41:12 [DEBUG   ] Got command RPT from MCS: ref #1415451
2019-02-06 02:41:12 [DEBUG   ] summary = ERROR
2019-02-06 02:41:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415451  13 58520  9672105 A  ERRORERROR'
2019-02-06 02:41:12 [DEBUG   ] Got command RPT from MCS: ref #1415452
2019-02-06 02:41:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 02:41:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415452  77 58520  9672106 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 02:41:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 02:41:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 02:41:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:41:41 [WARNING ] (13, 1, 'bot')
2019-02-06 02:41:41 [WARNING ] (13, 1, 'bot')
2019-02-06 02:41:41 [WARNING ] (13, 1, 'bot')
2019-02-06 02:41:41 [WARNING ] (13, 1, 'bot')
2019-02-06 02:41:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:41:41 [DEBUG   ] Finished updating board flags in 1.546 seconds
2019-02-06 02:41:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 02:42:13 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 02:42:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 02:42:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 02:42:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:42:41 [WARNING ] (13, 1, 'bot')
2019-02-06 02:42:41 [WARNING ] (13, 1, 'bot')
2019-02-06 02:42:41 [WARNING ] (13, 1, 'bot')
2019-02-06 02:42:41 [WARNING ] (13, 1, 'bot')
2019-02-06 02:42:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:42:41 [DEBUG   ] Finished updating board flags in 1.459 seconds
2019-02-06 02:42:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 02:43:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 02:43:33 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 02:43:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:43:41 [WARNING ] (13, 1, 'bot')
2019-02-06 02:43:41 [WARNING ] (13, 1, 'bot')
2019-02-06 02:43:41 [WARNING ] (13, 1, 'bot')
2019-02-06 02:43:41 [WARNING ] (13, 1, 'bot')
2019-02-06 02:43:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:43:41 [DEBUG   ] Finished updating board flags in 1.475 seconds
2019-02-06 02:43:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 02:44:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 02:44:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 02:44:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:44:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:44:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:44:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:44:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:44:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:44:42 [DEBUG   ] Finished updating board flags in 1.623 seconds
2019-02-06 02:44:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 02:45:02 [DEBUG   ] Got command RPT from MCS: ref #1415478
2019-02-06 02:45:02 [DEBUG   ] summary = ERROR
2019-02-06 02:45:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415478  13 58520  9902877 A  ERRORERROR'
2019-02-06 02:45:03 [DEBUG   ] Got command RPT from MCS: ref #1415479
2019-02-06 02:45:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 02:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415479  77 58520  9903081 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 02:45:03 [DEBUG   ] Got command RPT from MCS: ref #1415480
2019-02-06 02:45:03 [DEBUG   ] summary = ERROR
2019-02-06 02:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415480  13 58520  9903285 A  ERRORERROR'
2019-02-06 02:45:03 [DEBUG   ] Got command RPT from MCS: ref #1415482
2019-02-06 02:45:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 02:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415482  77 58520  9903489 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 02:45:03 [DEBUG   ] Got command RPT from MCS: ref #1415484
2019-02-06 02:45:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 02:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415484  12 58520  9903681 A  ERRORB˜™š'
2019-02-06 02:45:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 02:45:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 02:45:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:45:41 [WARNING ] (13, 1, 'bot')
2019-02-06 02:45:41 [WARNING ] (13, 1, 'bot')
2019-02-06 02:45:41 [WARNING ] (13, 1, 'bot')
2019-02-06 02:45:41 [WARNING ] (13, 1, 'bot')
2019-02-06 02:45:41 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:45:41 [DEBUG   ] Finished updating board flags in 1.510 seconds
2019-02-06 02:45:53 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-06 02:46:12 [DEBUG   ] Got command RPT from MCS: ref #1415488
2019-02-06 02:46:12 [DEBUG   ] summary = ERROR
2019-02-06 02:46:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415488  13 58520  9972109 A  ERRORERROR'
2019-02-06 02:46:12 [DEBUG   ] Got command RPT from MCS: ref #1415489
2019-02-06 02:46:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 02:46:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415489  77 58520  9972110 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 02:46:13 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 02:46:33 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-02-06 02:46:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:46:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:46:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:46:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:46:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:46:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:46:42 [DEBUG   ] Finished updating board flags in 2.180 seconds
2019-02-06 02:46:54 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-02-06 02:47:14 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-02-06 02:47:34 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-02-06 02:47:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:47:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:47:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:47:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:47:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:47:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:47:42 [DEBUG   ] Finished updating board flags in 1.960 seconds
2019-02-06 02:47:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 02:48:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 02:48:34 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 02:48:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:48:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:48:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:48:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:48:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:48:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:48:42 [DEBUG   ] Finished updating board flags in 1.816 seconds
2019-02-06 02:48:54 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-02-06 02:49:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 02:49:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 02:49:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:49:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:49:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:49:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:49:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:49:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:49:42 [DEBUG   ] Finished updating board flags in 1.810 seconds
2019-02-06 02:49:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 02:50:02 [DEBUG   ] Got command RPT from MCS: ref #1415509
2019-02-06 02:50:02 [DEBUG   ] summary = ERROR
2019-02-06 02:50:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415509  13 58520 10202961 A  ERRORERROR'
2019-02-06 02:50:03 [DEBUG   ] Got command RPT from MCS: ref #1415510
2019-02-06 02:50:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 02:50:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415510  77 58520 10203165 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 02:50:03 [DEBUG   ] Got command RPT from MCS: ref #1415511
2019-02-06 02:50:03 [DEBUG   ] summary = ERROR
2019-02-06 02:50:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415511  13 58520 10203369 A  ERRORERROR'
2019-02-06 02:50:03 [DEBUG   ] Got command RPT from MCS: ref #1415512
2019-02-06 02:50:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 02:50:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415512  77 58520 10203561 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 02:50:03 [DEBUG   ] Got command RPT from MCS: ref #1415513
2019-02-06 02:50:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 02:50:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415513  12 58520 10203765 A  ERRORB–™š'
2019-02-06 02:50:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 02:50:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 02:50:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:50:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:50:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:50:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:50:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:50:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:50:42 [DEBUG   ] Finished updating board flags in 1.774 seconds
2019-02-06 02:50:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 02:51:12 [DEBUG   ] Got command RPT from MCS: ref #1415518
2019-02-06 02:51:12 [DEBUG   ] summary = ERROR
2019-02-06 02:51:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415518  13 58520 10272109 A  ERRORERROR'
2019-02-06 02:51:12 [DEBUG   ] Got command RPT from MCS: ref #1415519
2019-02-06 02:51:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 02:51:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415519  77 58520 10272110 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 02:51:14 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 02:51:34 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-06 02:51:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:51:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:51:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:51:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:51:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:51:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:51:42 [DEBUG   ] Finished updating board flags in 1.638 seconds
2019-02-06 02:51:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 02:52:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 02:52:34 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 02:52:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:52:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:52:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:52:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:52:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:52:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:52:42 [DEBUG   ] Finished updating board flags in 1.568 seconds
2019-02-06 02:52:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 02:53:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 02:53:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 02:53:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:53:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:53:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:53:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:53:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:53:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:53:42 [DEBUG   ] Finished updating board flags in 1.457 seconds
2019-02-06 02:53:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 02:54:14 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-02-06 02:54:35 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-02-06 02:54:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 02:54:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:54:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:54:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:54:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:54:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:54:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:54:42 [DEBUG   ] Finished updating board flags in 1.441 seconds
2019-02-06 02:54:55 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-06 02:55:03 [DEBUG   ] Got command RPT from MCS: ref #1415541
2019-02-06 02:55:03 [DEBUG   ] summary = ERROR
2019-02-06 02:55:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415541  13 58520 10503041 A  ERRORERROR'
2019-02-06 02:55:03 [DEBUG   ] Got command RPT from MCS: ref #1415542
2019-02-06 02:55:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 02:55:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415542  77 58520 10503245 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 02:55:03 [DEBUG   ] Got command RPT from MCS: ref #1415543
2019-02-06 02:55:03 [DEBUG   ] summary = ERROR
2019-02-06 02:55:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415543  13 58520 10503449 A  ERRORERROR'
2019-02-06 02:55:03 [DEBUG   ] Got command RPT from MCS: ref #1415545
2019-02-06 02:55:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 02:55:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415545  77 58520 10503641 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 02:55:03 [DEBUG   ] Got command RPT from MCS: ref #1415546
2019-02-06 02:55:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 02:55:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415546  12 58520 10503845 A  ERRORB—™š'
2019-02-06 02:55:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 02:55:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 02:55:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:55:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:55:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:55:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:55:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:55:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:55:42 [DEBUG   ] Finished updating board flags in 1.431 seconds
2019-02-06 02:55:55 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 02:56:12 [DEBUG   ] Got command RPT from MCS: ref #1415551
2019-02-06 02:56:12 [DEBUG   ] summary = ERROR
2019-02-06 02:56:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415551  13 58520 10572117 A  ERRORERROR'
2019-02-06 02:56:12 [DEBUG   ] Got command RPT from MCS: ref #1415552
2019-02-06 02:56:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 02:56:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415552  77 58520 10572118 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 02:56:15 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 02:56:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 02:56:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:56:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:56:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:56:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:56:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:56:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:56:42 [DEBUG   ] Finished updating board flags in 1.443 seconds
2019-02-06 02:56:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 02:57:15 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 02:57:35 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-06 02:57:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:57:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:57:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:57:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:57:42 [WARNING ] (13, 1, 'bot')
2019-02-06 02:57:42 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:57:42 [DEBUG   ] Finished updating board flags in 1.526 seconds
2019-02-06 02:57:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 02:58:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 02:58:35 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 02:58:42 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 02:58:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:58:43 [WARNING ] (13, 1, 'bot')
2019-02-06 02:58:43 [WARNING ] (13, 1, 'bot')
2019-02-06 02:58:43 [WARNING ] (13, 1, 'bot')
2019-02-06 02:58:43 [WARNING ] (13, 1, 'bot')
2019-02-06 02:58:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:58:43 [DEBUG   ] Finished updating board flags in 2.205 seconds
2019-02-06 02:58:55 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-06 02:59:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 02:59:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 02:59:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 02:59:43 [WARNING ] (13, 1, 'bot')
2019-02-06 02:59:43 [WARNING ] (13, 1, 'bot')
2019-02-06 02:59:43 [WARNING ] (13, 1, 'bot')
2019-02-06 02:59:43 [WARNING ] (13, 1, 'bot')
2019-02-06 02:59:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 02:59:43 [DEBUG   ] Finished updating board flags in 2.117 seconds
2019-02-06 02:59:55 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 03:00:03 [DEBUG   ] Got command RPT from MCS: ref #1415576
2019-02-06 03:00:03 [DEBUG   ] summary = ERROR
2019-02-06 03:00:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415576  13 58520 10803129 A  ERRORERROR'
2019-02-06 03:00:03 [DEBUG   ] Got command RPT from MCS: ref #1415577
2019-02-06 03:00:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 03:00:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415577  77 58520 10803322 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 03:00:03 [DEBUG   ] Got command RPT from MCS: ref #1415578
2019-02-06 03:00:03 [DEBUG   ] summary = ERROR
2019-02-06 03:00:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415578  13 58520 10803525 A  ERRORERROR'
2019-02-06 03:00:03 [DEBUG   ] Got command RPT from MCS: ref #1415579
2019-02-06 03:00:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 03:00:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415579  77 58520 10803729 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 03:00:03 [DEBUG   ] Got command RPT from MCS: ref #1415580
2019-02-06 03:00:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 03:00:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415580  12 58520 10803933 A  ERRORB˜™š'
2019-02-06 03:00:15 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 03:00:36 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-02-06 03:00:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 03:00:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:00:43 [WARNING ] (13, 1, 'bot')
2019-02-06 03:00:43 [WARNING ] (13, 1, 'bot')
2019-02-06 03:00:43 [WARNING ] (13, 1, 'bot')
2019-02-06 03:00:43 [WARNING ] (13, 1, 'bot')
2019-02-06 03:00:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:00:43 [DEBUG   ] Finished updating board flags in 2.014 seconds
2019-02-06 03:00:56 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-02-06 03:01:12 [DEBUG   ] Got command RPT from MCS: ref #1415581
2019-02-06 03:01:12 [DEBUG   ] summary = ERROR
2019-02-06 03:01:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415581  13 58520 10872117 A  ERRORERROR'
2019-02-06 03:01:12 [DEBUG   ] Got command RPT from MCS: ref #1415582
2019-02-06 03:01:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 03:01:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415582  77 58520 10872118 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 03:01:16 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 03:01:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 03:01:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:01:43 [WARNING ] (13, 1, 'bot')
2019-02-06 03:01:43 [WARNING ] (13, 1, 'bot')
2019-02-06 03:01:43 [WARNING ] (13, 1, 'bot')
2019-02-06 03:01:43 [WARNING ] (13, 1, 'bot')
2019-02-06 03:01:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:01:43 [DEBUG   ] Finished updating board flags in 1.980 seconds
2019-02-06 03:01:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 03:02:16 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 03:02:36 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 03:02:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:02:43 [WARNING ] (13, 1, 'bot')
2019-02-06 03:02:43 [WARNING ] (13, 1, 'bot')
2019-02-06 03:02:43 [WARNING ] (13, 1, 'bot')
2019-02-06 03:02:43 [WARNING ] (13, 1, 'bot')
2019-02-06 03:02:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:02:43 [DEBUG   ] Finished updating board flags in 1.840 seconds
2019-02-06 03:02:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 03:03:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 03:03:36 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 03:03:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:03:43 [WARNING ] (13, 1, 'bot')
2019-02-06 03:03:43 [WARNING ] (13, 1, 'bot')
2019-02-06 03:03:43 [WARNING ] (13, 1, 'bot')
2019-02-06 03:03:43 [WARNING ] (13, 1, 'bot')
2019-02-06 03:03:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:03:43 [DEBUG   ] Finished updating board flags in 1.813 seconds
2019-02-06 03:03:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 03:04:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 03:04:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 03:04:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:04:43 [WARNING ] (13, 1, 'bot')
2019-02-06 03:04:43 [WARNING ] (13, 1, 'bot')
2019-02-06 03:04:43 [WARNING ] (13, 1, 'bot')
2019-02-06 03:04:43 [WARNING ] (13, 1, 'bot')
2019-02-06 03:04:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:04:43 [DEBUG   ] Finished updating board flags in 1.767 seconds
2019-02-06 03:04:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 03:05:03 [DEBUG   ] Got command RPT from MCS: ref #1415604
2019-02-06 03:05:03 [DEBUG   ] summary = ERROR
2019-02-06 03:05:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415604  13 58520 11103209 A  ERRORERROR'
2019-02-06 03:05:03 [DEBUG   ] Got command RPT from MCS: ref #1415605
2019-02-06 03:05:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 03:05:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415605  77 58520 11103402 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 03:05:03 [DEBUG   ] Got command RPT from MCS: ref #1415606
2019-02-06 03:05:03 [DEBUG   ] summary = ERROR
2019-02-06 03:05:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415606  13 58520 11103605 A  ERRORERROR'
2019-02-06 03:05:03 [DEBUG   ] Got command RPT from MCS: ref #1415608
2019-02-06 03:05:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 03:05:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415608  77 58520 11103809 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 03:05:04 [DEBUG   ] Got command RPT from MCS: ref #1415610
2019-02-06 03:05:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 03:05:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415610  12 58520 11104013 A  ERRORB–™š'
2019-02-06 03:05:16 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-06 03:05:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 03:05:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:05:43 [WARNING ] (13, 1, 'bot')
2019-02-06 03:05:43 [WARNING ] (13, 1, 'bot')
2019-02-06 03:05:43 [WARNING ] (13, 1, 'bot')
2019-02-06 03:05:43 [WARNING ] (13, 1, 'bot')
2019-02-06 03:05:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:05:43 [DEBUG   ] Finished updating board flags in 1.604 seconds
2019-02-06 03:05:56 [DEBUG   ] Finished updating ant stats in 0.719 seconds
2019-02-06 03:06:12 [DEBUG   ] Got command RPT from MCS: ref #1415618
2019-02-06 03:06:12 [DEBUG   ] summary = ERROR
2019-02-06 03:06:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415618  13 58520 11172113 A  ERRORERROR'
2019-02-06 03:06:12 [DEBUG   ] Got command RPT from MCS: ref #1415619
2019-02-06 03:06:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 03:06:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415619  77 58520 11172114 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 03:06:16 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 03:06:36 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-02-06 03:06:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:06:43 [WARNING ] (13, 1, 'bot')
2019-02-06 03:06:43 [WARNING ] (13, 1, 'bot')
2019-02-06 03:06:43 [WARNING ] (13, 1, 'bot')
2019-02-06 03:06:43 [WARNING ] (13, 1, 'bot')
2019-02-06 03:06:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:06:43 [DEBUG   ] Finished updating board flags in 1.610 seconds
2019-02-06 03:06:57 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-02-06 03:07:17 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-02-06 03:07:37 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-02-06 03:07:42 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 03:07:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:07:43 [WARNING ] (13, 1, 'bot')
2019-02-06 03:07:43 [WARNING ] (13, 1, 'bot')
2019-02-06 03:07:43 [WARNING ] (13, 1, 'bot')
2019-02-06 03:07:43 [WARNING ] (13, 1, 'bot')
2019-02-06 03:07:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:07:43 [DEBUG   ] Finished updating board flags in 1.585 seconds
2019-02-06 03:07:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 03:08:17 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-02-06 03:08:37 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 03:08:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:08:43 [WARNING ] (13, 1, 'bot')
2019-02-06 03:08:43 [WARNING ] (13, 1, 'bot')
2019-02-06 03:08:43 [WARNING ] (13, 1, 'bot')
2019-02-06 03:08:43 [WARNING ] (13, 1, 'bot')
2019-02-06 03:08:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:08:43 [DEBUG   ] Finished updating board flags in 1.415 seconds
2019-02-06 03:08:57 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 03:09:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 03:09:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 03:09:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:09:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-06 03:09:43 [WARNING ] (13, 1, 'bot')
2019-02-06 03:09:43 [WARNING ] (13, 1, 'bot')
2019-02-06 03:09:43 [WARNING ] (13, 1, 'bot')
2019-02-06 03:09:43 [WARNING ] (13, 1, 'bot')
2019-02-06 03:09:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:09:43 [DEBUG   ] Finished updating board flags in 1.388 seconds
2019-02-06 03:09:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 03:10:03 [DEBUG   ] Got command RPT from MCS: ref #1415639
2019-02-06 03:10:03 [DEBUG   ] summary = ERROR
2019-02-06 03:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415639  13 58520 11403289 A  ERRORERROR'
2019-02-06 03:10:03 [DEBUG   ] Got command RPT from MCS: ref #1415640
2019-02-06 03:10:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 03:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415640  77 58520 11403493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 03:10:03 [DEBUG   ] Got command RPT from MCS: ref #1415641
2019-02-06 03:10:03 [DEBUG   ] summary = ERROR
2019-02-06 03:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415641  13 58520 11403686 A  ERRORERROR'
2019-02-06 03:10:03 [DEBUG   ] Got command RPT from MCS: ref #1415642
2019-02-06 03:10:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 03:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415642  77 58520 11403889 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 03:10:04 [DEBUG   ] Got command RPT from MCS: ref #1415643
2019-02-06 03:10:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 03:10:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415643  12 58520 11404093 A  ERRORB˜™š'
2019-02-06 03:10:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 03:10:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 03:10:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:10:43 [WARNING ] (13, 1, 'bot')
2019-02-06 03:10:43 [WARNING ] (13, 1, 'bot')
2019-02-06 03:10:43 [WARNING ] (13, 1, 'bot')
2019-02-06 03:10:43 [WARNING ] (13, 1, 'bot')
2019-02-06 03:10:43 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:10:43 [DEBUG   ] Finished updating board flags in 1.497 seconds
2019-02-06 03:10:57 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-02-06 03:11:12 [DEBUG   ] Got command RPT from MCS: ref #1415644
2019-02-06 03:11:12 [DEBUG   ] summary = ERROR
2019-02-06 03:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415644  13 58520 11472118 A  ERRORERROR'
2019-02-06 03:11:12 [DEBUG   ] Got command RPT from MCS: ref #1415645
2019-02-06 03:11:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 03:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415645  77 58520 11472118 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 03:11:18 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-02-06 03:11:38 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-06 03:11:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:11:44 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-06 03:11:44 [WARNING ] (13, 1, 'bot')
2019-02-06 03:11:44 [WARNING ] (13, 1, 'bot')
2019-02-06 03:11:44 [WARNING ] (13, 1, 'bot')
2019-02-06 03:11:44 [WARNING ] (13, 1, 'bot')
2019-02-06 03:11:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:11:44 [DEBUG   ] Finished updating board flags in 2.191 seconds
2019-02-06 03:11:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 03:12:18 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 03:12:38 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-02-06 03:12:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:12:44 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-06 03:12:44 [WARNING ] (13, 1, 'bot')
2019-02-06 03:12:44 [WARNING ] (13, 1, 'bot')
2019-02-06 03:12:44 [WARNING ] (13, 1, 'bot')
2019-02-06 03:12:44 [WARNING ] (13, 1, 'bot')
2019-02-06 03:12:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:12:44 [DEBUG   ] Finished updating board flags in 1.915 seconds
2019-02-06 03:12:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 03:13:18 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-06 03:13:38 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-02-06 03:13:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:13:44 [WARNING ] (13, 1, 'bot')
2019-02-06 03:13:44 [WARNING ] (13, 1, 'bot')
2019-02-06 03:13:44 [WARNING ] (13, 1, 'bot')
2019-02-06 03:13:44 [WARNING ] (13, 1, 'bot')
2019-02-06 03:13:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:13:44 [DEBUG   ] Finished updating board flags in 1.822 seconds
2019-02-06 03:13:58 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-02-06 03:14:18 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-06 03:14:38 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-02-06 03:14:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:14:44 [WARNING ] (13, 1, 'bot')
2019-02-06 03:14:44 [WARNING ] (13, 1, 'bot')
2019-02-06 03:14:44 [WARNING ] (13, 1, 'bot')
2019-02-06 03:14:44 [WARNING ] (13, 1, 'bot')
2019-02-06 03:14:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:14:44 [DEBUG   ] Finished updating board flags in 1.791 seconds
2019-02-06 03:14:59 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-02-06 03:15:03 [DEBUG   ] Got command RPT from MCS: ref #1415671
2019-02-06 03:15:03 [DEBUG   ] summary = ERROR
2019-02-06 03:15:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415671  13 58520 11703373 A  ERRORERROR'
2019-02-06 03:15:03 [DEBUG   ] Got command RPT from MCS: ref #1415672
2019-02-06 03:15:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 03:15:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415672  77 58520 11703565 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 03:15:03 [DEBUG   ] Got command RPT from MCS: ref #1415673
2019-02-06 03:15:03 [DEBUG   ] summary = ERROR
2019-02-06 03:15:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415673  13 58520 11703769 A  ERRORERROR'
2019-02-06 03:15:03 [DEBUG   ] Got command RPT from MCS: ref #1415675
2019-02-06 03:15:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 03:15:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415675  77 58520 11703973 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 03:15:04 [DEBUG   ] Got command RPT from MCS: ref #1415676
2019-02-06 03:15:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 03:15:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415676  12 58520 11704166 A  ERRORB˜™š'
2019-02-06 03:15:19 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-06 03:15:39 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 03:15:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:15:44 [WARNING ] (13, 1, 'bot')
2019-02-06 03:15:44 [WARNING ] (13, 1, 'bot')
2019-02-06 03:15:44 [WARNING ] (13, 1, 'bot')
2019-02-06 03:15:44 [WARNING ] (13, 1, 'bot')
2019-02-06 03:15:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:15:44 [DEBUG   ] Finished updating board flags in 1.606 seconds
2019-02-06 03:15:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 03:16:12 [DEBUG   ] Got command RPT from MCS: ref #1415681
2019-02-06 03:16:12 [DEBUG   ] summary = ERROR
2019-02-06 03:16:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415681  13 58520 11772109 A  ERRORERROR'
2019-02-06 03:16:12 [DEBUG   ] Got command RPT from MCS: ref #1415682
2019-02-06 03:16:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 03:16:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415682  77 58520 11772110 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 03:16:19 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-06 03:16:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 03:16:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 03:16:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:16:44 [WARNING ] (13, 1, 'bot')
2019-02-06 03:16:44 [WARNING ] (13, 1, 'bot')
2019-02-06 03:16:44 [WARNING ] (13, 1, 'bot')
2019-02-06 03:16:44 [WARNING ] (13, 1, 'bot')
2019-02-06 03:16:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:16:44 [DEBUG   ] Finished updating board flags in 1.617 seconds
2019-02-06 03:16:59 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 03:17:19 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2019-02-06 03:17:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 03:17:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:17:44 [WARNING ] (13, 1, 'bot')
2019-02-06 03:17:44 [WARNING ] (13, 1, 'bot')
2019-02-06 03:17:44 [WARNING ] (13, 1, 'bot')
2019-02-06 03:17:44 [WARNING ] (13, 1, 'bot')
2019-02-06 03:17:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:17:44 [DEBUG   ] Finished updating board flags in 1.578 seconds
2019-02-06 03:17:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 03:18:19 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 03:18:39 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2019-02-06 03:18:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:18:44 [WARNING ] (13, 1, 'bot')
2019-02-06 03:18:44 [WARNING ] (13, 1, 'bot')
2019-02-06 03:18:44 [WARNING ] (13, 1, 'bot')
2019-02-06 03:18:44 [WARNING ] (13, 1, 'bot')
2019-02-06 03:18:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:18:44 [DEBUG   ] Finished updating board flags in 1.421 seconds
2019-02-06 03:18:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 03:19:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 03:19:39 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 03:19:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:19:44 [WARNING ] (13, 1, 'bot')
2019-02-06 03:19:44 [WARNING ] (13, 1, 'bot')
2019-02-06 03:19:44 [WARNING ] (13, 1, 'bot')
2019-02-06 03:19:44 [WARNING ] (13, 1, 'bot')
2019-02-06 03:19:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:19:44 [DEBUG   ] Finished updating board flags in 1.383 seconds
2019-02-06 03:19:59 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-06 03:20:03 [DEBUG   ] Got command RPT from MCS: ref #1415702
2019-02-06 03:20:03 [DEBUG   ] summary = ERROR
2019-02-06 03:20:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415702  13 58520 12003445 A  ERRORERROR'
2019-02-06 03:20:03 [DEBUG   ] Got command RPT from MCS: ref #1415703
2019-02-06 03:20:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 03:20:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415703  77 58520 12003649 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 03:20:03 [DEBUG   ] Got command RPT from MCS: ref #1415704
2019-02-06 03:20:03 [DEBUG   ] summary = ERROR
2019-02-06 03:20:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415704  13 58520 12003853 A  ERRORERROR'
2019-02-06 03:20:04 [DEBUG   ] Got command RPT from MCS: ref #1415705
2019-02-06 03:20:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 03:20:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415705  77 58520 12004045 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 03:20:04 [DEBUG   ] Got command RPT from MCS: ref #1415706
2019-02-06 03:20:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 03:20:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415706  12 58520 12004249 A  ERRORB–™š'
2019-02-06 03:20:19 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-06 03:20:39 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 03:20:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:20:44 [WARNING ] (13, 1, 'bot')
2019-02-06 03:20:44 [WARNING ] (13, 1, 'bot')
2019-02-06 03:20:44 [WARNING ] (13, 1, 'bot')
2019-02-06 03:20:44 [WARNING ] (13, 1, 'bot')
2019-02-06 03:20:44 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:20:44 [DEBUG   ] Finished updating board flags in 1.398 seconds
2019-02-06 03:20:59 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-02-06 03:21:12 [DEBUG   ] Got command RPT from MCS: ref #1415711
2019-02-06 03:21:12 [DEBUG   ] summary = ERROR
2019-02-06 03:21:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415711  13 58520 12072389 A  ERRORERROR'
2019-02-06 03:21:12 [DEBUG   ] Got command RPT from MCS: ref #1415712
2019-02-06 03:21:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 03:21:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415712  77 58520 12072390 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 03:21:20 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-02-06 03:21:40 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-06 03:21:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:21:45 [WARNING ] (13, 1, 'bot')
2019-02-06 03:21:45 [WARNING ] (13, 1, 'bot')
2019-02-06 03:21:45 [WARNING ] (13, 1, 'bot')
2019-02-06 03:21:45 [WARNING ] (13, 1, 'bot')
2019-02-06 03:21:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:21:45 [DEBUG   ] Finished updating board flags in 2.021 seconds
2019-02-06 03:22:00 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-02-06 03:22:20 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 03:22:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 03:22:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:22:45 [WARNING ] (13, 1, 'bot')
2019-02-06 03:22:45 [WARNING ] (13, 1, 'bot')
2019-02-06 03:22:45 [WARNING ] (13, 1, 'bot')
2019-02-06 03:22:45 [WARNING ] (13, 1, 'bot')
2019-02-06 03:22:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:22:45 [DEBUG   ] Finished updating board flags in 1.986 seconds
2019-02-06 03:23:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 03:23:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 03:23:40 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 03:23:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:23:45 [WARNING ] (13, 1, 'bot')
2019-02-06 03:23:45 [WARNING ] (13, 1, 'bot')
2019-02-06 03:23:45 [WARNING ] (13, 1, 'bot')
2019-02-06 03:23:45 [WARNING ] (13, 1, 'bot')
2019-02-06 03:23:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:23:45 [DEBUG   ] Finished updating board flags in 1.823 seconds
2019-02-06 03:24:00 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-06 03:24:20 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 03:24:40 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 03:24:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 03:24:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:24:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-02-06 03:24:45 [WARNING ] (13, 1, 'bot')
2019-02-06 03:24:45 [WARNING ] (13, 1, 'bot')
2019-02-06 03:24:45 [WARNING ] (13, 1, 'bot')
2019-02-06 03:24:45 [WARNING ] (13, 1, 'bot')
2019-02-06 03:24:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:24:45 [DEBUG   ] Finished updating board flags in 1.780 seconds
2019-02-06 03:25:00 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-06 03:25:03 [DEBUG   ] Got command RPT from MCS: ref #1415734
2019-02-06 03:25:03 [DEBUG   ] summary = ERROR
2019-02-06 03:25:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415734  13 58520 12303538 A  ERRORERROR'
2019-02-06 03:25:03 [DEBUG   ] Got command RPT from MCS: ref #1415735
2019-02-06 03:25:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 03:25:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415735  77 58520 12303729 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 03:25:03 [DEBUG   ] Got command RPT from MCS: ref #1415736
2019-02-06 03:25:03 [DEBUG   ] summary = ERROR
2019-02-06 03:25:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415736  13 58520 12303933 A  ERRORERROR'
2019-02-06 03:25:04 [DEBUG   ] Got command RPT from MCS: ref #1415737
2019-02-06 03:25:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 03:25:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415737  77 58520 12304125 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 03:25:04 [DEBUG   ] Got command RPT from MCS: ref #1415740
2019-02-06 03:25:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 03:25:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415740  12 58520 12304329 A  ERRORB–™š'
2019-02-06 03:25:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 03:25:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 03:25:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:25:45 [WARNING ] (13, 1, 'bot')
2019-02-06 03:25:45 [WARNING ] (13, 1, 'bot')
2019-02-06 03:25:45 [WARNING ] (13, 1, 'bot')
2019-02-06 03:25:45 [WARNING ] (13, 1, 'bot')
2019-02-06 03:25:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:25:45 [DEBUG   ] Finished updating board flags in 1.612 seconds
2019-02-06 03:26:00 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 03:26:12 [DEBUG   ] Got command RPT from MCS: ref #1415744
2019-02-06 03:26:12 [DEBUG   ] summary = ERROR
2019-02-06 03:26:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415744  13 58520 12372117 A  ERRORERROR'
2019-02-06 03:26:12 [DEBUG   ] Got command RPT from MCS: ref #1415745
2019-02-06 03:26:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 03:26:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415745  77 58520 12372118 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 03:26:20 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 03:26:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 03:26:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:26:45 [WARNING ] (13, 1, 'bot')
2019-02-06 03:26:45 [WARNING ] (13, 1, 'bot')
2019-02-06 03:26:45 [WARNING ] (13, 1, 'bot')
2019-02-06 03:26:45 [WARNING ] (13, 1, 'bot')
2019-02-06 03:26:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:26:45 [DEBUG   ] Finished updating board flags in 1.614 seconds
2019-02-06 03:27:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 03:27:20 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 03:27:40 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 03:27:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:27:45 [WARNING ] (13, 1, 'bot')
2019-02-06 03:27:45 [WARNING ] (13, 1, 'bot')
2019-02-06 03:27:45 [WARNING ] (13, 1, 'bot')
2019-02-06 03:27:45 [WARNING ] (13, 1, 'bot')
2019-02-06 03:27:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:27:45 [DEBUG   ] Finished updating board flags in 1.581 seconds
2019-02-06 03:28:01 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-02-06 03:28:21 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 03:28:41 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 03:28:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:28:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-06 03:28:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-06 03:28:45 [WARNING ] (13, 1, 'bot')
2019-02-06 03:28:45 [WARNING ] (13, 1, 'bot')
2019-02-06 03:28:45 [WARNING ] (13, 1, 'bot')
2019-02-06 03:28:45 [WARNING ] (13, 1, 'bot')
2019-02-06 03:28:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:28:45 [DEBUG   ] Finished updating board flags in 1.411 seconds
2019-02-06 03:29:01 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 03:29:21 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-02-06 03:29:41 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 03:29:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:29:45 [WARNING ] (13, 1, 'bot')
2019-02-06 03:29:45 [WARNING ] (13, 1, 'bot')
2019-02-06 03:29:45 [WARNING ] (13, 1, 'bot')
2019-02-06 03:29:45 [WARNING ] (13, 1, 'bot')
2019-02-06 03:29:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:29:45 [DEBUG   ] Finished updating board flags in 1.401 seconds
2019-02-06 03:30:01 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 03:30:03 [DEBUG   ] Got command RPT from MCS: ref #1415769
2019-02-06 03:30:03 [DEBUG   ] summary = ERROR
2019-02-06 03:30:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415769  13 58520 12603613 A  ERRORERROR'
2019-02-06 03:30:03 [DEBUG   ] Got command RPT from MCS: ref #1415770
2019-02-06 03:30:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 03:30:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415770  77 58520 12603805 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 03:30:04 [DEBUG   ] Got command RPT from MCS: ref #1415771
2019-02-06 03:30:04 [DEBUG   ] summary = ERROR
2019-02-06 03:30:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415771  13 58520 12604009 A  ERRORERROR'
2019-02-06 03:30:04 [DEBUG   ] Got command RPT from MCS: ref #1415772
2019-02-06 03:30:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 03:30:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415772  77 58520 12604213 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 03:30:04 [DEBUG   ] Got command RPT from MCS: ref #1415773
2019-02-06 03:30:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 03:30:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415773  12 58520 12604417 A  ERRORB˜™š'
2019-02-06 03:30:21 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-06 03:30:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 03:30:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:30:45 [WARNING ] (13, 1, 'bot')
2019-02-06 03:30:45 [WARNING ] (13, 1, 'bot')
2019-02-06 03:30:45 [WARNING ] (13, 1, 'bot')
2019-02-06 03:30:45 [WARNING ] (13, 1, 'bot')
2019-02-06 03:30:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:30:45 [DEBUG   ] Finished updating board flags in 1.403 seconds
2019-02-06 03:31:01 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-02-06 03:31:12 [DEBUG   ] Got command RPT from MCS: ref #1415774
2019-02-06 03:31:12 [DEBUG   ] summary = ERROR
2019-02-06 03:31:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415774  13 58520 12672117 A  ERRORERROR'
2019-02-06 03:31:12 [DEBUG   ] Got command RPT from MCS: ref #1415775
2019-02-06 03:31:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 03:31:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415775  77 58520 12672118 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 03:31:21 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 03:31:42 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-02-06 03:31:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:31:45 [WARNING ] (13, 1, 'bot')
2019-02-06 03:31:45 [WARNING ] (13, 1, 'bot')
2019-02-06 03:31:45 [WARNING ] (13, 1, 'bot')
2019-02-06 03:31:45 [WARNING ] (13, 1, 'bot')
2019-02-06 03:31:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:31:45 [DEBUG   ] Finished updating board flags in 1.409 seconds
2019-02-06 03:32:02 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-02-06 03:32:22 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-02-06 03:32:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 03:32:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:32:45 [WARNING ] (13, 1, 'bot')
2019-02-06 03:32:45 [WARNING ] (13, 1, 'bot')
2019-02-06 03:32:45 [WARNING ] (13, 1, 'bot')
2019-02-06 03:32:45 [WARNING ] (13, 1, 'bot')
2019-02-06 03:32:45 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:32:45 [DEBUG   ] Finished updating board flags in 1.399 seconds
2019-02-06 03:33:02 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 03:33:22 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-06 03:33:42 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-06 03:33:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:33:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:33:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:33:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:33:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:33:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:33:46 [DEBUG   ] Finished updating board flags in 2.207 seconds
2019-02-06 03:34:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 03:34:22 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 03:34:42 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 03:34:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:34:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:34:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:34:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:34:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:34:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:34:46 [DEBUG   ] Finished updating board flags in 2.180 seconds
2019-02-06 03:35:02 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-02-06 03:35:03 [DEBUG   ] Got command RPT from MCS: ref #1415797
2019-02-06 03:35:03 [DEBUG   ] summary = ERROR
2019-02-06 03:35:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415797  13 58520 12903689 A  ERRORERROR'
2019-02-06 03:35:03 [DEBUG   ] Got command RPT from MCS: ref #1415798
2019-02-06 03:35:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 03:35:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415798  77 58520 12903893 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 03:35:04 [DEBUG   ] Got command RPT from MCS: ref #1415799
2019-02-06 03:35:04 [DEBUG   ] summary = ERROR
2019-02-06 03:35:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415799  13 58520 12904097 A  ERRORERROR'
2019-02-06 03:35:04 [DEBUG   ] Got command RPT from MCS: ref #1415801
2019-02-06 03:35:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 03:35:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415801  77 58520 12904289 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 03:35:04 [DEBUG   ] Got command RPT from MCS: ref #1415802
2019-02-06 03:35:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 03:35:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415802  12 58520 12904493 A  ERRORB—™š'
2019-02-06 03:35:22 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-06 03:35:43 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-02-06 03:35:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:35:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:35:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:35:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:35:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:35:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:35:46 [DEBUG   ] Finished updating board flags in 2.025 seconds
2019-02-06 03:36:03 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-02-06 03:36:12 [DEBUG   ] Got command RPT from MCS: ref #1415811
2019-02-06 03:36:12 [DEBUG   ] summary = ERROR
2019-02-06 03:36:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415811  13 58520 12972125 A  ERRORERROR'
2019-02-06 03:36:12 [DEBUG   ] Got command RPT from MCS: ref #1415812
2019-02-06 03:36:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 03:36:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415812  77 58520 12972126 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 03:36:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 03:36:43 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 03:36:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:36:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:36:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:36:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:36:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:36:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:36:46 [DEBUG   ] Finished updating board flags in 1.983 seconds
2019-02-06 03:37:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 03:37:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 03:37:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 03:37:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:37:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:37:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:37:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:37:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:37:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:37:46 [DEBUG   ] Finished updating board flags in 1.925 seconds
2019-02-06 03:38:03 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 03:38:23 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 03:38:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 03:38:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:38:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:38:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:38:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:38:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:38:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:38:46 [DEBUG   ] Finished updating board flags in 1.681 seconds
2019-02-06 03:39:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 03:39:23 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 03:39:43 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-06 03:39:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 03:39:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:39:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:39:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:39:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:39:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:39:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:39:46 [DEBUG   ] Finished updating board flags in 1.643 seconds
2019-02-06 03:40:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 03:40:03 [DEBUG   ] Got command RPT from MCS: ref #1415832
2019-02-06 03:40:03 [DEBUG   ] summary = ERROR
2019-02-06 03:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415832  13 58520 13203769 A  ERRORERROR'
2019-02-06 03:40:03 [DEBUG   ] Got command RPT from MCS: ref #1415833
2019-02-06 03:40:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 03:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415833  77 58520 13203973 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 03:40:04 [DEBUG   ] Got command RPT from MCS: ref #1415834
2019-02-06 03:40:04 [DEBUG   ] summary = ERROR
2019-02-06 03:40:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415834  13 58520 13204169 A  ERRORERROR'
2019-02-06 03:40:04 [DEBUG   ] Got command RPT from MCS: ref #1415835
2019-02-06 03:40:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 03:40:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415835  77 58520 13204373 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 03:40:04 [DEBUG   ] Got command RPT from MCS: ref #1415836
2019-02-06 03:40:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 03:40:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415836  12 58520 13204577 A  ERRORB–™š'
2019-02-06 03:40:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 03:40:43 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 03:40:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:40:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:40:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:40:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:40:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:40:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:40:46 [DEBUG   ] Finished updating board flags in 1.601 seconds
2019-02-06 03:41:03 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 03:41:12 [DEBUG   ] Got command RPT from MCS: ref #1415837
2019-02-06 03:41:12 [DEBUG   ] summary = ERROR
2019-02-06 03:41:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415837  13 58520 13272121 A  ERRORERROR'
2019-02-06 03:41:12 [DEBUG   ] Got command RPT from MCS: ref #1415838
2019-02-06 03:41:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 03:41:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415838  77 58520 13272122 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 03:41:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 03:41:43 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 03:41:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:41:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-06 03:41:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:41:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:41:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:41:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:41:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:41:46 [DEBUG   ] Finished updating board flags in 1.561 seconds
2019-02-06 03:42:03 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-02-06 03:42:24 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-02-06 03:42:44 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-06 03:42:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:42:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:42:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:42:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:42:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:42:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:42:46 [DEBUG   ] Finished updating board flags in 1.409 seconds
2019-02-06 03:43:04 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-02-06 03:43:24 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 03:43:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 03:43:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:43:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-06 03:43:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:43:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:43:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:43:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:43:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:43:46 [DEBUG   ] Finished updating board flags in 1.412 seconds
2019-02-06 03:44:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 03:44:24 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 03:44:44 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-02-06 03:44:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:44:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-06 03:44:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:44:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:44:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:44:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:44:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:44:46 [DEBUG   ] Finished updating board flags in 1.381 seconds
2019-02-06 03:45:03 [DEBUG   ] Got command RPT from MCS: ref #1415864
2019-02-06 03:45:03 [DEBUG   ] summary = ERROR
2019-02-06 03:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415864  13 58520 13503845 A  ERRORERROR'
2019-02-06 03:45:04 [DEBUG   ] Got command RPT from MCS: ref #1415865
2019-02-06 03:45:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 03:45:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415865  77 58520 13504049 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 03:45:04 [DEBUG   ] Got command RPT from MCS: ref #1415866
2019-02-06 03:45:04 [DEBUG   ] summary = ERROR
2019-02-06 03:45:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415866  13 58520 13504253 A  ERRORERROR'
2019-02-06 03:45:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 03:45:04 [DEBUG   ] Got command RPT from MCS: ref #1415868
2019-02-06 03:45:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 03:45:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415868  77 58520 13504457 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 03:45:04 [DEBUG   ] Got command RPT from MCS: ref #1415869
2019-02-06 03:45:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 03:45:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415869  12 58520 13504649 A  ERRORB˜™š'
2019-02-06 03:45:24 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-06 03:45:44 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 03:45:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:45:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:45:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:45:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:45:46 [WARNING ] (13, 1, 'bot')
2019-02-06 03:45:46 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:45:46 [DEBUG   ] Finished updating board flags in 1.369 seconds
2019-02-06 03:46:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 03:46:12 [DEBUG   ] Got command RPT from MCS: ref #1415874
2019-02-06 03:46:12 [DEBUG   ] summary = ERROR
2019-02-06 03:46:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415874  13 58520 13572117 A  ERRORERROR'
2019-02-06 03:46:12 [DEBUG   ] Got command RPT from MCS: ref #1415875
2019-02-06 03:46:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 03:46:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415875  77 58520 13572118 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 03:46:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 03:46:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 03:46:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:46:47 [WARNING ] (13, 1, 'bot')
2019-02-06 03:46:47 [WARNING ] (13, 1, 'bot')
2019-02-06 03:46:47 [WARNING ] (13, 1, 'bot')
2019-02-06 03:46:47 [WARNING ] (13, 1, 'bot')
2019-02-06 03:46:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:46:47 [DEBUG   ] Finished updating board flags in 2.045 seconds
2019-02-06 03:47:04 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-02-06 03:47:24 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 03:47:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-06 03:47:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:47:47 [WARNING ] (13, 1, 'bot')
2019-02-06 03:47:47 [WARNING ] (13, 1, 'bot')
2019-02-06 03:47:47 [WARNING ] (13, 1, 'bot')
2019-02-06 03:47:47 [WARNING ] (13, 1, 'bot')
2019-02-06 03:47:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:47:47 [DEBUG   ] Finished updating board flags in 1.994 seconds
2019-02-06 03:48:05 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2019-02-06 03:48:25 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-06 03:48:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 03:48:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:48:47 [WARNING ] (13, 1, 'bot')
2019-02-06 03:48:47 [WARNING ] (13, 1, 'bot')
2019-02-06 03:48:47 [WARNING ] (13, 1, 'bot')
2019-02-06 03:48:47 [WARNING ] (13, 1, 'bot')
2019-02-06 03:48:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:48:47 [DEBUG   ] Finished updating board flags in 1.812 seconds
2019-02-06 03:49:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 03:49:25 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 03:49:45 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 03:49:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:49:47 [WARNING ] (13, 1, 'bot')
2019-02-06 03:49:47 [WARNING ] (13, 1, 'bot')
2019-02-06 03:49:47 [WARNING ] (13, 1, 'bot')
2019-02-06 03:49:47 [WARNING ] (13, 1, 'bot')
2019-02-06 03:49:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:49:47 [DEBUG   ] Finished updating board flags in 1.804 seconds
2019-02-06 03:50:03 [DEBUG   ] Got command RPT from MCS: ref #1415895
2019-02-06 03:50:03 [DEBUG   ] summary = ERROR
2019-02-06 03:50:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415895  13 58520 13803930 A  ERRORERROR'
2019-02-06 03:50:04 [DEBUG   ] Got command RPT from MCS: ref #1415896
2019-02-06 03:50:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 03:50:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415896  77 58520 13804133 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 03:50:04 [DEBUG   ] Got command RPT from MCS: ref #1415897
2019-02-06 03:50:04 [DEBUG   ] summary = ERROR
2019-02-06 03:50:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415897  13 58520 13804338 A  ERRORERROR'
2019-02-06 03:50:04 [DEBUG   ] Got command RPT from MCS: ref #1415898
2019-02-06 03:50:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 03:50:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415898  77 58520 13804530 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 03:50:04 [DEBUG   ] Got command RPT from MCS: ref #1415899
2019-02-06 03:50:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 03:50:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415899  12 58520 13804733 A  ERRORB—™š'
2019-02-06 03:50:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 03:50:25 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-02-06 03:50:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 03:50:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:50:47 [WARNING ] (13, 1, 'bot')
2019-02-06 03:50:47 [WARNING ] (13, 1, 'bot')
2019-02-06 03:50:47 [WARNING ] (13, 1, 'bot')
2019-02-06 03:50:47 [WARNING ] (13, 1, 'bot')
2019-02-06 03:50:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:50:47 [DEBUG   ] Finished updating board flags in 1.814 seconds
2019-02-06 03:51:05 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 03:51:12 [DEBUG   ] Got command RPT from MCS: ref #1415904
2019-02-06 03:51:12 [DEBUG   ] summary = ERROR
2019-02-06 03:51:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415904  13 58520 13872117 A  ERRORERROR'
2019-02-06 03:51:12 [DEBUG   ] Got command RPT from MCS: ref #1415905
2019-02-06 03:51:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 03:51:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415905  77 58520 13872118 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 03:51:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 03:51:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 03:51:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:51:47 [WARNING ] (13, 1, 'bot')
2019-02-06 03:51:47 [WARNING ] (13, 1, 'bot')
2019-02-06 03:51:47 [WARNING ] (13, 1, 'bot')
2019-02-06 03:51:47 [WARNING ] (13, 1, 'bot')
2019-02-06 03:51:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:51:47 [DEBUG   ] Finished updating board flags in 1.784 seconds
2019-02-06 03:52:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 03:52:25 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 03:52:45 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-06 03:52:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:52:47 [WARNING ] (13, 1, 'bot')
2019-02-06 03:52:47 [WARNING ] (13, 1, 'bot')
2019-02-06 03:52:47 [WARNING ] (13, 1, 'bot')
2019-02-06 03:52:47 [WARNING ] (13, 1, 'bot')
2019-02-06 03:52:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:52:47 [DEBUG   ] Finished updating board flags in 1.612 seconds
2019-02-06 03:53:05 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-06 03:53:26 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-02-06 03:53:46 [DEBUG   ] Finished updating ant stats in 1.253 seconds
2019-02-06 03:53:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:53:47 [WARNING ] (13, 1, 'bot')
2019-02-06 03:53:47 [WARNING ] (13, 1, 'bot')
2019-02-06 03:53:47 [WARNING ] (13, 1, 'bot')
2019-02-06 03:53:47 [WARNING ] (13, 1, 'bot')
2019-02-06 03:53:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:53:47 [DEBUG   ] Finished updating board flags in 1.594 seconds
2019-02-06 03:54:06 [DEBUG   ] Finished updating ant stats in 1.156 seconds
2019-02-06 03:54:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 03:54:46 [DEBUG   ] Finished updating ant stats in 1.045 seconds
2019-02-06 03:54:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:54:47 [WARNING ] (13, 1, 'bot')
2019-02-06 03:54:47 [WARNING ] (13, 1, 'bot')
2019-02-06 03:54:47 [WARNING ] (13, 1, 'bot')
2019-02-06 03:54:47 [WARNING ] (13, 1, 'bot')
2019-02-06 03:54:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:54:47 [DEBUG   ] Finished updating board flags in 1.409 seconds
2019-02-06 03:55:04 [DEBUG   ] Got command RPT from MCS: ref #1415927
2019-02-06 03:55:04 [DEBUG   ] summary = ERROR
2019-02-06 03:55:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415927  13 58520 14104009 A  ERRORERROR'
2019-02-06 03:55:04 [DEBUG   ] Got command RPT from MCS: ref #1415928
2019-02-06 03:55:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 03:55:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415928  77 58520 14104213 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 03:55:04 [DEBUG   ] Got command RPT from MCS: ref #1415929
2019-02-06 03:55:04 [DEBUG   ] summary = ERROR
2019-02-06 03:55:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415929  13 58520 14104417 A  ERRORERROR'
2019-02-06 03:55:04 [DEBUG   ] Got command RPT from MCS: ref #1415931
2019-02-06 03:55:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 03:55:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415931  77 58520 14104609 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 03:55:04 [DEBUG   ] Got command RPT from MCS: ref #1415933
2019-02-06 03:55:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 03:55:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415933  12 58520 14104813 A  ERRORB–™š'
2019-02-06 03:55:06 [DEBUG   ] Finished updating ant stats in 0.954 seconds
2019-02-06 03:55:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 03:55:46 [DEBUG   ] Finished updating ant stats in 0.850 seconds
2019-02-06 03:55:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:55:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-02-06 03:55:47 [WARNING ] (13, 1, 'bot')
2019-02-06 03:55:47 [WARNING ] (13, 1, 'bot')
2019-02-06 03:55:47 [WARNING ] (13, 1, 'bot')
2019-02-06 03:55:47 [WARNING ] (13, 1, 'bot')
2019-02-06 03:55:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:55:47 [DEBUG   ] Finished updating board flags in 1.393 seconds
2019-02-06 03:56:06 [DEBUG   ] Finished updating ant stats in 0.754 seconds
2019-02-06 03:56:12 [DEBUG   ] Got command RPT from MCS: ref #1415937
2019-02-06 03:56:12 [DEBUG   ] summary = ERROR
2019-02-06 03:56:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415937  13 58520 14172125 A  ERRORERROR'
2019-02-06 03:56:12 [DEBUG   ] Got command RPT from MCS: ref #1415938
2019-02-06 03:56:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 03:56:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415938  77 58520 14172126 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 03:56:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 03:56:46 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 03:56:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:56:47 [WARNING ] (13, 1, 'bot')
2019-02-06 03:56:47 [WARNING ] (13, 1, 'bot')
2019-02-06 03:56:47 [WARNING ] (13, 1, 'bot')
2019-02-06 03:56:47 [WARNING ] (13, 1, 'bot')
2019-02-06 03:56:47 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:56:47 [DEBUG   ] Finished updating board flags in 1.357 seconds
2019-02-06 03:57:06 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 03:57:26 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-02-06 03:57:47 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-02-06 03:57:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:57:48 [WARNING ] (13, 1, 'bot')
2019-02-06 03:57:48 [WARNING ] (13, 1, 'bot')
2019-02-06 03:57:48 [WARNING ] (13, 1, 'bot')
2019-02-06 03:57:48 [WARNING ] (13, 1, 'bot')
2019-02-06 03:57:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:57:48 [DEBUG   ] Finished updating board flags in 2.056 seconds
2019-02-06 03:58:07 [DEBUG   ] Finished updating ant stats in 1.139 seconds
2019-02-06 03:58:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 03:58:47 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 03:58:47 [DEBUG   ] Finished updating ant stats in 1.050 seconds
2019-02-06 03:58:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:58:48 [WARNING ] (13, 1, 'bot')
2019-02-06 03:58:48 [WARNING ] (13, 1, 'bot')
2019-02-06 03:58:48 [WARNING ] (13, 1, 'bot')
2019-02-06 03:58:48 [WARNING ] (13, 1, 'bot')
2019-02-06 03:58:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:58:48 [DEBUG   ] Finished updating board flags in 2.006 seconds
2019-02-06 03:59:07 [DEBUG   ] Finished updating ant stats in 0.956 seconds
2019-02-06 03:59:27 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 03:59:47 [DEBUG   ] Finished updating ant stats in 0.648 seconds
2019-02-06 03:59:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 03:59:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-06 03:59:48 [WARNING ] (13, 1, 'bot')
2019-02-06 03:59:48 [WARNING ] (13, 1, 'bot')
2019-02-06 03:59:48 [WARNING ] (13, 1, 'bot')
2019-02-06 03:59:48 [WARNING ] (13, 1, 'bot')
2019-02-06 03:59:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 03:59:48 [DEBUG   ] Finished updating board flags in 1.993 seconds
2019-02-06 04:00:04 [DEBUG   ] Got command RPT from MCS: ref #1415962
2019-02-06 04:00:04 [DEBUG   ] summary = ERROR
2019-02-06 04:00:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415962  13 58520 14404097 A  ERRORERROR'
2019-02-06 04:00:04 [DEBUG   ] Got command RPT from MCS: ref #1415963
2019-02-06 04:00:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 04:00:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415963  77 58520 14404289 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 04:00:04 [DEBUG   ] Got command RPT from MCS: ref #1415964
2019-02-06 04:00:04 [DEBUG   ] summary = ERROR
2019-02-06 04:00:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415964  13 58520 14404493 A  ERRORERROR'
2019-02-06 04:00:04 [DEBUG   ] Got command RPT from MCS: ref #1415965
2019-02-06 04:00:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 04:00:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415965  77 58520 14404697 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 04:00:04 [DEBUG   ] Got command RPT from MCS: ref #1415966
2019-02-06 04:00:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 04:00:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415966  12 58520 14404901 A  ERRORB˜™š'
2019-02-06 04:00:07 [DEBUG   ] Finished updating ant stats in 0.546 seconds
2019-02-06 04:00:28 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-02-06 04:00:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:00:48 [DEBUG   ] Finished updating ant stats in 1.250 seconds
2019-02-06 04:00:48 [WARNING ] (13, 1, 'bot')
2019-02-06 04:00:48 [WARNING ] (13, 1, 'bot')
2019-02-06 04:00:48 [WARNING ] (13, 1, 'bot')
2019-02-06 04:00:48 [WARNING ] (13, 1, 'bot')
2019-02-06 04:00:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:00:48 [DEBUG   ] Finished updating board flags in 1.865 seconds
2019-02-06 04:01:08 [DEBUG   ] Finished updating ant stats in 1.158 seconds
2019-02-06 04:01:12 [DEBUG   ] Got command RPT from MCS: ref #1415967
2019-02-06 04:01:12 [DEBUG   ] summary = ERROR
2019-02-06 04:01:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415967  13 58520 14472129 A  ERRORERROR'
2019-02-06 04:01:12 [DEBUG   ] Got command RPT from MCS: ref #1415968
2019-02-06 04:01:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 04:01:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415968  77 58520 14472130 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 04:01:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 04:01:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:01:48 [DEBUG   ] Finished updating ant stats in 1.047 seconds
2019-02-06 04:01:48 [WARNING ] (13, 1, 'bot')
2019-02-06 04:01:48 [WARNING ] (13, 1, 'bot')
2019-02-06 04:01:48 [WARNING ] (13, 1, 'bot')
2019-02-06 04:01:48 [WARNING ] (13, 1, 'bot')
2019-02-06 04:01:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:01:48 [DEBUG   ] Finished updating board flags in 1.801 seconds
2019-02-06 04:02:08 [DEBUG   ] Finished updating ant stats in 0.958 seconds
2019-02-06 04:02:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 04:02:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:02:48 [DEBUG   ] Finished updating ant stats in 0.847 seconds
2019-02-06 04:02:48 [WARNING ] (13, 1, 'bot')
2019-02-06 04:02:48 [WARNING ] (13, 1, 'bot')
2019-02-06 04:02:48 [WARNING ] (13, 1, 'bot')
2019-02-06 04:02:48 [WARNING ] (13, 1, 'bot')
2019-02-06 04:02:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:02:48 [DEBUG   ] Finished updating board flags in 1.792 seconds
2019-02-06 04:03:08 [DEBUG   ] Finished updating ant stats in 0.759 seconds
2019-02-06 04:03:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 04:03:48 [DEBUG   ] Finished updating ant stats in 0.651 seconds
2019-02-06 04:03:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:03:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:03:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:03:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:03:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:03:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:03:49 [DEBUG   ] Finished updating board flags in 2.559 seconds
2019-02-06 04:04:08 [DEBUG   ] Finished updating ant stats in 0.556 seconds
2019-02-06 04:04:29 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-02-06 04:04:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:04:48 [WARNING ] (13, 1, 'bot')
2019-02-06 04:04:48 [WARNING ] (13, 1, 'bot')
2019-02-06 04:04:48 [WARNING ] (13, 1, 'bot')
2019-02-06 04:04:48 [WARNING ] (13, 1, 'bot')
2019-02-06 04:04:48 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:04:48 [DEBUG   ] Finished updating board flags in 1.445 seconds
2019-02-06 04:04:49 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-06 04:05:04 [DEBUG   ] Got command RPT from MCS: ref #1415990
2019-02-06 04:05:04 [DEBUG   ] summary = ERROR
2019-02-06 04:05:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415990  13 58520 14704177 A  ERRORERROR'
2019-02-06 04:05:04 [DEBUG   ] Got command RPT from MCS: ref #1415991
2019-02-06 04:05:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 04:05:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415991  77 58520 14704369 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 04:05:04 [DEBUG   ] Got command RPT from MCS: ref #1415992
2019-02-06 04:05:04 [DEBUG   ] summary = ERROR
2019-02-06 04:05:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415992  13 58520 14704573 A  ERRORERROR'
2019-02-06 04:05:04 [DEBUG   ] Got command RPT from MCS: ref #1415994
2019-02-06 04:05:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 04:05:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415994  77 58520 14704777 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 04:05:04 [DEBUG   ] Got command RPT from MCS: ref #1415996
2019-02-06 04:05:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 04:05:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1415996  12 58520 14704969 A  ERRORB—™š'
2019-02-06 04:05:09 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-02-06 04:05:29 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 04:05:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:05:49 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-06 04:05:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:05:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:05:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:05:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:05:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:05:49 [DEBUG   ] Finished updating board flags in 2.357 seconds
2019-02-06 04:06:09 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-02-06 04:06:12 [DEBUG   ] Got command RPT from MCS: ref #1416004
2019-02-06 04:06:12 [DEBUG   ] summary = ERROR
2019-02-06 04:06:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416004  13 58520 14772129 A  ERRORERROR'
2019-02-06 04:06:12 [DEBUG   ] Got command RPT from MCS: ref #1416005
2019-02-06 04:06:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 04:06:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416005  77 58520 14772130 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 04:06:29 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 04:06:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:06:49 [DEBUG   ] Finished updating ant stats in 0.843 seconds
2019-02-06 04:06:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:06:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:06:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:06:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:06:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:06:49 [DEBUG   ] Finished updating board flags in 2.252 seconds
2019-02-06 04:07:09 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2019-02-06 04:07:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 04:07:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:07:49 [DEBUG   ] Finished updating ant stats in 0.647 seconds
2019-02-06 04:07:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:07:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:07:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:07:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:07:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:07:49 [DEBUG   ] Finished updating board flags in 2.177 seconds
2019-02-06 04:08:09 [DEBUG   ] Finished updating ant stats in 0.559 seconds
2019-02-06 04:08:30 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-02-06 04:08:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:08:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:08:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:08:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:08:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:08:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:08:49 [DEBUG   ] Finished updating board flags in 2.041 seconds
2019-02-06 04:08:50 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-02-06 04:09:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 04:09:30 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 04:09:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:09:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:09:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:09:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:09:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:09:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:09:49 [DEBUG   ] Finished updating board flags in 2.019 seconds
2019-02-06 04:09:50 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 04:10:04 [DEBUG   ] Got command RPT from MCS: ref #1416025
2019-02-06 04:10:04 [DEBUG   ] summary = ERROR
2019-02-06 04:10:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416025  13 58520 15004253 A  ERRORERROR'
2019-02-06 04:10:04 [DEBUG   ] Got command RPT from MCS: ref #1416026
2019-02-06 04:10:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 04:10:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416026  77 58520 15004457 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 04:10:04 [DEBUG   ] Got command RPT from MCS: ref #1416027
2019-02-06 04:10:04 [DEBUG   ] summary = ERROR
2019-02-06 04:10:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416027  13 58520 15004649 A  ERRORERROR'
2019-02-06 04:10:04 [DEBUG   ] Got command RPT from MCS: ref #1416028
2019-02-06 04:10:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 04:10:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416028  77 58520 15004853 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 04:10:05 [DEBUG   ] Got command RPT from MCS: ref #1416029
2019-02-06 04:10:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 04:10:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416029  12 58520 15005057 A  ERRORB–™š'
2019-02-06 04:10:10 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 04:10:30 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-02-06 04:10:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:10:50 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 04:10:50 [WARNING ] (13, 1, 'bot')
2019-02-06 04:10:50 [WARNING ] (13, 1, 'bot')
2019-02-06 04:10:50 [WARNING ] (13, 1, 'bot')
2019-02-06 04:10:50 [WARNING ] (13, 1, 'bot')
2019-02-06 04:10:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:10:50 [DEBUG   ] Finished updating board flags in 2.878 seconds
2019-02-06 04:11:10 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-06 04:11:12 [DEBUG   ] Got command RPT from MCS: ref #1416030
2019-02-06 04:11:12 [DEBUG   ] summary = ERROR
2019-02-06 04:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416030  13 58520 15072125 A  ERRORERROR'
2019-02-06 04:11:12 [DEBUG   ] Got command RPT from MCS: ref #1416031
2019-02-06 04:11:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 04:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416031  77 58520 15072126 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 04:11:30 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 04:11:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:11:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:11:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:11:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:11:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:11:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:11:49 [DEBUG   ] Finished updating board flags in 1.877 seconds
2019-02-06 04:11:50 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-06 04:12:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 04:12:30 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 04:12:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:12:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-02-06 04:12:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:12:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:12:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:12:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:12:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:12:49 [DEBUG   ] Finished updating board flags in 1.757 seconds
2019-02-06 04:12:50 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2019-02-06 04:13:11 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-02-06 04:13:31 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-02-06 04:13:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:13:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-06 04:13:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:13:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:13:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:13:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:13:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:13:49 [DEBUG   ] Finished updating board flags in 1.607 seconds
2019-02-06 04:13:51 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 04:14:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 04:14:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 04:14:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:14:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:14:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:14:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:14:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:14:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:14:49 [DEBUG   ] Finished updating board flags in 1.583 seconds
2019-02-06 04:14:51 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-06 04:15:04 [DEBUG   ] Got command RPT from MCS: ref #1416057
2019-02-06 04:15:04 [DEBUG   ] summary = ERROR
2019-02-06 04:15:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416057  13 58520 15304337 A  ERRORERROR'
2019-02-06 04:15:04 [DEBUG   ] Got command RPT from MCS: ref #1416058
2019-02-06 04:15:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 04:15:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416058  77 58520 15304529 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 04:15:04 [DEBUG   ] Got command RPT from MCS: ref #1416059
2019-02-06 04:15:04 [DEBUG   ] summary = ERROR
2019-02-06 04:15:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416059  13 58520 15304733 A  ERRORERROR'
2019-02-06 04:15:04 [DEBUG   ] Got command RPT from MCS: ref #1416061
2019-02-06 04:15:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 04:15:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416061  77 58520 15304937 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 04:15:05 [DEBUG   ] Got command RPT from MCS: ref #1416062
2019-02-06 04:15:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 04:15:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416062  12 58520 15305129 A  ERRORB—™š'
2019-02-06 04:15:11 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2019-02-06 04:15:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 04:15:48 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 04:15:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:15:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:15:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:15:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:15:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:15:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:15:49 [DEBUG   ] Finished updating board flags in 1.418 seconds
2019-02-06 04:15:51 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-02-06 04:16:11 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-02-06 04:16:12 [DEBUG   ] Got command RPT from MCS: ref #1416067
2019-02-06 04:16:12 [DEBUG   ] summary = ERROR
2019-02-06 04:16:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416067  13 58520 15372121 A  ERRORERROR'
2019-02-06 04:16:12 [DEBUG   ] Got command RPT from MCS: ref #1416068
2019-02-06 04:16:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 04:16:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416068  77 58520 15372122 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 04:16:31 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 04:16:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:16:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:16:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:16:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:16:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:16:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:16:49 [DEBUG   ] Finished updating board flags in 1.413 seconds
2019-02-06 04:16:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 04:17:11 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 04:17:31 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 04:17:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:17:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:17:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:17:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:17:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:17:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:17:49 [DEBUG   ] Finished updating board flags in 1.413 seconds
2019-02-06 04:17:51 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 04:18:11 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-06 04:18:31 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-06 04:18:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 04:18:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:18:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:18:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:18:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:18:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:18:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:18:49 [DEBUG   ] Finished updating board flags in 1.365 seconds
2019-02-06 04:18:52 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2019-02-06 04:19:12 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-06 04:19:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 04:19:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:19:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:19:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:19:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:19:49 [WARNING ] (13, 1, 'bot')
2019-02-06 04:19:49 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:19:49 [DEBUG   ] Finished updating board flags in 1.370 seconds
2019-02-06 04:19:52 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-02-06 04:20:04 [DEBUG   ] Got command RPT from MCS: ref #1416088
2019-02-06 04:20:04 [DEBUG   ] summary = ERROR
2019-02-06 04:20:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416088  13 58520 15604409 A  ERRORERROR'
2019-02-06 04:20:04 [DEBUG   ] Got command RPT from MCS: ref #1416089
2019-02-06 04:20:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 04:20:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416089  77 58520 15604613 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 04:20:04 [DEBUG   ] Got command RPT from MCS: ref #1416090
2019-02-06 04:20:04 [DEBUG   ] summary = ERROR
2019-02-06 04:20:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416090  13 58520 15604817 A  ERRORERROR'
2019-02-06 04:20:05 [DEBUG   ] Got command RPT from MCS: ref #1416091
2019-02-06 04:20:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 04:20:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416091  77 58520 15605021 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 04:20:05 [DEBUG   ] Got command RPT from MCS: ref #1416092
2019-02-06 04:20:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 04:20:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416092  12 58520 15605213 A  ERRORB—™š'
2019-02-06 04:20:12 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 04:20:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 04:20:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:20:50 [WARNING ] (13, 1, 'bot')
2019-02-06 04:20:50 [WARNING ] (13, 1, 'bot')
2019-02-06 04:20:50 [WARNING ] (13, 1, 'bot')
2019-02-06 04:20:50 [WARNING ] (13, 1, 'bot')
2019-02-06 04:20:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:20:50 [DEBUG   ] Finished updating board flags in 2.048 seconds
2019-02-06 04:20:52 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 04:21:12 [DEBUG   ] Got command RPT from MCS: ref #1416097
2019-02-06 04:21:12 [DEBUG   ] summary = ERROR
2019-02-06 04:21:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416097  13 58520 15672125 A  ERRORERROR'
2019-02-06 04:21:12 [DEBUG   ] Got command RPT from MCS: ref #1416098
2019-02-06 04:21:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 04:21:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416098  77 58520 15672126 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 04:21:12 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-06 04:21:32 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-06 04:21:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:21:50 [WARNING ] (13, 1, 'bot')
2019-02-06 04:21:50 [WARNING ] (13, 1, 'bot')
2019-02-06 04:21:50 [WARNING ] (13, 1, 'bot')
2019-02-06 04:21:50 [WARNING ] (13, 1, 'bot')
2019-02-06 04:21:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:21:50 [DEBUG   ] Finished updating board flags in 1.999 seconds
2019-02-06 04:21:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 04:22:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 04:22:32 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-02-06 04:22:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:22:50 [WARNING ] (13, 1, 'bot')
2019-02-06 04:22:50 [WARNING ] (13, 1, 'bot')
2019-02-06 04:22:50 [WARNING ] (13, 1, 'bot')
2019-02-06 04:22:50 [WARNING ] (13, 1, 'bot')
2019-02-06 04:22:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:22:50 [DEBUG   ] Finished updating board flags in 1.802 seconds
2019-02-06 04:22:52 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-02-06 04:23:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 04:23:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 04:23:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:23:50 [WARNING ] (13, 1, 'bot')
2019-02-06 04:23:50 [WARNING ] (13, 1, 'bot')
2019-02-06 04:23:50 [WARNING ] (13, 1, 'bot')
2019-02-06 04:23:50 [WARNING ] (13, 1, 'bot')
2019-02-06 04:23:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:23:50 [DEBUG   ] Finished updating board flags in 1.809 seconds
2019-02-06 04:23:52 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-02-06 04:24:12 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-02-06 04:24:32 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-06 04:24:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:24:50 [WARNING ] (13, 1, 'bot')
2019-02-06 04:24:50 [WARNING ] (13, 1, 'bot')
2019-02-06 04:24:50 [WARNING ] (13, 1, 'bot')
2019-02-06 04:24:50 [WARNING ] (13, 1, 'bot')
2019-02-06 04:24:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:24:50 [DEBUG   ] Finished updating board flags in 1.786 seconds
2019-02-06 04:24:53 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-02-06 04:25:04 [DEBUG   ] Got command RPT from MCS: ref #1416120
2019-02-06 04:25:04 [DEBUG   ] summary = ERROR
2019-02-06 04:25:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416120  13 58520 15904489 A  ERRORERROR'
2019-02-06 04:25:04 [DEBUG   ] Got command RPT from MCS: ref #1416121
2019-02-06 04:25:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 04:25:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416121  77 58520 15904693 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 04:25:04 [DEBUG   ] Got command RPT from MCS: ref #1416122
2019-02-06 04:25:04 [DEBUG   ] summary = ERROR
2019-02-06 04:25:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416122  13 58520 15904897 A  ERRORERROR'
2019-02-06 04:25:05 [DEBUG   ] Got command RPT from MCS: ref #1416124
2019-02-06 04:25:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 04:25:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416124  77 58520 15905089 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 04:25:05 [DEBUG   ] Got command RPT from MCS: ref #1416125
2019-02-06 04:25:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 04:25:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416125  12 58520 15905293 A  ERRORB–™š'
2019-02-06 04:25:13 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-02-06 04:25:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 04:25:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:25:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-02-06 04:25:50 [WARNING ] (13, 1, 'bot')
2019-02-06 04:25:50 [WARNING ] (13, 1, 'bot')
2019-02-06 04:25:50 [WARNING ] (13, 1, 'bot')
2019-02-06 04:25:50 [WARNING ] (13, 1, 'bot')
2019-02-06 04:25:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:25:50 [DEBUG   ] Finished updating board flags in 1.611 seconds
2019-02-06 04:25:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 04:26:12 [DEBUG   ] Got command RPT from MCS: ref #1416130
2019-02-06 04:26:12 [DEBUG   ] summary = ERROR
2019-02-06 04:26:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416130  13 58520 15972126 A  ERRORERROR'
2019-02-06 04:26:12 [DEBUG   ] Got command RPT from MCS: ref #1416131
2019-02-06 04:26:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 04:26:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416131  77 58520 15972126 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 04:26:13 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 04:26:33 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 04:26:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 04:26:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:26:50 [WARNING ] (13, 1, 'bot')
2019-02-06 04:26:50 [WARNING ] (13, 1, 'bot')
2019-02-06 04:26:50 [WARNING ] (13, 1, 'bot')
2019-02-06 04:26:50 [WARNING ] (13, 1, 'bot')
2019-02-06 04:26:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:26:50 [DEBUG   ] Finished updating board flags in 1.596 seconds
2019-02-06 04:26:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 04:27:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 04:27:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 04:27:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:27:50 [WARNING ] (13, 1, 'bot')
2019-02-06 04:27:50 [WARNING ] (13, 1, 'bot')
2019-02-06 04:27:50 [WARNING ] (13, 1, 'bot')
2019-02-06 04:27:50 [WARNING ] (13, 1, 'bot')
2019-02-06 04:27:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:27:50 [DEBUG   ] Finished updating board flags in 1.549 seconds
2019-02-06 04:27:53 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-06 04:28:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 04:28:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 04:28:49 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 04:28:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:28:50 [WARNING ] (13, 1, 'bot')
2019-02-06 04:28:50 [WARNING ] (13, 1, 'bot')
2019-02-06 04:28:50 [WARNING ] (13, 1, 'bot')
2019-02-06 04:28:50 [WARNING ] (13, 1, 'bot')
2019-02-06 04:28:50 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:28:50 [DEBUG   ] Finished updating board flags in 1.551 seconds
2019-02-06 04:28:53 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 04:29:13 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-02-06 04:29:33 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-02-06 04:29:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:29:51 [WARNING ] (13, 1, 'bot')
2019-02-06 04:29:51 [WARNING ] (13, 1, 'bot')
2019-02-06 04:29:51 [WARNING ] (13, 1, 'bot')
2019-02-06 04:29:51 [WARNING ] (13, 1, 'bot')
2019-02-06 04:29:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:29:51 [DEBUG   ] Finished updating board flags in 2.183 seconds
2019-02-06 04:29:54 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-02-06 04:30:04 [DEBUG   ] Got command RPT from MCS: ref #1416155
2019-02-06 04:30:04 [DEBUG   ] summary = ERROR
2019-02-06 04:30:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416155  13 58520 16204569 A  ERRORERROR'
2019-02-06 04:30:04 [DEBUG   ] Got command RPT from MCS: ref #1416156
2019-02-06 04:30:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 04:30:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416156  77 58520 16204773 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 04:30:04 [DEBUG   ] Got command RPT from MCS: ref #1416157
2019-02-06 04:30:04 [DEBUG   ] summary = ERROR
2019-02-06 04:30:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416157  13 58520 16204977 A  ERRORERROR'
2019-02-06 04:30:05 [DEBUG   ] Got command RPT from MCS: ref #1416158
2019-02-06 04:30:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 04:30:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416158  77 58520 16205173 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 04:30:05 [DEBUG   ] Got command RPT from MCS: ref #1416159
2019-02-06 04:30:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 04:30:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416159  12 58520 16205377 A  ERRORB˜™š'
2019-02-06 04:30:14 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-06 04:30:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 04:30:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:30:51 [WARNING ] (13, 1, 'bot')
2019-02-06 04:30:51 [WARNING ] (13, 1, 'bot')
2019-02-06 04:30:51 [WARNING ] (13, 1, 'bot')
2019-02-06 04:30:51 [WARNING ] (13, 1, 'bot')
2019-02-06 04:30:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:30:51 [DEBUG   ] Finished updating board flags in 1.942 seconds
2019-02-06 04:30:54 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 04:31:12 [DEBUG   ] Got command RPT from MCS: ref #1416160
2019-02-06 04:31:12 [DEBUG   ] summary = ERROR
2019-02-06 04:31:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416160  13 58520 16272129 A  ERRORERROR'
2019-02-06 04:31:12 [DEBUG   ] Got command RPT from MCS: ref #1416161
2019-02-06 04:31:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 04:31:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416161  77 58520 16272130 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 04:31:14 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-02-06 04:31:34 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-02-06 04:31:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:31:51 [WARNING ] (13, 1, 'bot')
2019-02-06 04:31:51 [WARNING ] (13, 1, 'bot')
2019-02-06 04:31:51 [WARNING ] (13, 1, 'bot')
2019-02-06 04:31:51 [WARNING ] (13, 1, 'bot')
2019-02-06 04:31:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:31:51 [DEBUG   ] Finished updating board flags in 1.816 seconds
2019-02-06 04:31:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 04:32:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 04:32:34 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-06 04:32:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:32:51 [WARNING ] (13, 1, 'bot')
2019-02-06 04:32:51 [WARNING ] (13, 1, 'bot')
2019-02-06 04:32:51 [WARNING ] (13, 1, 'bot')
2019-02-06 04:32:51 [WARNING ] (13, 1, 'bot')
2019-02-06 04:32:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:32:51 [DEBUG   ] Finished updating board flags in 1.778 seconds
2019-02-06 04:32:54 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-02-06 04:33:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 04:33:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 04:33:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:33:51 [WARNING ] (13, 1, 'bot')
2019-02-06 04:33:51 [WARNING ] (13, 1, 'bot')
2019-02-06 04:33:51 [WARNING ] (13, 1, 'bot')
2019-02-06 04:33:51 [WARNING ] (13, 1, 'bot')
2019-02-06 04:33:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:33:51 [DEBUG   ] Finished updating board flags in 1.610 seconds
2019-02-06 04:33:54 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-02-06 04:34:14 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-06 04:34:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 04:34:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:34:51 [WARNING ] (13, 1, 'bot')
2019-02-06 04:34:51 [WARNING ] (13, 1, 'bot')
2019-02-06 04:34:51 [WARNING ] (13, 1, 'bot')
2019-02-06 04:34:51 [WARNING ] (13, 1, 'bot')
2019-02-06 04:34:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:34:51 [DEBUG   ] Finished updating board flags in 1.582 seconds
2019-02-06 04:34:54 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-02-06 04:35:04 [DEBUG   ] Got command RPT from MCS: ref #1416183
2019-02-06 04:35:04 [DEBUG   ] summary = ERROR
2019-02-06 04:35:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416183  13 58520 16504653 A  ERRORERROR'
2019-02-06 04:35:04 [DEBUG   ] Got command RPT from MCS: ref #1416184
2019-02-06 04:35:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 04:35:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416184  77 58520 16504857 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 04:35:05 [DEBUG   ] Got command RPT from MCS: ref #1416185
2019-02-06 04:35:05 [DEBUG   ] summary = ERROR
2019-02-06 04:35:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416185  13 58520 16505049 A  ERRORERROR'
2019-02-06 04:35:05 [DEBUG   ] Got command RPT from MCS: ref #1416187
2019-02-06 04:35:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 04:35:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416187  77 58520 16505253 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 04:35:05 [DEBUG   ] Got command RPT from MCS: ref #1416188
2019-02-06 04:35:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 04:35:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416188  12 58520 16505457 A  ERRORB—™š'
2019-02-06 04:35:14 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-06 04:35:34 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-02-06 04:35:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:35:51 [WARNING ] (13, 1, 'bot')
2019-02-06 04:35:51 [WARNING ] (13, 1, 'bot')
2019-02-06 04:35:51 [WARNING ] (13, 1, 'bot')
2019-02-06 04:35:51 [WARNING ] (13, 1, 'bot')
2019-02-06 04:35:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:35:51 [DEBUG   ] Finished updating board flags in 1.422 seconds
2019-02-06 04:35:54 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-06 04:36:12 [DEBUG   ] Got command RPT from MCS: ref #1416197
2019-02-06 04:36:12 [DEBUG   ] summary = ERROR
2019-02-06 04:36:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416197  13 58520 16572133 A  ERRORERROR'
2019-02-06 04:36:12 [DEBUG   ] Got command RPT from MCS: ref #1416198
2019-02-06 04:36:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 04:36:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416198  77 58520 16572134 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 04:36:14 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-02-06 04:36:35 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-02-06 04:36:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:36:51 [WARNING ] (13, 1, 'bot')
2019-02-06 04:36:51 [WARNING ] (13, 1, 'bot')
2019-02-06 04:36:51 [WARNING ] (13, 1, 'bot')
2019-02-06 04:36:51 [WARNING ] (13, 1, 'bot')
2019-02-06 04:36:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:36:51 [DEBUG   ] Finished updating board flags in 1.390 seconds
2019-02-06 04:36:55 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-06 04:37:15 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-02-06 04:37:35 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 04:37:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:37:51 [WARNING ] (13, 1, 'bot')
2019-02-06 04:37:51 [WARNING ] (13, 1, 'bot')
2019-02-06 04:37:51 [WARNING ] (13, 1, 'bot')
2019-02-06 04:37:51 [WARNING ] (13, 1, 'bot')
2019-02-06 04:37:51 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:37:51 [DEBUG   ] Finished updating board flags in 1.376 seconds
2019-02-06 04:37:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 04:38:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 04:38:35 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 04:38:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:38:52 [WARNING ] (13, 1, 'bot')
2019-02-06 04:38:52 [WARNING ] (13, 1, 'bot')
2019-02-06 04:38:52 [WARNING ] (13, 1, 'bot')
2019-02-06 04:38:52 [WARNING ] (13, 1, 'bot')
2019-02-06 04:38:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:38:52 [DEBUG   ] Finished updating board flags in 2.036 seconds
2019-02-06 04:38:55 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-06 04:39:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 04:39:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 04:39:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:39:52 [WARNING ] (13, 1, 'bot')
2019-02-06 04:39:52 [WARNING ] (13, 1, 'bot')
2019-02-06 04:39:52 [WARNING ] (13, 1, 'bot')
2019-02-06 04:39:52 [WARNING ] (13, 1, 'bot')
2019-02-06 04:39:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:39:52 [DEBUG   ] Finished updating board flags in 2.010 seconds
2019-02-06 04:39:55 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-02-06 04:40:04 [DEBUG   ] Got command RPT from MCS: ref #1416218
2019-02-06 04:40:04 [DEBUG   ] summary = ERROR
2019-02-06 04:40:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416218  13 58520 16804733 A  ERRORERROR'
2019-02-06 04:40:04 [DEBUG   ] Got command RPT from MCS: ref #1416219
2019-02-06 04:40:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 04:40:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416219  77 58520 16804937 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 04:40:05 [DEBUG   ] Got command RPT from MCS: ref #1416220
2019-02-06 04:40:05 [DEBUG   ] summary = ERROR
2019-02-06 04:40:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416220  13 58520 16805129 A  ERRORERROR'
2019-02-06 04:40:05 [DEBUG   ] Got command RPT from MCS: ref #1416221
2019-02-06 04:40:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 04:40:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416221  77 58520 16805333 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 04:40:05 [DEBUG   ] Got command RPT from MCS: ref #1416222
2019-02-06 04:40:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 04:40:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416222  12 58520 16805537 A  ERRORB–™š'
2019-02-06 04:40:15 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 04:40:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 04:40:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:40:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-02-06 04:40:52 [WARNING ] (13, 1, 'bot')
2019-02-06 04:40:52 [WARNING ] (13, 1, 'bot')
2019-02-06 04:40:52 [WARNING ] (13, 1, 'bot')
2019-02-06 04:40:52 [WARNING ] (13, 1, 'bot')
2019-02-06 04:40:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:40:52 [DEBUG   ] Finished updating board flags in 1.994 seconds
2019-02-06 04:40:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 04:41:12 [DEBUG   ] Got command RPT from MCS: ref #1416223
2019-02-06 04:41:12 [DEBUG   ] summary = ERROR
2019-02-06 04:41:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416223  13 58520 16872133 A  ERRORERROR'
2019-02-06 04:41:12 [DEBUG   ] Got command RPT from MCS: ref #1416224
2019-02-06 04:41:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 04:41:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416224  77 58520 16872134 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 04:41:15 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-02-06 04:41:35 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 04:41:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:41:52 [WARNING ] (13, 1, 'bot')
2019-02-06 04:41:52 [WARNING ] (13, 1, 'bot')
2019-02-06 04:41:52 [WARNING ] (13, 1, 'bot')
2019-02-06 04:41:52 [WARNING ] (13, 1, 'bot')
2019-02-06 04:41:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:41:52 [DEBUG   ] Finished updating board flags in 1.835 seconds
2019-02-06 04:41:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-06 04:42:15 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-06 04:42:36 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-02-06 04:42:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:42:52 [WARNING ] (13, 1, 'bot')
2019-02-06 04:42:52 [WARNING ] (13, 1, 'bot')
2019-02-06 04:42:52 [WARNING ] (13, 1, 'bot')
2019-02-06 04:42:52 [WARNING ] (13, 1, 'bot')
2019-02-06 04:42:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:42:52 [DEBUG   ] Finished updating board flags in 1.763 seconds
2019-02-06 04:42:56 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-06 04:43:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 04:43:36 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-02-06 04:43:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:43:52 [WARNING ] (13, 1, 'bot')
2019-02-06 04:43:52 [WARNING ] (13, 1, 'bot')
2019-02-06 04:43:52 [WARNING ] (13, 1, 'bot')
2019-02-06 04:43:52 [WARNING ] (13, 1, 'bot')
2019-02-06 04:43:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:43:52 [DEBUG   ] Finished updating board flags in 1.630 seconds
2019-02-06 04:43:56 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 04:44:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 04:44:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 04:44:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 04:44:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:44:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-02-06 04:44:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-06 04:44:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-06 04:44:52 [WARNING ] (13, 1, 'bot')
2019-02-06 04:44:52 [WARNING ] (13, 1, 'bot')
2019-02-06 04:44:52 [WARNING ] (13, 1, 'bot')
2019-02-06 04:44:52 [WARNING ] (13, 1, 'bot')
2019-02-06 04:44:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:44:52 [DEBUG   ] Finished updating board flags in 1.572 seconds
2019-02-06 04:44:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 04:45:04 [DEBUG   ] Got command RPT from MCS: ref #1416250
2019-02-06 04:45:04 [DEBUG   ] summary = ERROR
2019-02-06 04:45:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416250  13 58520 17104805 A  ERRORERROR'
2019-02-06 04:45:05 [DEBUG   ] Got command RPT from MCS: ref #1416251
2019-02-06 04:45:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 04:45:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416251  77 58520 17105009 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 04:45:05 [DEBUG   ] Got command RPT from MCS: ref #1416252
2019-02-06 04:45:05 [DEBUG   ] summary = ERROR
2019-02-06 04:45:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416252  13 58520 17105213 A  ERRORERROR'
2019-02-06 04:45:05 [DEBUG   ] Got command RPT from MCS: ref #1416253
2019-02-06 04:45:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 04:45:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416253  77 58520 17105432 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 04:45:05 [DEBUG   ] Got command RPT from MCS: ref #1416255
2019-02-06 04:45:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 04:45:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416255  12 58520 17105609 A  ERRORB—™š'
2019-02-06 04:45:16 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-06 04:45:36 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 04:45:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 04:45:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:45:52 [WARNING ] (13, 1, 'bot')
2019-02-06 04:45:52 [WARNING ] (13, 1, 'bot')
2019-02-06 04:45:52 [WARNING ] (13, 1, 'bot')
2019-02-06 04:45:52 [WARNING ] (13, 1, 'bot')
2019-02-06 04:45:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:45:52 [DEBUG   ] Finished updating board flags in 1.412 seconds
2019-02-06 04:45:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 04:46:12 [DEBUG   ] Got command RPT from MCS: ref #1416260
2019-02-06 04:46:12 [DEBUG   ] summary = ERROR
2019-02-06 04:46:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416260  13 58520 17172129 A  ERRORERROR'
2019-02-06 04:46:12 [DEBUG   ] Got command RPT from MCS: ref #1416261
2019-02-06 04:46:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 04:46:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416261  77 58520 17172130 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 04:46:16 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-02-06 04:46:36 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 04:46:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 04:46:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:46:52 [WARNING ] (13, 1, 'bot')
2019-02-06 04:46:52 [WARNING ] (13, 1, 'bot')
2019-02-06 04:46:52 [WARNING ] (13, 1, 'bot')
2019-02-06 04:46:52 [WARNING ] (13, 1, 'bot')
2019-02-06 04:46:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:46:52 [DEBUG   ] Finished updating board flags in 1.393 seconds
2019-02-06 04:46:57 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-02-06 04:47:17 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-02-06 04:47:37 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-02-06 04:47:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:47:52 [WARNING ] (13, 1, 'bot')
2019-02-06 04:47:52 [WARNING ] (13, 1, 'bot')
2019-02-06 04:47:52 [WARNING ] (13, 1, 'bot')
2019-02-06 04:47:52 [WARNING ] (13, 1, 'bot')
2019-02-06 04:47:52 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:47:52 [DEBUG   ] Finished updating board flags in 1.357 seconds
2019-02-06 04:47:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 04:48:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 04:48:37 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-02-06 04:48:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:48:53 [WARNING ] (13, 1, 'bot')
2019-02-06 04:48:53 [WARNING ] (13, 1, 'bot')
2019-02-06 04:48:53 [WARNING ] (13, 1, 'bot')
2019-02-06 04:48:53 [WARNING ] (13, 1, 'bot')
2019-02-06 04:48:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:48:53 [DEBUG   ] Finished updating board flags in 2.055 seconds
2019-02-06 04:48:57 [DEBUG   ] Finished updating ant stats in 0.987 seconds
2019-02-06 04:49:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 04:49:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 04:49:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:49:53 [WARNING ] (13, 1, 'bot')
2019-02-06 04:49:53 [WARNING ] (13, 1, 'bot')
2019-02-06 04:49:53 [WARNING ] (13, 1, 'bot')
2019-02-06 04:49:53 [WARNING ] (13, 1, 'bot')
2019-02-06 04:49:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:49:53 [DEBUG   ] Finished updating board flags in 1.989 seconds
2019-02-06 04:49:57 [DEBUG   ] Finished updating ant stats in 0.788 seconds
2019-02-06 04:50:04 [DEBUG   ] Got command RPT from MCS: ref #1416281
2019-02-06 04:50:04 [DEBUG   ] summary = ERROR
2019-02-06 04:50:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416281  13 58520 17404889 A  ERRORERROR'
2019-02-06 04:50:05 [DEBUG   ] Got command RPT from MCS: ref #1416282
2019-02-06 04:50:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 04:50:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416282  77 58520 17405093 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 04:50:05 [DEBUG   ] Got command RPT from MCS: ref #1416283
2019-02-06 04:50:05 [DEBUG   ] summary = ERROR
2019-02-06 04:50:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416283  13 58520 17405297 A  ERRORERROR'
2019-02-06 04:50:05 [DEBUG   ] Got command RPT from MCS: ref #1416284
2019-02-06 04:50:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 04:50:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416284  77 58520 17405489 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 04:50:05 [DEBUG   ] Got command RPT from MCS: ref #1416285
2019-02-06 04:50:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 04:50:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416285  12 58520 17405693 A  ERRORB—™š'
2019-02-06 04:50:17 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 04:50:38 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-02-06 04:50:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:50:53 [WARNING ] (13, 1, 'bot')
2019-02-06 04:50:53 [WARNING ] (13, 1, 'bot')
2019-02-06 04:50:53 [WARNING ] (13, 1, 'bot')
2019-02-06 04:50:53 [WARNING ] (13, 1, 'bot')
2019-02-06 04:50:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:50:53 [DEBUG   ] Finished updating board flags in 1.812 seconds
2019-02-06 04:50:58 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-02-06 04:51:12 [DEBUG   ] Got command RPT from MCS: ref #1416290
2019-02-06 04:51:12 [DEBUG   ] summary = ERROR
2019-02-06 04:51:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416290  13 58520 17472129 A  ERRORERROR'
2019-02-06 04:51:12 [DEBUG   ] Got command RPT from MCS: ref #1416291
2019-02-06 04:51:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 04:51:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416291  77 58520 17472130 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 04:51:18 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-02-06 04:51:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 04:51:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:51:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-02-06 04:51:53 [WARNING ] (13, 1, 'bot')
2019-02-06 04:51:53 [WARNING ] (13, 1, 'bot')
2019-02-06 04:51:53 [WARNING ] (13, 1, 'bot')
2019-02-06 04:51:53 [WARNING ] (13, 1, 'bot')
2019-02-06 04:51:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:51:53 [DEBUG   ] Finished updating board flags in 1.793 seconds
2019-02-06 04:51:58 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-06 04:52:18 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-06 04:52:38 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-02-06 04:52:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:52:53 [WARNING ] (13, 1, 'bot')
2019-02-06 04:52:53 [WARNING ] (13, 1, 'bot')
2019-02-06 04:52:53 [WARNING ] (13, 1, 'bot')
2019-02-06 04:52:53 [WARNING ] (13, 1, 'bot')
2019-02-06 04:52:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:52:53 [DEBUG   ] Finished updating board flags in 1.615 seconds
2019-02-06 04:52:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 04:53:18 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 04:53:38 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-02-06 04:53:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:53:53 [WARNING ] (13, 1, 'bot')
2019-02-06 04:53:53 [WARNING ] (13, 1, 'bot')
2019-02-06 04:53:53 [WARNING ] (13, 1, 'bot')
2019-02-06 04:53:53 [WARNING ] (13, 1, 'bot')
2019-02-06 04:53:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:53:53 [DEBUG   ] Finished updating board flags in 1.582 seconds
2019-02-06 04:53:58 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-06 04:54:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 04:54:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 04:54:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:54:53 [WARNING ] (13, 1, 'bot')
2019-02-06 04:54:53 [WARNING ] (13, 1, 'bot')
2019-02-06 04:54:53 [WARNING ] (13, 1, 'bot')
2019-02-06 04:54:53 [WARNING ] (13, 1, 'bot')
2019-02-06 04:54:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:54:53 [DEBUG   ] Finished updating board flags in 1.410 seconds
2019-02-06 04:54:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 04:55:04 [DEBUG   ] Got command RPT from MCS: ref #1416313
2019-02-06 04:55:04 [DEBUG   ] summary = ERROR
2019-02-06 04:55:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416313  13 58520 17704969 A  ERRORERROR'
2019-02-06 04:55:05 [DEBUG   ] Got command RPT from MCS: ref #1416314
2019-02-06 04:55:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 04:55:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416314  77 58520 17705173 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 04:55:05 [DEBUG   ] Got command RPT from MCS: ref #1416315
2019-02-06 04:55:05 [DEBUG   ] summary = ERROR
2019-02-06 04:55:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416315  13 58520 17705377 A  ERRORERROR'
2019-02-06 04:55:05 [DEBUG   ] Got command RPT from MCS: ref #1416317
2019-02-06 04:55:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 04:55:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416317  77 58520 17705569 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 04:55:05 [DEBUG   ] Got command RPT from MCS: ref #1416318
2019-02-06 04:55:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 04:55:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416318  12 58520 17705773 A  ERRORB–™š'
2019-02-06 04:55:18 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 04:55:39 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-02-06 04:55:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:55:53 [WARNING ] (13, 1, 'bot')
2019-02-06 04:55:53 [WARNING ] (13, 1, 'bot')
2019-02-06 04:55:53 [WARNING ] (13, 1, 'bot')
2019-02-06 04:55:53 [WARNING ] (13, 1, 'bot')
2019-02-06 04:55:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:55:53 [DEBUG   ] Finished updating board flags in 1.395 seconds
2019-02-06 04:55:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 04:56:12 [DEBUG   ] Got command RPT from MCS: ref #1416323
2019-02-06 04:56:12 [DEBUG   ] summary = ERROR
2019-02-06 04:56:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416323  13 58520 17772137 A  ERRORERROR'
2019-02-06 04:56:12 [DEBUG   ] Got command RPT from MCS: ref #1416324
2019-02-06 04:56:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 04:56:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416324  77 58520 17772138 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 04:56:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 04:56:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 04:56:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:56:53 [WARNING ] (13, 1, 'bot')
2019-02-06 04:56:53 [WARNING ] (13, 1, 'bot')
2019-02-06 04:56:53 [WARNING ] (13, 1, 'bot')
2019-02-06 04:56:53 [WARNING ] (13, 1, 'bot')
2019-02-06 04:56:53 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:56:53 [DEBUG   ] Finished updating board flags in 1.371 seconds
2019-02-06 04:56:59 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-02-06 04:57:19 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 04:57:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 04:57:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:57:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-02-06 04:57:54 [WARNING ] (13, 1, 'bot')
2019-02-06 04:57:54 [WARNING ] (13, 1, 'bot')
2019-02-06 04:57:54 [WARNING ] (13, 1, 'bot')
2019-02-06 04:57:54 [WARNING ] (13, 1, 'bot')
2019-02-06 04:57:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:57:54 [DEBUG   ] Finished updating board flags in 2.051 seconds
2019-02-06 04:57:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 04:58:19 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 04:58:39 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-06 04:58:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:58:54 [WARNING ] (13, 1, 'bot')
2019-02-06 04:58:54 [WARNING ] (13, 1, 'bot')
2019-02-06 04:58:54 [WARNING ] (13, 1, 'bot')
2019-02-06 04:58:54 [WARNING ] (13, 1, 'bot')
2019-02-06 04:58:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:58:54 [DEBUG   ] Finished updating board flags in 1.991 seconds
2019-02-06 04:58:59 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-06 04:59:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 04:59:39 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 04:59:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 04:59:54 [WARNING ] (13, 1, 'bot')
2019-02-06 04:59:54 [WARNING ] (13, 1, 'bot')
2019-02-06 04:59:54 [WARNING ] (13, 1, 'bot')
2019-02-06 04:59:54 [WARNING ] (13, 1, 'bot')
2019-02-06 04:59:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 04:59:54 [DEBUG   ] Finished updating board flags in 1.824 seconds
2019-02-06 04:59:59 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 05:00:05 [DEBUG   ] Got command RPT from MCS: ref #1416348
2019-02-06 05:00:05 [DEBUG   ] summary = ERROR
2019-02-06 05:00:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416348  13 58520 18005049 A  ERRORERROR'
2019-02-06 05:00:05 [DEBUG   ] Got command RPT from MCS: ref #1416349
2019-02-06 05:00:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 05:00:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416349  77 58520 18005253 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 05:00:05 [DEBUG   ] Got command RPT from MCS: ref #1416350
2019-02-06 05:00:05 [DEBUG   ] summary = ERROR
2019-02-06 05:00:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416350  13 58520 18005457 A  ERRORERROR'
2019-02-06 05:00:05 [DEBUG   ] Got command RPT from MCS: ref #1416351
2019-02-06 05:00:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 05:00:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416351  77 58520 18005661 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 05:00:05 [DEBUG   ] Got command RPT from MCS: ref #1416352
2019-02-06 05:00:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 05:00:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416352  12 58520 18005853 A  ERRORB–™š'
2019-02-06 05:00:19 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-06 05:00:40 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-02-06 05:00:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:00:54 [WARNING ] (13, 1, 'bot')
2019-02-06 05:00:54 [WARNING ] (13, 1, 'bot')
2019-02-06 05:00:54 [WARNING ] (13, 1, 'bot')
2019-02-06 05:00:54 [WARNING ] (13, 1, 'bot')
2019-02-06 05:00:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:00:54 [DEBUG   ] Finished updating board flags in 1.775 seconds
2019-02-06 05:00:59 [DEBUG   ] Finished updating ant stats in 0.409 seconds
2019-02-06 05:01:12 [DEBUG   ] Got command RPT from MCS: ref #1416353
2019-02-06 05:01:12 [DEBUG   ] summary = ERROR
2019-02-06 05:01:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416353  13 58520 18072137 A  ERRORERROR'
2019-02-06 05:01:12 [DEBUG   ] Got command RPT from MCS: ref #1416354
2019-02-06 05:01:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 05:01:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416354  77 58520 18072138 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 05:01:19 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-02-06 05:01:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 05:01:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:01:54 [WARNING ] (13, 1, 'bot')
2019-02-06 05:01:54 [WARNING ] (13, 1, 'bot')
2019-02-06 05:01:54 [WARNING ] (13, 1, 'bot')
2019-02-06 05:01:54 [WARNING ] (13, 1, 'bot')
2019-02-06 05:01:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:01:54 [DEBUG   ] Finished updating board flags in 1.617 seconds
2019-02-06 05:02:00 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-02-06 05:02:20 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-02-06 05:02:40 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 05:02:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:02:54 [WARNING ] (13, 1, 'bot')
2019-02-06 05:02:54 [WARNING ] (13, 1, 'bot')
2019-02-06 05:02:54 [WARNING ] (13, 1, 'bot')
2019-02-06 05:02:54 [WARNING ] (13, 1, 'bot')
2019-02-06 05:02:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:02:54 [DEBUG   ] Finished updating board flags in 1.589 seconds
2019-02-06 05:03:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 05:03:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 05:03:40 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-06 05:03:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 05:03:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:03:54 [WARNING ] (13, 1, 'bot')
2019-02-06 05:03:54 [WARNING ] (13, 1, 'bot')
2019-02-06 05:03:54 [WARNING ] (13, 1, 'bot')
2019-02-06 05:03:54 [WARNING ] (13, 1, 'bot')
2019-02-06 05:03:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:03:54 [DEBUG   ] Finished updating board flags in 1.411 seconds
2019-02-06 05:04:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 05:04:20 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 05:04:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 05:04:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:04:54 [WARNING ] (13, 1, 'bot')
2019-02-06 05:04:54 [WARNING ] (13, 1, 'bot')
2019-02-06 05:04:54 [WARNING ] (13, 1, 'bot')
2019-02-06 05:04:54 [WARNING ] (13, 1, 'bot')
2019-02-06 05:04:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:04:54 [DEBUG   ] Finished updating board flags in 1.398 seconds
2019-02-06 05:05:00 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 05:05:05 [DEBUG   ] Got command RPT from MCS: ref #1416376
2019-02-06 05:05:05 [DEBUG   ] summary = ERROR
2019-02-06 05:05:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416376  13 58520 18305129 A  ERRORERROR'
2019-02-06 05:05:05 [DEBUG   ] Got command RPT from MCS: ref #1416377
2019-02-06 05:05:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 05:05:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416377  77 58520 18305333 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 05:05:05 [DEBUG   ] Got command RPT from MCS: ref #1416378
2019-02-06 05:05:05 [DEBUG   ] summary = ERROR
2019-02-06 05:05:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416378  13 58520 18305537 A  ERRORERROR'
2019-02-06 05:05:05 [DEBUG   ] Got command RPT from MCS: ref #1416380
2019-02-06 05:05:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 05:05:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416380  77 58520 18305741 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 05:05:05 [DEBUG   ] Got command RPT from MCS: ref #1416381
2019-02-06 05:05:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 05:05:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416381  12 58520 18305933 A  ERRORB˜™š'
2019-02-06 05:05:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 05:05:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 05:05:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:05:54 [WARNING ] (13, 1, 'bot')
2019-02-06 05:05:54 [WARNING ] (13, 1, 'bot')
2019-02-06 05:05:54 [WARNING ] (13, 1, 'bot')
2019-02-06 05:05:54 [WARNING ] (13, 1, 'bot')
2019-02-06 05:05:54 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:05:54 [DEBUG   ] Finished updating board flags in 1.371 seconds
2019-02-06 05:06:00 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-06 05:06:12 [DEBUG   ] Got command RPT from MCS: ref #1416390
2019-02-06 05:06:12 [DEBUG   ] summary = ERROR
2019-02-06 05:06:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416390  13 58520 18372137 A  ERRORERROR'
2019-02-06 05:06:12 [DEBUG   ] Got command RPT from MCS: ref #1416391
2019-02-06 05:06:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 05:06:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416391  77 58520 18372138 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 05:06:20 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-02-06 05:06:41 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-02-06 05:06:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:06:55 [WARNING ] (13, 1, 'bot')
2019-02-06 05:06:55 [WARNING ] (13, 1, 'bot')
2019-02-06 05:06:55 [WARNING ] (13, 1, 'bot')
2019-02-06 05:06:55 [WARNING ] (13, 1, 'bot')
2019-02-06 05:06:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:06:55 [DEBUG   ] Finished updating board flags in 2.041 seconds
2019-02-06 05:07:01 [DEBUG   ] Finished updating ant stats in 1.210 seconds
2019-02-06 05:07:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-02-06 05:07:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 05:07:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:07:55 [WARNING ] (13, 1, 'bot')
2019-02-06 05:07:55 [WARNING ] (13, 1, 'bot')
2019-02-06 05:07:55 [WARNING ] (13, 1, 'bot')
2019-02-06 05:07:55 [WARNING ] (13, 1, 'bot')
2019-02-06 05:07:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:07:55 [DEBUG   ] Finished updating board flags in 2.007 seconds
2019-02-06 05:08:01 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2019-02-06 05:08:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-06 05:08:41 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 05:08:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:08:55 [WARNING ] (13, 1, 'bot')
2019-02-06 05:08:55 [WARNING ] (13, 1, 'bot')
2019-02-06 05:08:55 [WARNING ] (13, 1, 'bot')
2019-02-06 05:08:55 [WARNING ] (13, 1, 'bot')
2019-02-06 05:08:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:08:55 [DEBUG   ] Finished updating board flags in 1.987 seconds
2019-02-06 05:09:01 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 05:09:21 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 05:09:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 05:09:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:09:55 [WARNING ] (13, 1, 'bot')
2019-02-06 05:09:55 [WARNING ] (13, 1, 'bot')
2019-02-06 05:09:55 [WARNING ] (13, 1, 'bot')
2019-02-06 05:09:55 [WARNING ] (13, 1, 'bot')
2019-02-06 05:09:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:09:55 [DEBUG   ] Finished updating board flags in 1.820 seconds
2019-02-06 05:10:01 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-06 05:10:05 [DEBUG   ] Got command RPT from MCS: ref #1416411
2019-02-06 05:10:05 [DEBUG   ] summary = ERROR
2019-02-06 05:10:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416411  13 58520 18605217 A  ERRORERROR'
2019-02-06 05:10:05 [DEBUG   ] Got command RPT from MCS: ref #1416412
2019-02-06 05:10:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 05:10:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416412  77 58520 18605421 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 05:10:05 [DEBUG   ] Got command RPT from MCS: ref #1416413
2019-02-06 05:10:05 [DEBUG   ] summary = ERROR
2019-02-06 05:10:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416413  13 58520 18605613 A  ERRORERROR'
2019-02-06 05:10:05 [DEBUG   ] Got command RPT from MCS: ref #1416414
2019-02-06 05:10:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 05:10:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416414  77 58520 18605817 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 05:10:06 [DEBUG   ] Got command RPT from MCS: ref #1416415
2019-02-06 05:10:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 05:10:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416415  12 58520 18606021 A  ERRORB—™š'
2019-02-06 05:10:21 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 05:10:42 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-02-06 05:10:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:10:55 [WARNING ] (13, 1, 'bot')
2019-02-06 05:10:55 [WARNING ] (13, 1, 'bot')
2019-02-06 05:10:55 [WARNING ] (13, 1, 'bot')
2019-02-06 05:10:55 [WARNING ] (13, 1, 'bot')
2019-02-06 05:10:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:10:55 [DEBUG   ] Finished updating board flags in 1.783 seconds
2019-02-06 05:11:01 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2019-02-06 05:11:12 [DEBUG   ] Got command RPT from MCS: ref #1416416
2019-02-06 05:11:12 [DEBUG   ] summary = ERROR
2019-02-06 05:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416416  13 58520 18672141 A  ERRORERROR'
2019-02-06 05:11:12 [DEBUG   ] Got command RPT from MCS: ref #1416417
2019-02-06 05:11:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 05:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416417  77 58520 18672142 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 05:11:22 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-02-06 05:11:42 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-02-06 05:11:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:11:55 [WARNING ] (13, 1, 'bot')
2019-02-06 05:11:55 [WARNING ] (13, 1, 'bot')
2019-02-06 05:11:55 [WARNING ] (13, 1, 'bot')
2019-02-06 05:11:55 [WARNING ] (13, 1, 'bot')
2019-02-06 05:11:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:11:55 [DEBUG   ] Finished updating board flags in 1.614 seconds
2019-02-06 05:12:02 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-06 05:12:22 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-02-06 05:12:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 05:12:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:12:55 [WARNING ] (13, 1, 'bot')
2019-02-06 05:12:55 [WARNING ] (13, 1, 'bot')
2019-02-06 05:12:55 [WARNING ] (13, 1, 'bot')
2019-02-06 05:12:55 [WARNING ] (13, 1, 'bot')
2019-02-06 05:12:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:12:55 [DEBUG   ] Finished updating board flags in 1.590 seconds
2019-02-06 05:13:02 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 05:13:22 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-06 05:13:42 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-06 05:13:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:13:55 [WARNING ] (13, 1, 'bot')
2019-02-06 05:13:55 [WARNING ] (13, 1, 'bot')
2019-02-06 05:13:55 [WARNING ] (13, 1, 'bot')
2019-02-06 05:13:55 [WARNING ] (13, 1, 'bot')
2019-02-06 05:13:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:13:55 [DEBUG   ] Finished updating board flags in 1.421 seconds
2019-02-06 05:14:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 05:14:22 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 05:14:42 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-02-06 05:14:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:14:55 [WARNING ] (13, 1, 'bot')
2019-02-06 05:14:55 [WARNING ] (13, 1, 'bot')
2019-02-06 05:14:55 [WARNING ] (13, 1, 'bot')
2019-02-06 05:14:55 [WARNING ] (13, 1, 'bot')
2019-02-06 05:14:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:14:55 [DEBUG   ] Finished updating board flags in 1.388 seconds
2019-02-06 05:15:02 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2019-02-06 05:15:05 [DEBUG   ] Got command RPT from MCS: ref #1416443
2019-02-06 05:15:05 [DEBUG   ] summary = ERROR
2019-02-06 05:15:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416443  13 58520 18905289 A  ERRORERROR'
2019-02-06 05:15:05 [DEBUG   ] Got command RPT from MCS: ref #1416444
2019-02-06 05:15:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 05:15:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416444  77 58520 18905493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 05:15:05 [DEBUG   ] Got command RPT from MCS: ref #1416445
2019-02-06 05:15:05 [DEBUG   ] summary = ERROR
2019-02-06 05:15:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416445  13 58520 18905697 A  ERRORERROR'
2019-02-06 05:15:05 [DEBUG   ] Got command RPT from MCS: ref #1416447
2019-02-06 05:15:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 05:15:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416447  77 58520 18905901 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 05:15:06 [DEBUG   ] Got command RPT from MCS: ref #1416448
2019-02-06 05:15:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 05:15:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416448  12 58520 18906093 A  ERRORB–™š'
2019-02-06 05:15:22 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 05:15:43 [DEBUG   ] Finished updating ant stats in 1.319 seconds
2019-02-06 05:15:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:15:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-02-06 05:15:55 [WARNING ] (13, 1, 'bot')
2019-02-06 05:15:55 [WARNING ] (13, 1, 'bot')
2019-02-06 05:15:55 [WARNING ] (13, 1, 'bot')
2019-02-06 05:15:55 [WARNING ] (13, 1, 'bot')
2019-02-06 05:15:55 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:15:55 [DEBUG   ] Finished updating board flags in 1.375 seconds
2019-02-06 05:16:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 05:16:12 [DEBUG   ] Got command RPT from MCS: ref #1416453
2019-02-06 05:16:12 [DEBUG   ] summary = ERROR
2019-02-06 05:16:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416453  13 58520 18972141 A  ERRORERROR'
2019-02-06 05:16:12 [DEBUG   ] Got command RPT from MCS: ref #1416454
2019-02-06 05:16:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 05:16:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416454  77 58520 18972142 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 05:16:23 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 05:16:43 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-02-06 05:16:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:16:56 [WARNING ] (13, 1, 'bot')
2019-02-06 05:16:56 [WARNING ] (13, 1, 'bot')
2019-02-06 05:16:56 [WARNING ] (13, 1, 'bot')
2019-02-06 05:16:56 [WARNING ] (13, 1, 'bot')
2019-02-06 05:16:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:16:56 [DEBUG   ] Finished updating board flags in 2.034 seconds
2019-02-06 05:17:03 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-06 05:17:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 05:17:43 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 05:17:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:17:56 [WARNING ] (13, 1, 'bot')
2019-02-06 05:17:56 [WARNING ] (13, 1, 'bot')
2019-02-06 05:17:56 [WARNING ] (13, 1, 'bot')
2019-02-06 05:17:56 [WARNING ] (13, 1, 'bot')
2019-02-06 05:17:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:17:56 [DEBUG   ] Finished updating board flags in 2.110 seconds
2019-02-06 05:18:03 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-02-06 05:18:23 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 05:18:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 05:18:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 05:18:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:18:56 [WARNING ] (13, 1, 'bot')
2019-02-06 05:18:56 [WARNING ] (13, 1, 'bot')
2019-02-06 05:18:56 [WARNING ] (13, 1, 'bot')
2019-02-06 05:18:56 [WARNING ] (13, 1, 'bot')
2019-02-06 05:18:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:18:56 [DEBUG   ] Finished updating board flags in 1.883 seconds
2019-02-06 05:19:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 05:19:23 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-02-06 05:19:43 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 05:19:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:19:56 [WARNING ] (13, 1, 'bot')
2019-02-06 05:19:56 [WARNING ] (13, 1, 'bot')
2019-02-06 05:19:56 [WARNING ] (13, 1, 'bot')
2019-02-06 05:19:56 [WARNING ] (13, 1, 'bot')
2019-02-06 05:19:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:19:56 [DEBUG   ] Finished updating board flags in 1.827 seconds
2019-02-06 05:20:04 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-02-06 05:20:05 [DEBUG   ] Got command RPT from MCS: ref #1416474
2019-02-06 05:20:05 [DEBUG   ] summary = ERROR
2019-02-06 05:20:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416474  13 58520 19205381 A  ERRORERROR'
2019-02-06 05:20:05 [DEBUG   ] Got command RPT from MCS: ref #1416475
2019-02-06 05:20:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 05:20:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416475  77 58520 19205585 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 05:20:05 [DEBUG   ] Got command RPT from MCS: ref #1416476
2019-02-06 05:20:05 [DEBUG   ] summary = ERROR
2019-02-06 05:20:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416476  13 58520 19205777 A  ERRORERROR'
2019-02-06 05:20:05 [DEBUG   ] Got command RPT from MCS: ref #1416477
2019-02-06 05:20:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 05:20:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416477  77 58520 19205981 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 05:20:06 [DEBUG   ] Got command RPT from MCS: ref #1416478
2019-02-06 05:20:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 05:20:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416478  12 58520 19206185 A  ERRORB—™š'
2019-02-06 05:20:24 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-02-06 05:20:44 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-02-06 05:20:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:20:56 [WARNING ] (13, 1, 'bot')
2019-02-06 05:20:56 [WARNING ] (13, 1, 'bot')
2019-02-06 05:20:56 [WARNING ] (13, 1, 'bot')
2019-02-06 05:20:56 [WARNING ] (13, 1, 'bot')
2019-02-06 05:20:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:20:56 [DEBUG   ] Finished updating board flags in 1.777 seconds
2019-02-06 05:21:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 05:21:12 [DEBUG   ] Got command RPT from MCS: ref #1416483
2019-02-06 05:21:12 [DEBUG   ] summary = ERROR
2019-02-06 05:21:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416483  13 58520 19272137 A  ERRORERROR'
2019-02-06 05:21:12 [DEBUG   ] Got command RPT from MCS: ref #1416484
2019-02-06 05:21:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 05:21:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416484  77 58520 19272138 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 05:21:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 05:21:44 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-02-06 05:21:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:21:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-06 05:21:56 [WARNING ] (13, 1, 'bot')
2019-02-06 05:21:56 [WARNING ] (13, 1, 'bot')
2019-02-06 05:21:56 [WARNING ] (13, 1, 'bot')
2019-02-06 05:21:56 [WARNING ] (13, 1, 'bot')
2019-02-06 05:21:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:21:56 [DEBUG   ] Finished updating board flags in 1.619 seconds
2019-02-06 05:22:04 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-06 05:22:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 05:22:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 05:22:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:22:56 [WARNING ] (13, 1, 'bot')
2019-02-06 05:22:56 [WARNING ] (13, 1, 'bot')
2019-02-06 05:22:56 [WARNING ] (13, 1, 'bot')
2019-02-06 05:22:56 [WARNING ] (13, 1, 'bot')
2019-02-06 05:22:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:22:56 [DEBUG   ] Finished updating board flags in 1.600 seconds
2019-02-06 05:23:04 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 05:23:24 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-02-06 05:23:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 05:23:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:23:56 [WARNING ] (13, 1, 'bot')
2019-02-06 05:23:56 [WARNING ] (13, 1, 'bot')
2019-02-06 05:23:56 [WARNING ] (13, 1, 'bot')
2019-02-06 05:23:56 [WARNING ] (13, 1, 'bot')
2019-02-06 05:23:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:23:56 [DEBUG   ] Finished updating board flags in 1.393 seconds
2019-02-06 05:24:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 05:24:24 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-02-06 05:24:44 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 05:24:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:24:56 [WARNING ] (13, 1, 'bot')
2019-02-06 05:24:56 [WARNING ] (13, 1, 'bot')
2019-02-06 05:24:56 [WARNING ] (13, 1, 'bot')
2019-02-06 05:24:56 [WARNING ] (13, 1, 'bot')
2019-02-06 05:24:56 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:24:56 [DEBUG   ] Finished updating board flags in 1.374 seconds
2019-02-06 05:25:05 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-02-06 05:25:05 [DEBUG   ] Got command RPT from MCS: ref #1416506
2019-02-06 05:25:05 [DEBUG   ] summary = ERROR
2019-02-06 05:25:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416506  13 58520 19505453 A  ERRORERROR'
2019-02-06 05:25:05 [DEBUG   ] Got command RPT from MCS: ref #1416507
2019-02-06 05:25:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 05:25:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416507  77 58520 19505657 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 05:25:05 [DEBUG   ] Got command RPT from MCS: ref #1416508
2019-02-06 05:25:05 [DEBUG   ] summary = ERROR
2019-02-06 05:25:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416508  13 58520 19505861 A  ERRORERROR'
2019-02-06 05:25:06 [DEBUG   ] Got command RPT from MCS: ref #1416510
2019-02-06 05:25:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 05:25:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416510  77 58520 19506065 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 05:25:06 [DEBUG   ] Got command RPT from MCS: ref #1416512
2019-02-06 05:25:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 05:25:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416512  12 58520 19506257 A  ERRORB—™š'
2019-02-06 05:25:25 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-02-06 05:25:45 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-02-06 05:25:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:25:57 [WARNING ] (13, 1, 'bot')
2019-02-06 05:25:57 [WARNING ] (13, 1, 'bot')
2019-02-06 05:25:57 [WARNING ] (13, 1, 'bot')
2019-02-06 05:25:57 [WARNING ] (13, 1, 'bot')
2019-02-06 05:25:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:25:57 [DEBUG   ] Finished updating board flags in 2.043 seconds
2019-02-06 05:26:05 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-02-06 05:26:12 [DEBUG   ] Got command RPT from MCS: ref #1416516
2019-02-06 05:26:12 [DEBUG   ] summary = ERROR
2019-02-06 05:26:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416516  13 58520 19572141 A  ERRORERROR'
2019-02-06 05:26:12 [DEBUG   ] Got command RPT from MCS: ref #1416517
2019-02-06 05:26:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 05:26:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416517  77 58520 19572142 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 05:26:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 05:26:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 05:26:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:26:57 [WARNING ] (13, 1, 'bot')
2019-02-06 05:26:57 [WARNING ] (13, 1, 'bot')
2019-02-06 05:26:57 [WARNING ] (13, 1, 'bot')
2019-02-06 05:26:57 [WARNING ] (13, 1, 'bot')
2019-02-06 05:26:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:26:57 [DEBUG   ] Finished updating board flags in 1.983 seconds
2019-02-06 05:27:05 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-06 05:27:11 [DEBUG   ] Got command TBW from MCS: ref #1416538
2019-02-06 05:27:11 [DEBUG   ] tbw = exited with status True, code 0x00
2019-02-06 05:27:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW  1416538   8 58520 19631994 A  ERROR'
2019-02-06 05:27:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2019-02-06 05:27:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2019-02-06 05:27:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2019-02-06 05:27:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2019-02-06 05:27:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2019-02-06 05:27:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2019-02-06 05:27:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2019-02-06 05:27:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2019-02-06 05:27:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2019-02-06 05:27:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2019-02-06 05:27:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2019-02-06 05:27:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2019-02-06 05:27:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2019-02-06 05:27:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2019-02-06 05:27:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2019-02-06 05:27:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2019-02-06 05:27:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2019-02-06 05:27:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2019-02-06 05:27:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2019-02-06 05:27:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2019-02-06 05:27:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2019-02-06 05:27:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2019-02-06 05:27:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2019-02-06 05:27:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2019-02-06 05:27:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2019-02-06 05:27:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2019-02-06 05:27:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2019-02-06 05:27:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2019-02-06 05:27:15 [DEBUG   ] spawn_process: at 2019-02-06 05:27:15 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2019-02-06 05:27:15 [DEBUG   ] spawn_process: at 2019-02-06 05:27:15 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2019-02-06 05:27:15 [DEBUG   ] spawn_process: at 2019-02-06 05:27:15 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2019-02-06 05:27:15 [DEBUG   ] spawn_process: at 2019-02-06 05:27:15 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2019-02-06 05:27:15 [DEBUG   ] spawn_process: at 2019-02-06 05:27:15 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2019-02-06 05:27:15 [DEBUG   ] spawn_process: at 2019-02-06 05:27:15 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2019-02-06 05:27:15 [DEBUG   ] spawn_process: at 2019-02-06 05:27:15 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2019-02-06 05:27:15 [DEBUG   ] spawn_process: at 2019-02-06 05:27:15 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2019-02-06 05:27:15 [DEBUG   ] spawn_process: at 2019-02-06 05:27:15 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2019-02-06 05:27:15 [DEBUG   ] spawn_process: at 2019-02-06 05:27:15 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2019-02-06 05:27:15 [DEBUG   ] spawn_process: at 2019-02-06 05:27:15 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2019-02-06 05:27:15 [DEBUG   ] spawn_process: at 2019-02-06 05:27:15 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2019-02-06 05:27:15 [DEBUG   ] spawn_process: at 2019-02-06 05:27:15 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2019-02-06 05:27:15 [DEBUG   ] spawn_process: at 2019-02-06 05:27:15 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2019-02-06 05:27:15 [DEBUG   ] spawn_process: at 2019-02-06 05:27:15 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2019-02-06 05:27:15 [DEBUG   ] spawn_process: at 2019-02-06 05:27:15 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2019-02-06 05:27:15 [DEBUG   ] spawn_process: at 2019-02-06 05:27:15 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2019-02-06 05:27:15 [DEBUG   ] spawn_process: at 2019-02-06 05:27:15 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2019-02-06 05:27:15 [DEBUG   ] spawn_process: at 2019-02-06 05:27:15 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2019-02-06 05:27:15 [DEBUG   ] spawn_process: at 2019-02-06 05:27:15 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2019-02-06 05:27:15 [DEBUG   ] spawn_process: at 2019-02-06 05:27:15 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2019-02-06 05:27:15 [DEBUG   ] spawn_process: at 2019-02-06 05:27:15 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2019-02-06 05:27:15 [DEBUG   ] spawn_process: at 2019-02-06 05:27:15 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2019-02-06 05:27:15 [DEBUG   ] spawn_process: at 2019-02-06 05:27:15 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2019-02-06 05:27:15 [DEBUG   ] spawn_process: at 2019-02-06 05:27:15 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2019-02-06 05:27:15 [DEBUG   ] spawn_process: at 2019-02-06 05:27:15 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2019-02-06 05:27:15 [INFO    ] Finished spawning TBW
2019-02-06 05:27:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:27:57 [WARNING ] (13, 1, 'bot')
2019-02-06 05:27:57 [WARNING ] (13, 1, 'bot')
2019-02-06 05:27:57 [WARNING ] (13, 1, 'bot')
2019-02-06 05:27:57 [WARNING ] (13, 1, 'bot')
2019-02-06 05:27:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:27:57 [DEBUG   ] Finished updating board flags in 1.791 seconds
2019-02-06 05:28:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:28:57 [WARNING ] (13, 1, 'bot')
2019-02-06 05:28:57 [WARNING ] (13, 1, 'bot')
2019-02-06 05:28:57 [WARNING ] (13, 1, 'bot')
2019-02-06 05:28:57 [WARNING ] (13, 1, 'bot')
2019-02-06 05:28:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:28:57 [DEBUG   ] Finished updating board flags in 1.545 seconds
2019-02-06 05:29:03 [INFO    ] __waitForTBW - TBW finished in 108.319 s
2019-02-06 05:29:04 [DEBUG   ] Finished updating ant stats in 0.392 seconds
2019-02-06 05:29:04 [INFO    ] Started antennas statistics background thread
2019-02-06 05:29:04 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2019-02-06 05:29:04 [DEBUG   ] spawn_process: at 2019-02-06 05:29:04 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1549430946']
2019-02-06 05:29:04 [DEBUG   ] spawn_process: at 2019-02-06 05:29:04 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1549430946']
2019-02-06 05:29:04 [DEBUG   ] spawn_process: at 2019-02-06 05:29:04 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1549430946']
2019-02-06 05:29:04 [DEBUG   ] spawn_process: at 2019-02-06 05:29:04 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1549430946']
2019-02-06 05:29:04 [DEBUG   ] spawn_process: at 2019-02-06 05:29:04 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1549430946']
2019-02-06 05:29:04 [DEBUG   ] spawn_process: at 2019-02-06 05:29:04 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1549430946']
2019-02-06 05:29:04 [DEBUG   ] spawn_process: at 2019-02-06 05:29:04 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1549430946']
2019-02-06 05:29:04 [DEBUG   ] spawn_process: at 2019-02-06 05:29:04 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1549430946']
2019-02-06 05:29:04 [DEBUG   ] spawn_process: at 2019-02-06 05:29:04 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1549430946']
2019-02-06 05:29:04 [DEBUG   ] spawn_process: at 2019-02-06 05:29:04 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1549430946']
2019-02-06 05:29:04 [DEBUG   ] spawn_process: at 2019-02-06 05:29:04 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1549430946']
2019-02-06 05:29:04 [DEBUG   ] spawn_process: at 2019-02-06 05:29:04 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1549430946']
2019-02-06 05:29:04 [DEBUG   ] spawn_process: at 2019-02-06 05:29:04 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1549430946']
2019-02-06 05:29:04 [DEBUG   ] spawn_process: at 2019-02-06 05:29:04 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1549430946']
2019-02-06 05:29:04 [DEBUG   ] spawn_process: at 2019-02-06 05:29:04 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1549430946']
2019-02-06 05:29:04 [DEBUG   ] spawn_process: at 2019-02-06 05:29:04 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1549430946']
2019-02-06 05:29:04 [DEBUG   ] spawn_process: at 2019-02-06 05:29:04 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1549430946']
2019-02-06 05:29:04 [DEBUG   ] spawn_process: at 2019-02-06 05:29:04 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1549430946']
2019-02-06 05:29:04 [DEBUG   ] spawn_process: at 2019-02-06 05:29:04 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1549430946']
2019-02-06 05:29:04 [DEBUG   ] spawn_process: at 2019-02-06 05:29:04 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1549430946']
2019-02-06 05:29:04 [DEBUG   ] spawn_process: at 2019-02-06 05:29:04 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1549430946']
2019-02-06 05:29:04 [DEBUG   ] spawn_process: at 2019-02-06 05:29:04 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1549430946']
2019-02-06 05:29:04 [DEBUG   ] spawn_process: at 2019-02-06 05:29:04 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1549430946']
2019-02-06 05:29:04 [DEBUG   ] spawn_process: at 2019-02-06 05:29:04 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1549430946']
2019-02-06 05:29:04 [DEBUG   ] spawn_process: at 2019-02-06 05:29:04 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1549430946']
2019-02-06 05:29:04 [DEBUG   ] spawn_process: at 2019-02-06 05:29:04 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1549430946']
2019-02-06 05:29:04 [INFO    ] Finished spawning TBN in 0.049 s
2019-02-06 05:29:25 [DEBUG   ] Finished updating ant stats in 1.271 seconds
2019-02-06 05:29:45 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-02-06 05:29:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:29:57 [WARNING ] (13, 1, 'bot')
2019-02-06 05:29:57 [WARNING ] (13, 1, 'bot')
2019-02-06 05:29:57 [WARNING ] (13, 1, 'bot')
2019-02-06 05:29:57 [WARNING ] (13, 1, 'bot')
2019-02-06 05:29:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:29:57 [DEBUG   ] Finished updating board flags in 1.598 seconds
2019-02-06 05:30:05 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-02-06 05:30:05 [DEBUG   ] Got command RPT from MCS: ref #1416550
2019-02-06 05:30:05 [DEBUG   ] summary = ERROR
2019-02-06 05:30:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416550  13 58520 19805541 A  ERRORERROR'
2019-02-06 05:30:05 [DEBUG   ] Got command RPT from MCS: ref #1416551
2019-02-06 05:30:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 05:30:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416551  77 58520 19805733 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 05:30:05 [DEBUG   ] Got command RPT from MCS: ref #1416552
2019-02-06 05:30:05 [DEBUG   ] summary = ERROR
2019-02-06 05:30:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416552  13 58520 19805937 A  ERRORERROR'
2019-02-06 05:30:06 [DEBUG   ] Got command RPT from MCS: ref #1416553
2019-02-06 05:30:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 05:30:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416553  77 58520 19806141 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 05:30:06 [DEBUG   ] Got command RPT from MCS: ref #1416554
2019-02-06 05:30:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 05:30:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416554  12 58520 19806345 A  ERRORB–™š'
2019-02-06 05:30:25 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-06 05:30:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 05:30:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:30:57 [WARNING ] (13, 1, 'bot')
2019-02-06 05:30:57 [WARNING ] (13, 1, 'bot')
2019-02-06 05:30:57 [WARNING ] (13, 1, 'bot')
2019-02-06 05:30:57 [WARNING ] (13, 1, 'bot')
2019-02-06 05:30:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:30:57 [DEBUG   ] Finished updating board flags in 1.614 seconds
2019-02-06 05:31:05 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-02-06 05:31:12 [DEBUG   ] Got command RPT from MCS: ref #1416555
2019-02-06 05:31:12 [DEBUG   ] summary = ERROR
2019-02-06 05:31:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416555  13 58520 19872145 A  ERRORERROR'
2019-02-06 05:31:12 [DEBUG   ] Got command RPT from MCS: ref #1416556
2019-02-06 05:31:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 05:31:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416556  77 58520 19872146 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 05:31:25 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-02-06 05:31:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 05:31:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:31:57 [WARNING ] (13, 1, 'bot')
2019-02-06 05:31:57 [WARNING ] (13, 1, 'bot')
2019-02-06 05:31:57 [WARNING ] (13, 1, 'bot')
2019-02-06 05:31:57 [WARNING ] (13, 1, 'bot')
2019-02-06 05:31:57 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:31:57 [DEBUG   ] Finished updating board flags in 1.355 seconds
2019-02-06 05:32:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 05:32:25 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 05:32:45 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-02-06 05:32:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:32:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-02-06 05:32:58 [WARNING ] (13, 1, 'bot')
2019-02-06 05:32:58 [WARNING ] (13, 1, 'bot')
2019-02-06 05:32:58 [WARNING ] (13, 1, 'bot')
2019-02-06 05:32:58 [WARNING ] (13, 1, 'bot')
2019-02-06 05:32:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:32:58 [DEBUG   ] Finished updating board flags in 2.122 seconds
2019-02-06 05:33:05 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 05:33:26 [DEBUG   ] Finished updating ant stats in 1.368 seconds
2019-02-06 05:33:46 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-02-06 05:33:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:33:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-06 05:33:58 [WARNING ] (13, 1, 'bot')
2019-02-06 05:33:58 [WARNING ] (13, 1, 'bot')
2019-02-06 05:33:58 [WARNING ] (13, 1, 'bot')
2019-02-06 05:33:58 [WARNING ] (13, 1, 'bot')
2019-02-06 05:33:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:33:58 [DEBUG   ] Finished updating board flags in 1.993 seconds
2019-02-06 05:34:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 05:34:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 05:34:46 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-06 05:34:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:34:58 [WARNING ] (13, 1, 'bot')
2019-02-06 05:34:58 [WARNING ] (13, 1, 'bot')
2019-02-06 05:34:58 [WARNING ] (13, 1, 'bot')
2019-02-06 05:34:58 [WARNING ] (13, 1, 'bot')
2019-02-06 05:34:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:34:58 [DEBUG   ] Finished updating board flags in 1.818 seconds
2019-02-06 05:35:05 [DEBUG   ] Got command RPT from MCS: ref #1416578
2019-02-06 05:35:05 [DEBUG   ] summary = ERROR
2019-02-06 05:35:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416578  13 58520 20105617 A  ERRORERROR'
2019-02-06 05:35:05 [DEBUG   ] Got command RPT from MCS: ref #1416579
2019-02-06 05:35:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 05:35:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416579  77 58520 20105821 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 05:35:06 [DEBUG   ] Got command RPT from MCS: ref #1416580
2019-02-06 05:35:06 [DEBUG   ] summary = ERROR
2019-02-06 05:35:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416580  13 58520 20106025 A  ERRORERROR'
2019-02-06 05:35:06 [DEBUG   ] Got command RPT from MCS: ref #1416582
2019-02-06 05:35:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 05:35:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416582  77 58520 20106217 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 05:35:06 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-02-06 05:35:06 [DEBUG   ] Got command RPT from MCS: ref #1416584
2019-02-06 05:35:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 05:35:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416584  12 58520 20106421 A  ERRORB—™š'
2019-02-06 05:35:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 05:35:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 05:35:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:35:58 [WARNING ] (13, 1, 'bot')
2019-02-06 05:35:58 [WARNING ] (13, 1, 'bot')
2019-02-06 05:35:58 [WARNING ] (13, 1, 'bot')
2019-02-06 05:35:58 [WARNING ] (13, 1, 'bot')
2019-02-06 05:35:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:35:58 [DEBUG   ] Finished updating board flags in 1.789 seconds
2019-02-06 05:36:06 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-06 05:36:12 [DEBUG   ] Got command RPT from MCS: ref #1416592
2019-02-06 05:36:12 [DEBUG   ] summary = ERROR
2019-02-06 05:36:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416592  13 58520 20172145 A  ERRORERROR'
2019-02-06 05:36:12 [DEBUG   ] Got command RPT from MCS: ref #1416593
2019-02-06 05:36:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 05:36:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416593  77 58520 20172146 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 05:36:26 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-06 05:36:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 05:36:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 05:36:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:36:58 [WARNING ] (13, 1, 'bot')
2019-02-06 05:36:58 [WARNING ] (13, 1, 'bot')
2019-02-06 05:36:58 [WARNING ] (13, 1, 'bot')
2019-02-06 05:36:58 [WARNING ] (13, 1, 'bot')
2019-02-06 05:36:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:36:58 [DEBUG   ] Finished updating board flags in 1.613 seconds
2019-02-06 05:37:06 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 05:37:26 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-06 05:37:46 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 05:37:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:37:58 [WARNING ] (13, 1, 'bot')
2019-02-06 05:37:58 [WARNING ] (13, 1, 'bot')
2019-02-06 05:37:58 [WARNING ] (13, 1, 'bot')
2019-02-06 05:37:58 [WARNING ] (13, 1, 'bot')
2019-02-06 05:37:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:37:58 [DEBUG   ] Finished updating board flags in 1.613 seconds
2019-02-06 05:38:07 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-02-06 05:38:27 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-02-06 05:38:47 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-06 05:38:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 05:38:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:38:58 [WARNING ] (13, 1, 'bot')
2019-02-06 05:38:58 [WARNING ] (13, 1, 'bot')
2019-02-06 05:38:58 [WARNING ] (13, 1, 'bot')
2019-02-06 05:38:58 [WARNING ] (13, 1, 'bot')
2019-02-06 05:38:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:38:58 [DEBUG   ] Finished updating board flags in 1.583 seconds
2019-02-06 05:39:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 05:39:27 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-02-06 05:39:47 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 05:39:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 05:39:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:39:58 [WARNING ] (13, 1, 'bot')
2019-02-06 05:39:58 [WARNING ] (13, 1, 'bot')
2019-02-06 05:39:58 [WARNING ] (13, 1, 'bot')
2019-02-06 05:39:58 [WARNING ] (13, 1, 'bot')
2019-02-06 05:39:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:39:58 [DEBUG   ] Finished updating board flags in 1.413 seconds
2019-02-06 05:40:05 [DEBUG   ] Got command RPT from MCS: ref #1416613
2019-02-06 05:40:05 [DEBUG   ] summary = ERROR
2019-02-06 05:40:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416613  13 58520 20405705 A  ERRORERROR'
2019-02-06 05:40:05 [DEBUG   ] Got command RPT from MCS: ref #1416614
2019-02-06 05:40:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 05:40:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416614  77 58520 20405897 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 05:40:06 [DEBUG   ] Got command RPT from MCS: ref #1416615
2019-02-06 05:40:06 [DEBUG   ] summary = ERROR
2019-02-06 05:40:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416615  13 58520 20406101 A  ERRORERROR'
2019-02-06 05:40:06 [DEBUG   ] Got command RPT from MCS: ref #1416616
2019-02-06 05:40:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 05:40:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416616  77 58520 20406305 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 05:40:06 [DEBUG   ] Got command RPT from MCS: ref #1416617
2019-02-06 05:40:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 05:40:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416617  12 58520 20406509 A  ERRORB—™š'
2019-02-06 05:40:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 05:40:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 05:40:47 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-02-06 05:40:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:40:58 [WARNING ] (13, 1, 'bot')
2019-02-06 05:40:58 [WARNING ] (13, 1, 'bot')
2019-02-06 05:40:58 [WARNING ] (13, 1, 'bot')
2019-02-06 05:40:58 [WARNING ] (13, 1, 'bot')
2019-02-06 05:40:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:40:58 [DEBUG   ] Finished updating board flags in 1.382 seconds
2019-02-06 05:41:07 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-06 05:41:12 [DEBUG   ] Got command RPT from MCS: ref #1416618
2019-02-06 05:41:12 [DEBUG   ] summary = ERROR
2019-02-06 05:41:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416618  13 58520 20472141 A  ERRORERROR'
2019-02-06 05:41:12 [DEBUG   ] Got command RPT from MCS: ref #1416619
2019-02-06 05:41:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 05:41:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416619  77 58520 20472142 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 05:41:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 05:41:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 05:41:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:41:58 [WARNING ] (13, 1, 'bot')
2019-02-06 05:41:58 [WARNING ] (13, 1, 'bot')
2019-02-06 05:41:58 [WARNING ] (13, 1, 'bot')
2019-02-06 05:41:58 [WARNING ] (13, 1, 'bot')
2019-02-06 05:41:58 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:41:58 [DEBUG   ] Finished updating board flags in 1.381 seconds
2019-02-06 05:42:07 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-06 05:42:27 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-02-06 05:42:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 05:42:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:42:59 [WARNING ] (13, 1, 'bot')
2019-02-06 05:42:59 [WARNING ] (13, 1, 'bot')
2019-02-06 05:42:59 [WARNING ] (13, 1, 'bot')
2019-02-06 05:42:59 [WARNING ] (13, 1, 'bot')
2019-02-06 05:42:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:42:59 [DEBUG   ] Finished updating board flags in 2.038 seconds
2019-02-06 05:43:07 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 05:43:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-06 05:43:47 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 05:43:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:43:59 [WARNING ] (13, 1, 'bot')
2019-02-06 05:43:59 [WARNING ] (13, 1, 'bot')
2019-02-06 05:43:59 [WARNING ] (13, 1, 'bot')
2019-02-06 05:43:59 [WARNING ] (13, 1, 'bot')
2019-02-06 05:43:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:43:59 [DEBUG   ] Finished updating board flags in 1.998 seconds
2019-02-06 05:44:07 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-06 05:44:28 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-02-06 05:44:48 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-02-06 05:44:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:44:59 [WARNING ] (13, 1, 'bot')
2019-02-06 05:44:59 [WARNING ] (13, 1, 'bot')
2019-02-06 05:44:59 [WARNING ] (13, 1, 'bot')
2019-02-06 05:44:59 [WARNING ] (13, 1, 'bot')
2019-02-06 05:44:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:44:59 [DEBUG   ] Finished updating board flags in 1.812 seconds
2019-02-06 05:45:05 [DEBUG   ] Got command RPT from MCS: ref #1416645
2019-02-06 05:45:05 [DEBUG   ] summary = ERROR
2019-02-06 05:45:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416645  13 58520 20705781 A  ERRORERROR'
2019-02-06 05:45:05 [DEBUG   ] Got command RPT from MCS: ref #1416646
2019-02-06 05:45:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 05:45:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416646  77 58520 20705985 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 05:45:06 [DEBUG   ] Got command RPT from MCS: ref #1416647
2019-02-06 05:45:06 [DEBUG   ] summary = ERROR
2019-02-06 05:45:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416647  13 58520 20706189 A  ERRORERROR'
2019-02-06 05:45:06 [DEBUG   ] Got command RPT from MCS: ref #1416649
2019-02-06 05:45:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 05:45:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416649  77 58520 20706381 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 05:45:06 [DEBUG   ] Got command RPT from MCS: ref #1416650
2019-02-06 05:45:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 05:45:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416650  12 58520 20706585 A  ERRORB–™š'
2019-02-06 05:45:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 05:45:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 05:45:48 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-02-06 05:45:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:45:59 [WARNING ] (13, 1, 'bot')
2019-02-06 05:45:59 [WARNING ] (13, 1, 'bot')
2019-02-06 05:45:59 [WARNING ] (13, 1, 'bot')
2019-02-06 05:45:59 [WARNING ] (13, 1, 'bot')
2019-02-06 05:45:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:45:59 [DEBUG   ] Finished updating board flags in 1.781 seconds
2019-02-06 05:46:08 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-02-06 05:46:12 [DEBUG   ] Got command RPT from MCS: ref #1416655
2019-02-06 05:46:12 [DEBUG   ] summary = ERROR
2019-02-06 05:46:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416655  13 58520 20772141 A  ERRORERROR'
2019-02-06 05:46:12 [DEBUG   ] Got command RPT from MCS: ref #1416656
2019-02-06 05:46:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 05:46:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416656  77 58520 20772142 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 05:46:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 05:46:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 05:46:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:46:59 [WARNING ] (13, 1, 'bot')
2019-02-06 05:46:59 [WARNING ] (13, 1, 'bot')
2019-02-06 05:46:59 [WARNING ] (13, 1, 'bot')
2019-02-06 05:46:59 [WARNING ] (13, 1, 'bot')
2019-02-06 05:46:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:46:59 [DEBUG   ] Finished updating board flags in 1.617 seconds
2019-02-06 05:47:08 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-06 05:47:28 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-06 05:47:48 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-06 05:47:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:47:59 [WARNING ] (13, 1, 'bot')
2019-02-06 05:47:59 [WARNING ] (13, 1, 'bot')
2019-02-06 05:47:59 [WARNING ] (13, 1, 'bot')
2019-02-06 05:47:59 [WARNING ] (13, 1, 'bot')
2019-02-06 05:47:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:47:59 [DEBUG   ] Finished updating board flags in 1.585 seconds
2019-02-06 05:48:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 05:48:28 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-02-06 05:48:48 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-02-06 05:48:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:48:59 [WARNING ] (13, 1, 'bot')
2019-02-06 05:48:59 [WARNING ] (13, 1, 'bot')
2019-02-06 05:48:59 [WARNING ] (13, 1, 'bot')
2019-02-06 05:48:59 [WARNING ] (13, 1, 'bot')
2019-02-06 05:48:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:48:59 [DEBUG   ] Finished updating board flags in 1.413 seconds
2019-02-06 05:49:08 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 05:49:28 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 05:49:48 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-02-06 05:49:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:49:59 [WARNING ] (13, 1, 'bot')
2019-02-06 05:49:59 [WARNING ] (13, 1, 'bot')
2019-02-06 05:49:59 [WARNING ] (13, 1, 'bot')
2019-02-06 05:49:59 [WARNING ] (13, 1, 'bot')
2019-02-06 05:49:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:49:59 [DEBUG   ] Finished updating board flags in 1.391 seconds
2019-02-06 05:50:05 [DEBUG   ] Got command RPT from MCS: ref #1416676
2019-02-06 05:50:05 [DEBUG   ] summary = ERROR
2019-02-06 05:50:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416676  13 58520 21005861 A  ERRORERROR'
2019-02-06 05:50:06 [DEBUG   ] Got command RPT from MCS: ref #1416677
2019-02-06 05:50:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 05:50:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416677  77 58520 21006065 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 05:50:06 [DEBUG   ] Got command RPT from MCS: ref #1416678
2019-02-06 05:50:06 [DEBUG   ] summary = ERROR
2019-02-06 05:50:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416678  13 58520 21006269 A  ERRORERROR'
2019-02-06 05:50:06 [DEBUG   ] Got command RPT from MCS: ref #1416679
2019-02-06 05:50:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 05:50:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416679  77 58520 21006473 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 05:50:06 [DEBUG   ] Got command RPT from MCS: ref #1416680
2019-02-06 05:50:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 05:50:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416680  12 58520 21006665 A  ERRORB—™š'
2019-02-06 05:50:08 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2019-02-06 05:50:29 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-02-06 05:50:49 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-02-06 05:50:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:50:59 [WARNING ] (13, 1, 'bot')
2019-02-06 05:50:59 [WARNING ] (13, 1, 'bot')
2019-02-06 05:50:59 [WARNING ] (13, 1, 'bot')
2019-02-06 05:50:59 [WARNING ] (13, 1, 'bot')
2019-02-06 05:50:59 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:50:59 [DEBUG   ] Finished updating board flags in 1.365 seconds
2019-02-06 05:51:09 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-02-06 05:51:12 [DEBUG   ] Got command RPT from MCS: ref #1416685
2019-02-06 05:51:12 [DEBUG   ] summary = ERROR
2019-02-06 05:51:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416685  13 58520 21072149 A  ERRORERROR'
2019-02-06 05:51:12 [DEBUG   ] Got command RPT from MCS: ref #1416686
2019-02-06 05:51:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 05:51:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416686  77 58520 21072150 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 05:51:29 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-02-06 05:51:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 05:51:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:52:00 [WARNING ] (13, 1, 'bot')
2019-02-06 05:52:00 [WARNING ] (13, 1, 'bot')
2019-02-06 05:52:00 [WARNING ] (13, 1, 'bot')
2019-02-06 05:52:00 [WARNING ] (13, 1, 'bot')
2019-02-06 05:52:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:52:00 [DEBUG   ] Finished updating board flags in 2.053 seconds
2019-02-06 05:52:09 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-02-06 05:52:29 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-02-06 05:52:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 05:52:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:53:00 [WARNING ] (13, 1, 'bot')
2019-02-06 05:53:00 [WARNING ] (13, 1, 'bot')
2019-02-06 05:53:00 [WARNING ] (13, 1, 'bot')
2019-02-06 05:53:00 [WARNING ] (13, 1, 'bot')
2019-02-06 05:53:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:53:00 [DEBUG   ] Finished updating board flags in 1.983 seconds
2019-02-06 05:53:09 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 05:53:29 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-02-06 05:53:49 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-02-06 05:53:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 05:53:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:54:00 [WARNING ] (13, 1, 'bot')
2019-02-06 05:54:00 [WARNING ] (13, 1, 'bot')
2019-02-06 05:54:00 [WARNING ] (13, 1, 'bot')
2019-02-06 05:54:00 [WARNING ] (13, 1, 'bot')
2019-02-06 05:54:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:54:00 [DEBUG   ] Finished updating board flags in 1.850 seconds
2019-02-06 05:54:10 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-02-06 05:54:30 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2019-02-06 05:54:50 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-02-06 05:54:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:55:00 [WARNING ] (13, 1, 'bot')
2019-02-06 05:55:00 [WARNING ] (13, 1, 'bot')
2019-02-06 05:55:00 [WARNING ] (13, 1, 'bot')
2019-02-06 05:55:00 [WARNING ] (13, 1, 'bot')
2019-02-06 05:55:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:55:00 [DEBUG   ] Finished updating board flags in 1.757 seconds
2019-02-06 05:55:05 [DEBUG   ] Got command RPT from MCS: ref #1416708
2019-02-06 05:55:05 [DEBUG   ] summary = ERROR
2019-02-06 05:55:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416708  13 58520 21305949 A  ERRORERROR'
2019-02-06 05:55:06 [DEBUG   ] Got command RPT from MCS: ref #1416709
2019-02-06 05:55:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 05:55:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416709  77 58520 21306141 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 05:55:06 [DEBUG   ] Got command RPT from MCS: ref #1416710
2019-02-06 05:55:06 [DEBUG   ] summary = ERROR
2019-02-06 05:55:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416710  13 58520 21306345 A  ERRORERROR'
2019-02-06 05:55:06 [DEBUG   ] Got command RPT from MCS: ref #1416712
2019-02-06 05:55:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 05:55:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416712  77 58520 21306549 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 05:55:06 [DEBUG   ] Got command RPT from MCS: ref #1416713
2019-02-06 05:55:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 05:55:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416713  12 58520 21306741 A  ERRORB—™š'
2019-02-06 05:55:10 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 05:55:30 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 05:55:50 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-06 05:55:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:56:00 [WARNING ] (13, 1, 'bot')
2019-02-06 05:56:00 [WARNING ] (13, 1, 'bot')
2019-02-06 05:56:00 [WARNING ] (13, 1, 'bot')
2019-02-06 05:56:00 [WARNING ] (13, 1, 'bot')
2019-02-06 05:56:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:56:00 [DEBUG   ] Finished updating board flags in 1.623 seconds
2019-02-06 05:56:10 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-06 05:56:12 [DEBUG   ] Got command RPT from MCS: ref #1416718
2019-02-06 05:56:12 [DEBUG   ] summary = ERROR
2019-02-06 05:56:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416718  13 58520 21372145 A  ERRORERROR'
2019-02-06 05:56:12 [DEBUG   ] Got command RPT from MCS: ref #1416719
2019-02-06 05:56:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 05:56:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416719  77 58520 21372146 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 05:56:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 05:56:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 05:56:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:57:00 [WARNING ] (13, 1, 'bot')
2019-02-06 05:57:00 [WARNING ] (13, 1, 'bot')
2019-02-06 05:57:00 [WARNING ] (13, 1, 'bot')
2019-02-06 05:57:00 [WARNING ] (13, 1, 'bot')
2019-02-06 05:57:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:57:00 [DEBUG   ] Finished updating board flags in 1.586 seconds
2019-02-06 05:57:10 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-06 05:57:30 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 05:57:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 05:57:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:58:00 [WARNING ] (13, 1, 'bot')
2019-02-06 05:58:00 [WARNING ] (13, 1, 'bot')
2019-02-06 05:58:00 [WARNING ] (13, 1, 'bot')
2019-02-06 05:58:00 [WARNING ] (13, 1, 'bot')
2019-02-06 05:58:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:58:00 [DEBUG   ] Finished updating board flags in 1.410 seconds
2019-02-06 05:58:10 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 05:58:30 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-06 05:58:50 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 05:58:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 05:59:00 [WARNING ] (13, 1, 'bot')
2019-02-06 05:59:00 [WARNING ] (13, 1, 'bot')
2019-02-06 05:59:00 [WARNING ] (13, 1, 'bot')
2019-02-06 05:59:00 [WARNING ] (13, 1, 'bot')
2019-02-06 05:59:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 05:59:00 [DEBUG   ] Finished updating board flags in 1.407 seconds
2019-02-06 05:59:11 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-02-06 05:59:31 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-02-06 05:59:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 05:59:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:00:00 [WARNING ] (13, 1, 'bot')
2019-02-06 06:00:00 [WARNING ] (13, 1, 'bot')
2019-02-06 06:00:00 [WARNING ] (13, 1, 'bot')
2019-02-06 06:00:00 [WARNING ] (13, 1, 'bot')
2019-02-06 06:00:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:00:00 [DEBUG   ] Finished updating board flags in 1.386 seconds
2019-02-06 06:00:06 [DEBUG   ] Got command RPT from MCS: ref #1416743
2019-02-06 06:00:06 [DEBUG   ] summary = ERROR
2019-02-06 06:00:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416743  13 58520 21606017 A  ERRORERROR'
2019-02-06 06:00:06 [DEBUG   ] Got command RPT from MCS: ref #1416744
2019-02-06 06:00:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 06:00:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416744  77 58520 21606221 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 06:00:06 [DEBUG   ] Got command RPT from MCS: ref #1416745
2019-02-06 06:00:06 [DEBUG   ] summary = ERROR
2019-02-06 06:00:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416745  13 58520 21606425 A  ERRORERROR'
2019-02-06 06:00:06 [DEBUG   ] Got command RPT from MCS: ref #1416746
2019-02-06 06:00:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 06:00:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416746  77 58520 21606622 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 06:00:06 [DEBUG   ] Got command RPT from MCS: ref #1416747
2019-02-06 06:00:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 06:00:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416747  12 58520 21606825 A  ERRORB–™š'
2019-02-06 06:00:11 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 06:00:31 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-06 06:00:51 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 06:00:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 06:01:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:01:00 [WARNING ] (13, 1, 'bot')
2019-02-06 06:01:00 [WARNING ] (13, 1, 'bot')
2019-02-06 06:01:00 [WARNING ] (13, 1, 'bot')
2019-02-06 06:01:00 [WARNING ] (13, 1, 'bot')
2019-02-06 06:01:00 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:01:00 [DEBUG   ] Finished updating board flags in 1.365 seconds
2019-02-06 06:01:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 06:01:12 [DEBUG   ] Got command RPT from MCS: ref #1416748
2019-02-06 06:01:12 [DEBUG   ] summary = ERROR
2019-02-06 06:01:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416748  13 58520 21672149 A  ERRORERROR'
2019-02-06 06:01:12 [DEBUG   ] Got command RPT from MCS: ref #1416749
2019-02-06 06:01:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 06:01:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416749  77 58520 21672150 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 06:01:31 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-02-06 06:01:51 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-06 06:02:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 06:02:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:02:01 [WARNING ] (13, 1, 'bot')
2019-02-06 06:02:01 [WARNING ] (13, 1, 'bot')
2019-02-06 06:02:01 [WARNING ] (13, 1, 'bot')
2019-02-06 06:02:01 [WARNING ] (13, 1, 'bot')
2019-02-06 06:02:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:02:01 [DEBUG   ] Finished updating board flags in 2.050 seconds
2019-02-06 06:02:11 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-06 06:02:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 06:02:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 06:03:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:03:01 [WARNING ] (13, 1, 'bot')
2019-02-06 06:03:01 [WARNING ] (13, 1, 'bot')
2019-02-06 06:03:01 [WARNING ] (13, 1, 'bot')
2019-02-06 06:03:01 [WARNING ] (13, 1, 'bot')
2019-02-06 06:03:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:03:01 [DEBUG   ] Finished updating board flags in 2.013 seconds
2019-02-06 06:03:11 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-02-06 06:03:31 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 06:03:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 06:04:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:04:01 [WARNING ] (13, 1, 'bot')
2019-02-06 06:04:01 [WARNING ] (13, 1, 'bot')
2019-02-06 06:04:01 [WARNING ] (13, 1, 'bot')
2019-02-06 06:04:01 [WARNING ] (13, 1, 'bot')
2019-02-06 06:04:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:04:01 [DEBUG   ] Finished updating board flags in 1.985 seconds
2019-02-06 06:04:11 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 06:04:31 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-02-06 06:04:51 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 06:05:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:05:01 [WARNING ] (13, 1, 'bot')
2019-02-06 06:05:01 [WARNING ] (13, 1, 'bot')
2019-02-06 06:05:01 [WARNING ] (13, 1, 'bot')
2019-02-06 06:05:01 [WARNING ] (13, 1, 'bot')
2019-02-06 06:05:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:05:01 [DEBUG   ] Finished updating board flags in 1.844 seconds
2019-02-06 06:05:06 [DEBUG   ] Got command RPT from MCS: ref #1416771
2019-02-06 06:05:06 [DEBUG   ] summary = ERROR
2019-02-06 06:05:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416771  13 58520 21906101 A  ERRORERROR'
2019-02-06 06:05:06 [DEBUG   ] Got command RPT from MCS: ref #1416772
2019-02-06 06:05:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 06:05:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416772  77 58520 21906305 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 06:05:06 [DEBUG   ] Got command RPT from MCS: ref #1416773
2019-02-06 06:05:06 [DEBUG   ] summary = ERROR
2019-02-06 06:05:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416773  13 58520 21906497 A  ERRORERROR'
2019-02-06 06:05:06 [DEBUG   ] Got command RPT from MCS: ref #1416775
2019-02-06 06:05:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 06:05:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416775  77 58520 21906701 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 06:05:06 [DEBUG   ] Got command RPT from MCS: ref #1416776
2019-02-06 06:05:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 06:05:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416776  12 58520 21906905 A  ERRORB˜™š'
2019-02-06 06:05:11 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-06 06:05:32 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-02-06 06:05:52 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-02-06 06:06:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:06:01 [WARNING ] (13, 1, 'bot')
2019-02-06 06:06:01 [WARNING ] (13, 1, 'bot')
2019-02-06 06:06:01 [WARNING ] (13, 1, 'bot')
2019-02-06 06:06:01 [WARNING ] (13, 1, 'bot')
2019-02-06 06:06:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:06:01 [DEBUG   ] Finished updating board flags in 1.760 seconds
2019-02-06 06:06:12 [DEBUG   ] Got command RPT from MCS: ref #1416785
2019-02-06 06:06:12 [DEBUG   ] summary = ERROR
2019-02-06 06:06:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416785  13 58520 21972153 A  ERRORERROR'
2019-02-06 06:06:12 [DEBUG   ] Got command RPT from MCS: ref #1416786
2019-02-06 06:06:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 06:06:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416786  77 58520 21972154 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 06:06:12 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 06:06:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 06:06:52 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-02-06 06:07:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:07:01 [WARNING ] (13, 1, 'bot')
2019-02-06 06:07:01 [WARNING ] (13, 1, 'bot')
2019-02-06 06:07:01 [WARNING ] (13, 1, 'bot')
2019-02-06 06:07:01 [WARNING ] (13, 1, 'bot')
2019-02-06 06:07:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:07:01 [DEBUG   ] Finished updating board flags in 1.617 seconds
2019-02-06 06:07:12 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-06 06:07:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 06:07:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 06:08:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:08:01 [WARNING ] (13, 1, 'bot')
2019-02-06 06:08:01 [WARNING ] (13, 1, 'bot')
2019-02-06 06:08:01 [WARNING ] (13, 1, 'bot')
2019-02-06 06:08:01 [WARNING ] (13, 1, 'bot')
2019-02-06 06:08:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:08:01 [DEBUG   ] Finished updating board flags in 1.577 seconds
2019-02-06 06:08:12 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-02-06 06:08:32 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-02-06 06:08:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 06:09:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 06:09:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:09:01 [WARNING ] (13, 1, 'bot')
2019-02-06 06:09:01 [WARNING ] (13, 1, 'bot')
2019-02-06 06:09:01 [WARNING ] (13, 1, 'bot')
2019-02-06 06:09:01 [WARNING ] (13, 1, 'bot')
2019-02-06 06:09:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:09:01 [DEBUG   ] Finished updating board flags in 1.415 seconds
2019-02-06 06:09:12 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 06:09:32 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-06 06:09:52 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-02-06 06:10:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:10:01 [WARNING ] (13, 1, 'bot')
2019-02-06 06:10:01 [WARNING ] (13, 1, 'bot')
2019-02-06 06:10:01 [WARNING ] (13, 1, 'bot')
2019-02-06 06:10:01 [WARNING ] (13, 1, 'bot')
2019-02-06 06:10:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:10:01 [DEBUG   ] Finished updating board flags in 1.412 seconds
2019-02-06 06:10:06 [DEBUG   ] Got command RPT from MCS: ref #1416806
2019-02-06 06:10:06 [DEBUG   ] summary = ERROR
2019-02-06 06:10:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416806  13 58520 22206181 A  ERRORERROR'
2019-02-06 06:10:06 [DEBUG   ] Got command RPT from MCS: ref #1416807
2019-02-06 06:10:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 06:10:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416807  77 58520 22206385 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 06:10:06 [DEBUG   ] Got command RPT from MCS: ref #1416808
2019-02-06 06:10:06 [DEBUG   ] summary = ERROR
2019-02-06 06:10:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416808  13 58520 22206577 A  ERRORERROR'
2019-02-06 06:10:06 [DEBUG   ] Got command RPT from MCS: ref #1416809
2019-02-06 06:10:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 06:10:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416809  77 58520 22206781 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 06:10:06 [DEBUG   ] Got command RPT from MCS: ref #1416810
2019-02-06 06:10:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 06:10:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416810  12 58520 22206985 A  ERRORB—™š'
2019-02-06 06:10:12 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-06 06:10:33 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-02-06 06:10:53 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-02-06 06:11:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 06:11:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:11:01 [WARNING ] (13, 1, 'bot')
2019-02-06 06:11:01 [WARNING ] (13, 1, 'bot')
2019-02-06 06:11:01 [WARNING ] (13, 1, 'bot')
2019-02-06 06:11:01 [WARNING ] (13, 1, 'bot')
2019-02-06 06:11:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:11:01 [DEBUG   ] Finished updating board flags in 1.390 seconds
2019-02-06 06:11:12 [DEBUG   ] Got command RPT from MCS: ref #1416811
2019-02-06 06:11:12 [DEBUG   ] summary = ERROR
2019-02-06 06:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416811  13 58520 22272154 A  ERRORERROR'
2019-02-06 06:11:12 [DEBUG   ] Got command RPT from MCS: ref #1416812
2019-02-06 06:11:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 06:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416812  77 58520 22272154 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 06:11:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 06:11:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 06:11:53 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-02-06 06:12:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:12:01 [WARNING ] (13, 1, 'bot')
2019-02-06 06:12:01 [WARNING ] (13, 1, 'bot')
2019-02-06 06:12:01 [WARNING ] (13, 1, 'bot')
2019-02-06 06:12:01 [WARNING ] (13, 1, 'bot')
2019-02-06 06:12:01 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:12:01 [DEBUG   ] Finished updating board flags in 1.408 seconds
2019-02-06 06:12:13 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-02-06 06:12:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 06:12:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 06:13:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:13:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:13:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:13:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:13:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:13:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:13:02 [DEBUG   ] Finished updating board flags in 2.195 seconds
2019-02-06 06:13:13 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-02-06 06:13:33 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-06 06:13:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 06:14:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:14:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:14:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:14:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:14:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:14:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:14:02 [DEBUG   ] Finished updating board flags in 2.013 seconds
2019-02-06 06:14:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 06:14:33 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-02-06 06:14:53 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-02-06 06:15:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:15:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:15:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:15:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:15:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:15:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:15:02 [DEBUG   ] Finished updating board flags in 1.990 seconds
2019-02-06 06:15:06 [DEBUG   ] Got command RPT from MCS: ref #1416838
2019-02-06 06:15:06 [DEBUG   ] summary = ERROR
2019-02-06 06:15:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416838  13 58520 22506257 A  ERRORERROR'
2019-02-06 06:15:06 [DEBUG   ] Got command RPT from MCS: ref #1416839
2019-02-06 06:15:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 06:15:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416839  77 58520 22506461 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 06:15:06 [DEBUG   ] Got command RPT from MCS: ref #1416840
2019-02-06 06:15:06 [DEBUG   ] summary = ERROR
2019-02-06 06:15:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416840  13 58520 22506666 A  ERRORERROR'
2019-02-06 06:15:06 [DEBUG   ] Got command RPT from MCS: ref #1416842
2019-02-06 06:15:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 06:15:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416842  77 58520 22506857 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 06:15:07 [DEBUG   ] Got command RPT from MCS: ref #1416844
2019-02-06 06:15:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 06:15:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416844  12 58520 22507062 A  ERRORB–™š'
2019-02-06 06:15:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 06:15:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 06:15:53 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-02-06 06:16:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 06:16:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:16:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-02-06 06:16:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:16:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:16:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:16:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:16:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:16:02 [DEBUG   ] Finished updating board flags in 1.811 seconds
2019-02-06 06:16:12 [DEBUG   ] Got command RPT from MCS: ref #1416848
2019-02-06 06:16:12 [DEBUG   ] summary = ERROR
2019-02-06 06:16:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416848  13 58520 22572153 A  ERRORERROR'
2019-02-06 06:16:12 [DEBUG   ] Got command RPT from MCS: ref #1416849
2019-02-06 06:16:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 06:16:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416849  77 58520 22572154 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 06:16:13 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-02-06 06:16:34 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-02-06 06:16:54 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-02-06 06:17:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:17:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:17:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:17:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:17:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:17:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:17:02 [DEBUG   ] Finished updating board flags in 1.818 seconds
2019-02-06 06:17:14 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 06:17:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 06:17:54 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 06:18:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:18:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:18:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:18:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:18:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:18:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:18:02 [DEBUG   ] Finished updating board flags in 1.778 seconds
2019-02-06 06:18:14 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-06 06:18:34 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-06 06:18:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 06:19:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:19:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:19:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:19:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:19:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:19:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:19:02 [DEBUG   ] Finished updating board flags in 1.605 seconds
2019-02-06 06:19:14 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 06:19:34 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-06 06:19:54 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 06:20:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 06:20:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:20:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:20:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:20:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:20:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:20:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:20:02 [DEBUG   ] Finished updating board flags in 1.688 seconds
2019-02-06 06:20:06 [DEBUG   ] Got command RPT from MCS: ref #1416869
2019-02-06 06:20:06 [DEBUG   ] summary = ERROR
2019-02-06 06:20:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416869  13 58520 22806341 A  ERRORERROR'
2019-02-06 06:20:06 [DEBUG   ] Got command RPT from MCS: ref #1416870
2019-02-06 06:20:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 06:20:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416870  77 58520 22806545 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 06:20:06 [DEBUG   ] Got command RPT from MCS: ref #1416871
2019-02-06 06:20:06 [DEBUG   ] summary = ERROR
2019-02-06 06:20:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416871  13 58520 22806737 A  ERRORERROR'
2019-02-06 06:20:06 [DEBUG   ] Got command RPT from MCS: ref #1416872
2019-02-06 06:20:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 06:20:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416872  77 58520 22806941 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 06:20:07 [DEBUG   ] Got command RPT from MCS: ref #1416873
2019-02-06 06:20:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 06:20:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416873  12 58520 22807145 A  ERRORB˜™š'
2019-02-06 06:20:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 06:20:34 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 06:20:54 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-06 06:21:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:21:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:21:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:21:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:21:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:21:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:21:02 [DEBUG   ] Finished updating board flags in 1.509 seconds
2019-02-06 06:21:12 [DEBUG   ] Got command RPT from MCS: ref #1416878
2019-02-06 06:21:12 [DEBUG   ] summary = ERROR
2019-02-06 06:21:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416878  13 58520 22872157 A  ERRORERROR'
2019-02-06 06:21:12 [DEBUG   ] Got command RPT from MCS: ref #1416879
2019-02-06 06:21:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 06:21:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416879  77 58520 22872158 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 06:21:14 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 06:21:35 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-02-06 06:21:55 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-02-06 06:22:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:22:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:22:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:22:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:22:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:22:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:22:02 [DEBUG   ] Finished updating board flags in 1.413 seconds
2019-02-06 06:22:15 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 06:22:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 06:22:55 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-02-06 06:23:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:23:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:23:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:23:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:23:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:23:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:23:02 [DEBUG   ] Finished updating board flags in 1.401 seconds
2019-02-06 06:23:15 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-02-06 06:23:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 06:23:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 06:24:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:24:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:24:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:24:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:24:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:24:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:24:02 [DEBUG   ] Finished updating board flags in 1.414 seconds
2019-02-06 06:24:15 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-02-06 06:24:35 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-06 06:24:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 06:25:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:25:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:25:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:25:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:25:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:25:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:25:02 [DEBUG   ] Finished updating board flags in 1.367 seconds
2019-02-06 06:25:06 [DEBUG   ] Got command RPT from MCS: ref #1416901
2019-02-06 06:25:06 [DEBUG   ] summary = ERROR
2019-02-06 06:25:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416901  13 58520 23106413 A  ERRORERROR'
2019-02-06 06:25:06 [DEBUG   ] Got command RPT from MCS: ref #1416902
2019-02-06 06:25:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 06:25:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416902  77 58520 23106617 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 06:25:06 [DEBUG   ] Got command RPT from MCS: ref #1416903
2019-02-06 06:25:06 [DEBUG   ] summary = ERROR
2019-02-06 06:25:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416903  13 58520 23106821 A  ERRORERROR'
2019-02-06 06:25:07 [DEBUG   ] Got command RPT from MCS: ref #1416905
2019-02-06 06:25:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 06:25:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416905  77 58520 23107025 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 06:25:07 [DEBUG   ] Got command RPT from MCS: ref #1416907
2019-02-06 06:25:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 06:25:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416907  12 58520 23107217 A  ERRORB—™š'
2019-02-06 06:25:15 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 06:25:35 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-02-06 06:25:55 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-02-06 06:26:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:26:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:26:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:26:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:26:02 [WARNING ] (13, 1, 'bot')
2019-02-06 06:26:02 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:26:02 [DEBUG   ] Finished updating board flags in 1.362 seconds
2019-02-06 06:26:12 [DEBUG   ] Got command RPT from MCS: ref #1416911
2019-02-06 06:26:12 [DEBUG   ] summary = ERROR
2019-02-06 06:26:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416911  13 58520 23172157 A  ERRORERROR'
2019-02-06 06:26:12 [DEBUG   ] Got command RPT from MCS: ref #1416912
2019-02-06 06:26:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 06:26:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416912  77 58520 23172158 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 06:26:15 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-06 06:26:36 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-02-06 06:26:55 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2019-02-06 06:27:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:27:03 [WARNING ] (13, 1, 'bot')
2019-02-06 06:27:03 [WARNING ] (13, 1, 'bot')
2019-02-06 06:27:03 [WARNING ] (13, 1, 'bot')
2019-02-06 06:27:03 [WARNING ] (13, 1, 'bot')
2019-02-06 06:27:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:27:03 [DEBUG   ] Finished updating board flags in 2.060 seconds
2019-02-06 06:27:15 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-02-06 06:27:36 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 06:27:56 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-02-06 06:28:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:28:03 [WARNING ] (13, 1, 'bot')
2019-02-06 06:28:03 [WARNING ] (13, 1, 'bot')
2019-02-06 06:28:03 [WARNING ] (13, 1, 'bot')
2019-02-06 06:28:03 [WARNING ] (13, 1, 'bot')
2019-02-06 06:28:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:28:03 [DEBUG   ] Finished updating board flags in 1.994 seconds
2019-02-06 06:28:16 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-02-06 06:28:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 06:28:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 06:29:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:29:03 [WARNING ] (13, 1, 'bot')
2019-02-06 06:29:03 [WARNING ] (13, 1, 'bot')
2019-02-06 06:29:03 [WARNING ] (13, 1, 'bot')
2019-02-06 06:29:03 [WARNING ] (13, 1, 'bot')
2019-02-06 06:29:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:29:03 [DEBUG   ] Finished updating board flags in 1.809 seconds
2019-02-06 06:29:16 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-06 06:29:36 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-06 06:29:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 06:30:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 06:30:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:30:03 [WARNING ] (13, 1, 'bot')
2019-02-06 06:30:03 [WARNING ] (13, 1, 'bot')
2019-02-06 06:30:03 [WARNING ] (13, 1, 'bot')
2019-02-06 06:30:03 [WARNING ] (13, 1, 'bot')
2019-02-06 06:30:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:30:03 [DEBUG   ] Finished updating board flags in 1.787 seconds
2019-02-06 06:30:06 [DEBUG   ] Got command RPT from MCS: ref #1416936
2019-02-06 06:30:06 [DEBUG   ] summary = ERROR
2019-02-06 06:30:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416936  13 58520 23406497 A  ERRORERROR'
2019-02-06 06:30:06 [DEBUG   ] Got command RPT from MCS: ref #1416937
2019-02-06 06:30:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 06:30:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416937  77 58520 23406697 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 06:30:06 [DEBUG   ] Got command RPT from MCS: ref #1416938
2019-02-06 06:30:06 [DEBUG   ] summary = ERROR
2019-02-06 06:30:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416938  13 58520 23406905 A  ERRORERROR'
2019-02-06 06:30:07 [DEBUG   ] Got command RPT from MCS: ref #1416939
2019-02-06 06:30:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 06:30:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416939  77 58520 23407097 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 06:30:07 [DEBUG   ] Got command RPT from MCS: ref #1416940
2019-02-06 06:30:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 06:30:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416940  12 58520 23407301 A  ERRORB–™š'
2019-02-06 06:30:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 06:30:36 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-02-06 06:30:56 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-02-06 06:31:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 06:31:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:31:03 [WARNING ] (13, 1, 'bot')
2019-02-06 06:31:03 [WARNING ] (13, 1, 'bot')
2019-02-06 06:31:03 [WARNING ] (13, 1, 'bot')
2019-02-06 06:31:03 [WARNING ] (13, 1, 'bot')
2019-02-06 06:31:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:31:03 [DEBUG   ] Finished updating board flags in 1.636 seconds
2019-02-06 06:31:12 [DEBUG   ] Got command RPT from MCS: ref #1416941
2019-02-06 06:31:12 [DEBUG   ] summary = ERROR
2019-02-06 06:31:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416941  13 58520 23472149 A  ERRORERROR'
2019-02-06 06:31:12 [DEBUG   ] Got command RPT from MCS: ref #1416942
2019-02-06 06:31:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 06:31:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416942  77 58520 23472150 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 06:31:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 06:31:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 06:31:56 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-02-06 06:32:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-02-06 06:32:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:32:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-06 06:32:03 [WARNING ] (13, 1, 'bot')
2019-02-06 06:32:03 [WARNING ] (13, 1, 'bot')
2019-02-06 06:32:03 [WARNING ] (13, 1, 'bot')
2019-02-06 06:32:03 [WARNING ] (13, 1, 'bot')
2019-02-06 06:32:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:32:03 [DEBUG   ] Finished updating board flags in 1.577 seconds
2019-02-06 06:32:16 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 06:32:37 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-02-06 06:32:57 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-02-06 06:33:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-02-06 06:33:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:33:03 [WARNING ] (13, 1, 'bot')
2019-02-06 06:33:03 [WARNING ] (13, 1, 'bot')
2019-02-06 06:33:03 [WARNING ] (13, 1, 'bot')
2019-02-06 06:33:03 [WARNING ] (13, 1, 'bot')
2019-02-06 06:33:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:33:03 [DEBUG   ] Finished updating board flags in 1.420 seconds
2019-02-06 06:33:17 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-02-06 06:33:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 06:33:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 06:34:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:34:03 [WARNING ] (13, 1, 'bot')
2019-02-06 06:34:03 [WARNING ] (13, 1, 'bot')
2019-02-06 06:34:03 [WARNING ] (13, 1, 'bot')
2019-02-06 06:34:03 [WARNING ] (13, 1, 'bot')
2019-02-06 06:34:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:34:03 [DEBUG   ] Finished updating board flags in 1.411 seconds
2019-02-06 06:34:17 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-02-06 06:34:37 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-06 06:34:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 06:35:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:35:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:35:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:35:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:35:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:35:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:35:04 [DEBUG   ] Finished updating board flags in 2.449 seconds
2019-02-06 06:35:06 [DEBUG   ] Got command RPT from MCS: ref #1416964
2019-02-06 06:35:06 [DEBUG   ] summary = ERROR
2019-02-06 06:35:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416964  13 58520 23706573 A  ERRORERROR'
2019-02-06 06:35:06 [DEBUG   ] Got command RPT from MCS: ref #1416965
2019-02-06 06:35:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 06:35:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416965  77 58520 23706781 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 06:35:06 [DEBUG   ] Got command RPT from MCS: ref #1416966
2019-02-06 06:35:06 [DEBUG   ] summary = ERROR
2019-02-06 06:35:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416966  13 58520 23706985 A  ERRORERROR'
2019-02-06 06:35:07 [DEBUG   ] Got command RPT from MCS: ref #1416968
2019-02-06 06:35:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 06:35:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416968  77 58520 23707177 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 06:35:07 [DEBUG   ] Got command RPT from MCS: ref #1416970
2019-02-06 06:35:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 06:35:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416970  12 58520 23707381 A  ERRORB˜™š'
2019-02-06 06:35:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 06:35:37 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-02-06 06:35:57 [DEBUG   ] Finished updating ant stats in 0.771 seconds
2019-02-06 06:36:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:36:03 [WARNING ] (13, 1, 'bot')
2019-02-06 06:36:03 [WARNING ] (13, 1, 'bot')
2019-02-06 06:36:03 [WARNING ] (13, 1, 'bot')
2019-02-06 06:36:03 [WARNING ] (13, 1, 'bot')
2019-02-06 06:36:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:36:03 [DEBUG   ] Finished updating board flags in 1.337 seconds
2019-02-06 06:36:12 [DEBUG   ] Got command RPT from MCS: ref #1416978
2019-02-06 06:36:12 [DEBUG   ] summary = ERROR
2019-02-06 06:36:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416978  13 58520 23772153 A  ERRORERROR'
2019-02-06 06:36:12 [DEBUG   ] Got command RPT from MCS: ref #1416979
2019-02-06 06:36:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 06:36:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416979  77 58520 23772154 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 06:36:17 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 06:36:38 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-02-06 06:36:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 06:37:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:37:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:37:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:37:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:37:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:37:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:37:04 [DEBUG   ] Finished updating board flags in 2.205 seconds
2019-02-06 06:37:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 06:37:38 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-02-06 06:37:58 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-06 06:38:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:38:03 [WARNING ] (13, 1, 'bot')
2019-02-06 06:38:03 [WARNING ] (13, 1, 'bot')
2019-02-06 06:38:03 [WARNING ] (13, 1, 'bot')
2019-02-06 06:38:03 [WARNING ] (13, 1, 'bot')
2019-02-06 06:38:03 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:38:03 [DEBUG   ] Finished updating board flags in 1.328 seconds
2019-02-06 06:38:18 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 06:38:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 06:38:58 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 06:39:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:39:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:39:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:39:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:39:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:39:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:39:04 [DEBUG   ] Finished updating board flags in 2.071 seconds
2019-02-06 06:39:18 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-06 06:39:38 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-02-06 06:39:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 06:40:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:40:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:40:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:40:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:40:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:40:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:40:04 [DEBUG   ] Finished updating board flags in 1.996 seconds
2019-02-06 06:40:06 [DEBUG   ] Got command RPT from MCS: ref #1416999
2019-02-06 06:40:06 [DEBUG   ] summary = ERROR
2019-02-06 06:40:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1416999  13 58520 24006657 A  ERRORERROR'
2019-02-06 06:40:06 [DEBUG   ] Got command RPT from MCS: ref #1417000
2019-02-06 06:40:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 06:40:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417000  77 58520 24006857 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 06:40:07 [DEBUG   ] Got command RPT from MCS: ref #1417001
2019-02-06 06:40:07 [DEBUG   ] summary = ERROR
2019-02-06 06:40:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417001  13 58520 24007057 A  ERRORERROR'
2019-02-06 06:40:07 [DEBUG   ] Got command RPT from MCS: ref #1417002
2019-02-06 06:40:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 06:40:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417002  77 58520 24007261 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 06:40:07 [DEBUG   ] Got command RPT from MCS: ref #1417003
2019-02-06 06:40:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 06:40:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417003  12 58520 24007461 A  ERRORB—™š'
2019-02-06 06:40:18 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-02-06 06:40:38 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-06 06:40:58 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-06 06:41:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:41:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:41:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:41:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:41:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:41:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:41:04 [DEBUG   ] Finished updating board flags in 1.808 seconds
2019-02-06 06:41:12 [DEBUG   ] Got command RPT from MCS: ref #1417004
2019-02-06 06:41:12 [DEBUG   ] summary = ERROR
2019-02-06 06:41:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417004  13 58520 24072157 A  ERRORERROR'
2019-02-06 06:41:12 [DEBUG   ] Got command RPT from MCS: ref #1417005
2019-02-06 06:41:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 06:41:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417005  77 58520 24072158 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 06:41:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 06:41:38 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 06:41:58 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-06 06:42:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:42:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:42:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:42:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:42:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:42:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:42:04 [DEBUG   ] Finished updating board flags in 1.793 seconds
2019-02-06 06:42:18 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 06:42:38 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-06 06:42:59 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-02-06 06:43:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:43:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:43:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:43:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:43:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:43:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:43:04 [DEBUG   ] Finished updating board flags in 1.612 seconds
2019-02-06 06:43:19 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-06 06:43:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 06:43:59 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-02-06 06:44:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 06:44:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:44:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:44:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:44:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:44:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:44:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:44:04 [DEBUG   ] Finished updating board flags in 1.593 seconds
2019-02-06 06:44:19 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2019-02-06 06:44:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 06:44:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 06:45:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 06:45:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:45:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:45:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:45:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:45:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:45:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:45:04 [DEBUG   ] Finished updating board flags in 1.409 seconds
2019-02-06 06:45:06 [DEBUG   ] Got command RPT from MCS: ref #1417031
2019-02-06 06:45:06 [DEBUG   ] summary = ERROR
2019-02-06 06:45:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417031  13 58520 24306737 A  ERRORERROR'
2019-02-06 06:45:06 [DEBUG   ] Got command RPT from MCS: ref #1417032
2019-02-06 06:45:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 06:45:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417032  77 58520 24306941 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 06:45:07 [DEBUG   ] Got command RPT from MCS: ref #1417033
2019-02-06 06:45:07 [DEBUG   ] summary = ERROR
2019-02-06 06:45:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417033  13 58520 24307145 A  ERRORERROR'
2019-02-06 06:45:07 [DEBUG   ] Got command RPT from MCS: ref #1417035
2019-02-06 06:45:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 06:45:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417035  77 58520 24307337 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 06:45:07 [DEBUG   ] Got command RPT from MCS: ref #1417037
2019-02-06 06:45:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 06:45:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417037  12 58520 24307549 A  ERRORB—™š'
2019-02-06 06:45:19 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-02-06 06:45:39 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 06:45:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 06:46:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 06:46:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:46:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:46:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:46:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:46:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:46:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:46:04 [DEBUG   ] Finished updating board flags in 1.400 seconds
2019-02-06 06:46:12 [DEBUG   ] Got command RPT from MCS: ref #1417041
2019-02-06 06:46:12 [DEBUG   ] summary = ERROR
2019-02-06 06:46:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417041  13 58520 24372157 A  ERRORERROR'
2019-02-06 06:46:12 [DEBUG   ] Got command RPT from MCS: ref #1417042
2019-02-06 06:46:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 06:46:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417042  77 58520 24372158 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 06:46:19 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 06:46:39 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-06 06:46:59 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-02-06 06:47:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:47:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:47:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:47:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:47:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:47:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:47:04 [DEBUG   ] Finished updating board flags in 1.434 seconds
2019-02-06 06:47:19 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-06 06:47:39 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-06 06:48:00 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-02-06 06:48:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:48:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:48:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:48:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:48:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:48:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:48:04 [DEBUG   ] Finished updating board flags in 1.415 seconds
2019-02-06 06:48:20 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-02-06 06:48:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 06:49:00 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-02-06 06:49:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:49:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:49:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:49:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:49:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:49:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:49:04 [DEBUG   ] Finished updating board flags in 1.413 seconds
2019-02-06 06:49:20 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-02-06 06:49:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 06:50:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 06:50:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:50:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:50:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:50:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:50:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:50:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:50:04 [DEBUG   ] Finished updating board flags in 1.411 seconds
2019-02-06 06:50:06 [DEBUG   ] Got command RPT from MCS: ref #1417062
2019-02-06 06:50:06 [DEBUG   ] summary = ERROR
2019-02-06 06:50:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417062  13 58520 24606821 A  ERRORERROR'
2019-02-06 06:50:07 [DEBUG   ] Got command RPT from MCS: ref #1417063
2019-02-06 06:50:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 06:50:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417063  77 58520 24607029 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 06:50:07 [DEBUG   ] Got command RPT from MCS: ref #1417064
2019-02-06 06:50:07 [DEBUG   ] summary = ERROR
2019-02-06 06:50:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417064  13 58520 24607221 A  ERRORERROR'
2019-02-06 06:50:07 [DEBUG   ] Got command RPT from MCS: ref #1417065
2019-02-06 06:50:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 06:50:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417065  77 58520 24607425 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 06:50:07 [DEBUG   ] Got command RPT from MCS: ref #1417066
2019-02-06 06:50:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 06:50:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417066  12 58520 24607629 A  ERRORB˜™š'
2019-02-06 06:50:20 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2019-02-06 06:50:40 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 06:51:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 06:51:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:51:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-06 06:51:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:51:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:51:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:51:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:51:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:51:04 [DEBUG   ] Finished updating board flags in 1.416 seconds
2019-02-06 06:51:12 [DEBUG   ] Got command RPT from MCS: ref #1417071
2019-02-06 06:51:12 [DEBUG   ] summary = ERROR
2019-02-06 06:51:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417071  13 58520 24672157 A  ERRORERROR'
2019-02-06 06:51:12 [DEBUG   ] Got command RPT from MCS: ref #1417072
2019-02-06 06:51:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 06:51:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417072  77 58520 24672158 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 06:51:20 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 06:51:40 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-02-06 06:52:00 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-02-06 06:52:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:52:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:52:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:52:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:52:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:52:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:52:04 [DEBUG   ] Finished updating board flags in 1.451 seconds
2019-02-06 06:52:20 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-06 06:52:40 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-06 06:53:01 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-02-06 06:53:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:53:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-06 06:53:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:53:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:53:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:53:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:53:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:53:04 [DEBUG   ] Finished updating board flags in 1.450 seconds
2019-02-06 06:53:21 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-06 06:53:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 06:54:01 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-06 06:54:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:54:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-02-06 06:54:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:54:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:54:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:54:04 [WARNING ] (13, 1, 'bot')
2019-02-06 06:54:04 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:54:04 [DEBUG   ] Finished updating board flags in 1.455 seconds
2019-02-06 06:54:21 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 06:54:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 06:55:01 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2019-02-06 06:55:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:55:05 [WARNING ] (13, 1, 'bot')
2019-02-06 06:55:05 [WARNING ] (13, 1, 'bot')
2019-02-06 06:55:05 [WARNING ] (13, 1, 'bot')
2019-02-06 06:55:05 [WARNING ] (13, 1, 'bot')
2019-02-06 06:55:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:55:05 [DEBUG   ] Finished updating board flags in 2.249 seconds
2019-02-06 06:55:06 [DEBUG   ] Got command RPT from MCS: ref #1417094
2019-02-06 06:55:06 [DEBUG   ] summary = ERROR
2019-02-06 06:55:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417094  13 58520 24906902 A  ERRORERROR'
2019-02-06 06:55:07 [DEBUG   ] Got command RPT from MCS: ref #1417095
2019-02-06 06:55:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 06:55:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417095  77 58520 24907105 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 06:55:07 [DEBUG   ] Got command RPT from MCS: ref #1417096
2019-02-06 06:55:07 [DEBUG   ] summary = ERROR
2019-02-06 06:55:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417096  13 58520 24907306 A  ERRORERROR'
2019-02-06 06:55:07 [DEBUG   ] Got command RPT from MCS: ref #1417098
2019-02-06 06:55:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 06:55:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417098  77 58520 24907502 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 06:55:07 [DEBUG   ] Got command RPT from MCS: ref #1417100
2019-02-06 06:55:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 06:55:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417100  12 58520 24907705 A  ERRORB–™š'
2019-02-06 06:55:21 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-06 06:55:41 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-06 06:56:01 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 06:56:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:56:05 [WARNING ] (13, 1, 'bot')
2019-02-06 06:56:05 [WARNING ] (13, 1, 'bot')
2019-02-06 06:56:05 [WARNING ] (13, 1, 'bot')
2019-02-06 06:56:05 [WARNING ] (13, 1, 'bot')
2019-02-06 06:56:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:56:05 [DEBUG   ] Finished updating board flags in 2.121 seconds
2019-02-06 06:56:12 [DEBUG   ] Got command RPT from MCS: ref #1417104
2019-02-06 06:56:12 [DEBUG   ] summary = ERROR
2019-02-06 06:56:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417104  13 58520 24972165 A  ERRORERROR'
2019-02-06 06:56:12 [DEBUG   ] Got command RPT from MCS: ref #1417105
2019-02-06 06:56:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 06:56:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417105  77 58520 24972166 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 06:56:21 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 06:56:41 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-02-06 06:57:01 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-02-06 06:57:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:57:05 [WARNING ] (13, 1, 'bot')
2019-02-06 06:57:05 [WARNING ] (13, 1, 'bot')
2019-02-06 06:57:05 [WARNING ] (13, 1, 'bot')
2019-02-06 06:57:05 [WARNING ] (13, 1, 'bot')
2019-02-06 06:57:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:57:05 [DEBUG   ] Finished updating board flags in 2.007 seconds
2019-02-06 06:57:21 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 06:57:42 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-02-06 06:58:02 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-02-06 06:58:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:58:05 [WARNING ] (13, 1, 'bot')
2019-02-06 06:58:05 [WARNING ] (13, 1, 'bot')
2019-02-06 06:58:05 [WARNING ] (13, 1, 'bot')
2019-02-06 06:58:05 [WARNING ] (13, 1, 'bot')
2019-02-06 06:58:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:58:05 [DEBUG   ] Finished updating board flags in 1.997 seconds
2019-02-06 06:58:22 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-02-06 06:58:42 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 06:59:02 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-06 06:59:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 06:59:05 [WARNING ] (13, 1, 'bot')
2019-02-06 06:59:05 [WARNING ] (13, 1, 'bot')
2019-02-06 06:59:05 [WARNING ] (13, 1, 'bot')
2019-02-06 06:59:05 [WARNING ] (13, 1, 'bot')
2019-02-06 06:59:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 06:59:05 [DEBUG   ] Finished updating board flags in 1.806 seconds
2019-02-06 06:59:22 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-02-06 06:59:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 07:00:02 [DEBUG   ] Finished updating ant stats in 1.363 seconds
2019-02-06 07:00:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:00:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-02-06 07:00:05 [WARNING ] (13, 1, 'bot')
2019-02-06 07:00:05 [WARNING ] (13, 1, 'bot')
2019-02-06 07:00:05 [WARNING ] (13, 1, 'bot')
2019-02-06 07:00:05 [WARNING ] (13, 1, 'bot')
2019-02-06 07:00:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:00:05 [DEBUG   ] Finished updating board flags in 1.813 seconds
2019-02-06 07:00:06 [DEBUG   ] Got command RPT from MCS: ref #1417129
2019-02-06 07:00:06 [DEBUG   ] summary = ERROR
2019-02-06 07:00:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417129  13 58520 25206985 A  ERRORERROR'
2019-02-06 07:00:07 [DEBUG   ] Got command RPT from MCS: ref #1417130
2019-02-06 07:00:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 07:00:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417130  77 58520 25207177 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 07:00:07 [DEBUG   ] Got command RPT from MCS: ref #1417131
2019-02-06 07:00:07 [DEBUG   ] summary = ERROR
2019-02-06 07:00:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417131  13 58520 25207381 A  ERRORERROR'
2019-02-06 07:00:07 [DEBUG   ] Got command RPT from MCS: ref #1417132
2019-02-06 07:00:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 07:00:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417132  77 58520 25207589 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 07:00:07 [DEBUG   ] Got command RPT from MCS: ref #1417133
2019-02-06 07:00:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 07:00:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417133  12 58520 25207781 A  ERRORB–™š'
2019-02-06 07:00:22 [DEBUG   ] Finished updating ant stats in 0.841 seconds
2019-02-06 07:00:42 [DEBUG   ] Finished updating ant stats in 0.627 seconds
2019-02-06 07:01:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 07:01:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:01:05 [WARNING ] (13, 1, 'bot')
2019-02-06 07:01:05 [WARNING ] (13, 1, 'bot')
2019-02-06 07:01:05 [WARNING ] (13, 1, 'bot')
2019-02-06 07:01:05 [WARNING ] (13, 1, 'bot')
2019-02-06 07:01:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:01:05 [DEBUG   ] Finished updating board flags in 1.787 seconds
2019-02-06 07:01:12 [DEBUG   ] Got command RPT from MCS: ref #1417134
2019-02-06 07:01:12 [DEBUG   ] summary = ERROR
2019-02-06 07:01:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417134  13 58520 25272157 A  ERRORERROR'
2019-02-06 07:01:12 [DEBUG   ] Got command RPT from MCS: ref #1417135
2019-02-06 07:01:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 07:01:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417135  77 58520 25272158 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 07:01:22 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-02-06 07:01:42 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-06 07:02:02 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-02-06 07:02:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:02:05 [WARNING ] (13, 1, 'bot')
2019-02-06 07:02:05 [WARNING ] (13, 1, 'bot')
2019-02-06 07:02:05 [WARNING ] (13, 1, 'bot')
2019-02-06 07:02:05 [WARNING ] (13, 1, 'bot')
2019-02-06 07:02:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:02:05 [DEBUG   ] Finished updating board flags in 1.613 seconds
2019-02-06 07:02:22 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-06 07:02:43 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-02-06 07:03:03 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-06 07:03:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:03:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-06 07:03:05 [WARNING ] (13, 1, 'bot')
2019-02-06 07:03:05 [WARNING ] (13, 1, 'bot')
2019-02-06 07:03:05 [WARNING ] (13, 1, 'bot')
2019-02-06 07:03:05 [WARNING ] (13, 1, 'bot')
2019-02-06 07:03:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:03:05 [DEBUG   ] Finished updating board flags in 1.583 seconds
2019-02-06 07:03:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 07:03:43 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-02-06 07:04:03 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2019-02-06 07:04:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:04:05 [WARNING ] (13, 1, 'bot')
2019-02-06 07:04:05 [WARNING ] (13, 1, 'bot')
2019-02-06 07:04:05 [WARNING ] (13, 1, 'bot')
2019-02-06 07:04:05 [WARNING ] (13, 1, 'bot')
2019-02-06 07:04:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:04:05 [DEBUG   ] Finished updating board flags in 1.419 seconds
2019-02-06 07:04:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 07:04:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 07:05:03 [DEBUG   ] Finished updating ant stats in 1.363 seconds
2019-02-06 07:05:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:05:05 [WARNING ] (13, 1, 'bot')
2019-02-06 07:05:05 [WARNING ] (13, 1, 'bot')
2019-02-06 07:05:05 [WARNING ] (13, 1, 'bot')
2019-02-06 07:05:05 [WARNING ] (13, 1, 'bot')
2019-02-06 07:05:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:05:05 [DEBUG   ] Finished updating board flags in 1.388 seconds
2019-02-06 07:05:07 [DEBUG   ] Got command RPT from MCS: ref #1417157
2019-02-06 07:05:07 [DEBUG   ] summary = ERROR
2019-02-06 07:05:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417157  13 58520 25507057 A  ERRORERROR'
2019-02-06 07:05:07 [DEBUG   ] Got command RPT from MCS: ref #1417158
2019-02-06 07:05:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 07:05:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417158  77 58520 25507261 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 07:05:07 [DEBUG   ] Got command RPT from MCS: ref #1417159
2019-02-06 07:05:07 [DEBUG   ] summary = ERROR
2019-02-06 07:05:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417159  13 58520 25507465 A  ERRORERROR'
2019-02-06 07:05:07 [DEBUG   ] Got command RPT from MCS: ref #1417161
2019-02-06 07:05:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 07:05:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417161  77 58520 25507657 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 07:05:07 [DEBUG   ] Got command RPT from MCS: ref #1417163
2019-02-06 07:05:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 07:05:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417163  12 58520 25507865 A  ERRORB˜™š'
2019-02-06 07:05:23 [DEBUG   ] Finished updating ant stats in 0.840 seconds
2019-02-06 07:05:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 07:06:03 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-02-06 07:06:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:06:05 [WARNING ] (13, 1, 'bot')
2019-02-06 07:06:05 [WARNING ] (13, 1, 'bot')
2019-02-06 07:06:05 [WARNING ] (13, 1, 'bot')
2019-02-06 07:06:05 [WARNING ] (13, 1, 'bot')
2019-02-06 07:06:05 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:06:05 [DEBUG   ] Finished updating board flags in 1.360 seconds
2019-02-06 07:06:12 [DEBUG   ] Got command RPT from MCS: ref #1417171
2019-02-06 07:06:12 [DEBUG   ] summary = ERROR
2019-02-06 07:06:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417171  13 58520 25572161 A  ERRORERROR'
2019-02-06 07:06:12 [DEBUG   ] Got command RPT from MCS: ref #1417172
2019-02-06 07:06:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 07:06:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417172  77 58520 25572162 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 07:06:23 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-06 07:06:43 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 07:07:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 07:07:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:07:06 [WARNING ] (13, 1, 'bot')
2019-02-06 07:07:06 [WARNING ] (13, 1, 'bot')
2019-02-06 07:07:06 [WARNING ] (13, 1, 'bot')
2019-02-06 07:07:06 [WARNING ] (13, 1, 'bot')
2019-02-06 07:07:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:07:06 [DEBUG   ] Finished updating board flags in 2.051 seconds
2019-02-06 07:07:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 07:07:43 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-02-06 07:08:03 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 07:08:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:08:06 [WARNING ] (13, 1, 'bot')
2019-02-06 07:08:06 [WARNING ] (13, 1, 'bot')
2019-02-06 07:08:06 [WARNING ] (13, 1, 'bot')
2019-02-06 07:08:06 [WARNING ] (13, 1, 'bot')
2019-02-06 07:08:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:08:06 [DEBUG   ] Finished updating board flags in 2.028 seconds
2019-02-06 07:08:24 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-02-06 07:08:44 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-02-06 07:09:04 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-02-06 07:09:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:09:06 [WARNING ] (13, 1, 'bot')
2019-02-06 07:09:06 [WARNING ] (13, 1, 'bot')
2019-02-06 07:09:06 [WARNING ] (13, 1, 'bot')
2019-02-06 07:09:06 [WARNING ] (13, 1, 'bot')
2019-02-06 07:09:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:09:06 [DEBUG   ] Finished updating board flags in 1.977 seconds
2019-02-06 07:09:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 07:09:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 07:10:04 [DEBUG   ] Finished updating ant stats in 1.009 seconds
2019-02-06 07:10:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:10:06 [WARNING ] (13, 1, 'bot')
2019-02-06 07:10:06 [WARNING ] (13, 1, 'bot')
2019-02-06 07:10:06 [WARNING ] (13, 1, 'bot')
2019-02-06 07:10:06 [WARNING ] (13, 1, 'bot')
2019-02-06 07:10:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:10:06 [DEBUG   ] Finished updating board flags in 1.844 seconds
2019-02-06 07:10:07 [DEBUG   ] Got command RPT from MCS: ref #1417192
2019-02-06 07:10:07 [DEBUG   ] summary = ERROR
2019-02-06 07:10:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417192  13 58520 25807137 A  ERRORERROR'
2019-02-06 07:10:07 [DEBUG   ] Got command RPT from MCS: ref #1417193
2019-02-06 07:10:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 07:10:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417193  77 58520 25807346 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 07:10:07 [DEBUG   ] Got command RPT from MCS: ref #1417194
2019-02-06 07:10:07 [DEBUG   ] summary = ERROR
2019-02-06 07:10:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417194  13 58520 25807537 A  ERRORERROR'
2019-02-06 07:10:07 [DEBUG   ] Got command RPT from MCS: ref #1417195
2019-02-06 07:10:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 07:10:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417195  77 58520 25807741 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 07:10:07 [DEBUG   ] Got command RPT from MCS: ref #1417196
2019-02-06 07:10:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 07:10:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417196  12 58520 25807945 A  ERRORB–™š'
2019-02-06 07:10:24 [DEBUG   ] Finished updating ant stats in 0.987 seconds
2019-02-06 07:10:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 07:11:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 07:11:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:11:06 [WARNING ] (13, 1, 'bot')
2019-02-06 07:11:06 [WARNING ] (13, 1, 'bot')
2019-02-06 07:11:06 [WARNING ] (13, 1, 'bot')
2019-02-06 07:11:06 [WARNING ] (13, 1, 'bot')
2019-02-06 07:11:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:11:06 [DEBUG   ] Finished updating board flags in 1.755 seconds
2019-02-06 07:11:12 [DEBUG   ] Got command RPT from MCS: ref #1417197
2019-02-06 07:11:12 [DEBUG   ] summary = ERROR
2019-02-06 07:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417197  13 58520 25872161 A  ERRORERROR'
2019-02-06 07:11:12 [DEBUG   ] Got command RPT from MCS: ref #1417198
2019-02-06 07:11:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 07:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417198  77 58520 25872162 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 07:11:24 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-02-06 07:11:44 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-02-06 07:12:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 07:12:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:12:06 [WARNING ] (13, 1, 'bot')
2019-02-06 07:12:06 [WARNING ] (13, 1, 'bot')
2019-02-06 07:12:06 [WARNING ] (13, 1, 'bot')
2019-02-06 07:12:06 [WARNING ] (13, 1, 'bot')
2019-02-06 07:12:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:12:06 [DEBUG   ] Finished updating board flags in 1.612 seconds
2019-02-06 07:12:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 07:12:44 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-02-06 07:13:04 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-02-06 07:13:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:13:06 [WARNING ] (13, 1, 'bot')
2019-02-06 07:13:06 [WARNING ] (13, 1, 'bot')
2019-02-06 07:13:06 [WARNING ] (13, 1, 'bot')
2019-02-06 07:13:06 [WARNING ] (13, 1, 'bot')
2019-02-06 07:13:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:13:06 [DEBUG   ] Finished updating board flags in 1.623 seconds
2019-02-06 07:13:24 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 07:13:45 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-02-06 07:14:05 [DEBUG   ] Finished updating ant stats in 1.251 seconds
2019-02-06 07:14:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:14:06 [WARNING ] (13, 1, 'bot')
2019-02-06 07:14:06 [WARNING ] (13, 1, 'bot')
2019-02-06 07:14:06 [WARNING ] (13, 1, 'bot')
2019-02-06 07:14:06 [WARNING ] (13, 1, 'bot')
2019-02-06 07:14:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:14:06 [DEBUG   ] Finished updating board flags in 1.574 seconds
2019-02-06 07:14:25 [DEBUG   ] Finished updating ant stats in 1.150 seconds
2019-02-06 07:14:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 07:15:05 [DEBUG   ] Finished updating ant stats in 1.051 seconds
2019-02-06 07:15:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-02-06 07:15:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:15:06 [WARNING ] (13, 1, 'bot')
2019-02-06 07:15:06 [WARNING ] (13, 1, 'bot')
2019-02-06 07:15:06 [WARNING ] (13, 1, 'bot')
2019-02-06 07:15:06 [WARNING ] (13, 1, 'bot')
2019-02-06 07:15:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:15:06 [DEBUG   ] Finished updating board flags in 1.418 seconds
2019-02-06 07:15:07 [DEBUG   ] Got command RPT from MCS: ref #1417224
2019-02-06 07:15:07 [DEBUG   ] summary = ERROR
2019-02-06 07:15:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417224  13 58520 26107221 A  ERRORERROR'
2019-02-06 07:15:07 [DEBUG   ] Got command RPT from MCS: ref #1417225
2019-02-06 07:15:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 07:15:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417225  77 58520 26107425 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 07:15:07 [DEBUG   ] Got command RPT from MCS: ref #1417226
2019-02-06 07:15:07 [DEBUG   ] summary = ERROR
2019-02-06 07:15:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417226  13 58520 26107617 A  ERRORERROR'
2019-02-06 07:15:07 [DEBUG   ] Got command RPT from MCS: ref #1417228
2019-02-06 07:15:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 07:15:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417228  77 58520 26107821 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 07:15:08 [DEBUG   ] Got command RPT from MCS: ref #1417230
2019-02-06 07:15:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 07:15:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417230  12 58520 26108029 A  ERRORB—™š'
2019-02-06 07:15:25 [DEBUG   ] Finished updating ant stats in 0.955 seconds
2019-02-06 07:15:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 07:16:05 [DEBUG   ] Finished updating ant stats in 0.832 seconds
2019-02-06 07:16:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 07:16:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:16:06 [WARNING ] (13, 1, 'bot')
2019-02-06 07:16:06 [WARNING ] (13, 1, 'bot')
2019-02-06 07:16:06 [WARNING ] (13, 1, 'bot')
2019-02-06 07:16:06 [WARNING ] (13, 1, 'bot')
2019-02-06 07:16:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:16:06 [DEBUG   ] Finished updating board flags in 1.380 seconds
2019-02-06 07:16:12 [DEBUG   ] Got command RPT from MCS: ref #1417234
2019-02-06 07:16:12 [DEBUG   ] summary = ERROR
2019-02-06 07:16:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417234  13 58520 26172161 A  ERRORERROR'
2019-02-06 07:16:12 [DEBUG   ] Got command RPT from MCS: ref #1417235
2019-02-06 07:16:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 07:16:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417235  77 58520 26172162 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 07:16:25 [DEBUG   ] Finished updating ant stats in 0.776 seconds
2019-02-06 07:16:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-06 07:17:05 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 07:17:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:17:06 [WARNING ] (13, 1, 'bot')
2019-02-06 07:17:06 [WARNING ] (13, 1, 'bot')
2019-02-06 07:17:06 [WARNING ] (13, 1, 'bot')
2019-02-06 07:17:06 [WARNING ] (13, 1, 'bot')
2019-02-06 07:17:06 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:17:06 [DEBUG   ] Finished updating board flags in 1.358 seconds
2019-02-06 07:17:26 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-02-06 07:17:46 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-06 07:18:06 [DEBUG   ] Finished updating ant stats in 1.252 seconds
2019-02-06 07:18:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:18:07 [WARNING ] (13, 1, 'bot')
2019-02-06 07:18:07 [WARNING ] (13, 1, 'bot')
2019-02-06 07:18:07 [WARNING ] (13, 1, 'bot')
2019-02-06 07:18:07 [WARNING ] (13, 1, 'bot')
2019-02-06 07:18:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:18:07 [DEBUG   ] Finished updating board flags in 2.053 seconds
2019-02-06 07:18:26 [DEBUG   ] Finished updating ant stats in 1.157 seconds
2019-02-06 07:18:46 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-06 07:19:06 [DEBUG   ] Finished updating ant stats in 1.044 seconds
2019-02-06 07:19:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:19:07 [WARNING ] (13, 1, 'bot')
2019-02-06 07:19:07 [WARNING ] (13, 1, 'bot')
2019-02-06 07:19:07 [WARNING ] (13, 1, 'bot')
2019-02-06 07:19:07 [WARNING ] (13, 1, 'bot')
2019-02-06 07:19:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:19:07 [DEBUG   ] Finished updating board flags in 2.016 seconds
2019-02-06 07:19:26 [DEBUG   ] Finished updating ant stats in 0.951 seconds
2019-02-06 07:19:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 07:20:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:20:07 [DEBUG   ] Got command RPT from MCS: ref #1417255
2019-02-06 07:20:07 [DEBUG   ] summary = ERROR
2019-02-06 07:20:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417255  13 58520 26407305 A  ERRORERROR'
2019-02-06 07:20:07 [DEBUG   ] Finished updating ant stats in 1.796 seconds
2019-02-06 07:20:07 [DEBUG   ] Got command RPT from MCS: ref #1417256
2019-02-06 07:20:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 07:20:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417256  77 58520 26407525 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 07:20:07 [WARNING ] (13, 1, 'bot')
2019-02-06 07:20:07 [WARNING ] (13, 1, 'bot')
2019-02-06 07:20:07 [WARNING ] (13, 1, 'bot')
2019-02-06 07:20:07 [WARNING ] (13, 1, 'bot')
2019-02-06 07:20:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:20:07 [DEBUG   ] Finished updating board flags in 2.006 seconds
2019-02-06 07:20:07 [DEBUG   ] Got command RPT from MCS: ref #1417257
2019-02-06 07:20:07 [DEBUG   ] summary = ERROR
2019-02-06 07:20:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417257  13 58520 26407701 A  ERRORERROR'
2019-02-06 07:20:07 [DEBUG   ] Got command RPT from MCS: ref #1417258
2019-02-06 07:20:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 07:20:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417258  77 58520 26407912 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 07:20:08 [DEBUG   ] Got command RPT from MCS: ref #1417259
2019-02-06 07:20:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 07:20:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417259  12 58520 26408102 A  ERRORB—™š'
2019-02-06 07:20:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 07:20:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 07:21:06 [DEBUG   ] Finished updating ant stats in 0.651 seconds
2019-02-06 07:21:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:21:07 [WARNING ] (13, 1, 'bot')
2019-02-06 07:21:07 [WARNING ] (13, 1, 'bot')
2019-02-06 07:21:07 [WARNING ] (13, 1, 'bot')
2019-02-06 07:21:07 [WARNING ] (13, 1, 'bot')
2019-02-06 07:21:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:21:07 [DEBUG   ] Finished updating board flags in 1.987 seconds
2019-02-06 07:21:12 [DEBUG   ] Got command RPT from MCS: ref #1417264
2019-02-06 07:21:12 [DEBUG   ] summary = ERROR
2019-02-06 07:21:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417264  13 58520 26472165 A  ERRORERROR'
2019-02-06 07:21:12 [DEBUG   ] Got command RPT from MCS: ref #1417265
2019-02-06 07:21:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 07:21:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417265  77 58520 26472166 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 07:21:26 [DEBUG   ] Finished updating ant stats in 0.557 seconds
2019-02-06 07:21:47 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-02-06 07:22:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:22:07 [DEBUG   ] Finished updating ant stats in 1.252 seconds
2019-02-06 07:22:07 [WARNING ] (13, 1, 'bot')
2019-02-06 07:22:07 [WARNING ] (13, 1, 'bot')
2019-02-06 07:22:07 [WARNING ] (13, 1, 'bot')
2019-02-06 07:22:07 [WARNING ] (13, 1, 'bot')
2019-02-06 07:22:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:22:07 [DEBUG   ] Finished updating board flags in 1.861 seconds
2019-02-06 07:22:27 [DEBUG   ] Finished updating ant stats in 1.155 seconds
2019-02-06 07:22:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 07:23:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:23:07 [DEBUG   ] Finished updating ant stats in 1.046 seconds
2019-02-06 07:23:07 [WARNING ] (13, 1, 'bot')
2019-02-06 07:23:07 [WARNING ] (13, 1, 'bot')
2019-02-06 07:23:07 [WARNING ] (13, 1, 'bot')
2019-02-06 07:23:07 [WARNING ] (13, 1, 'bot')
2019-02-06 07:23:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:23:07 [DEBUG   ] Finished updating board flags in 1.790 seconds
2019-02-06 07:23:27 [DEBUG   ] Finished updating ant stats in 0.961 seconds
2019-02-06 07:23:47 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2019-02-06 07:24:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:24:07 [DEBUG   ] Finished updating ant stats in 0.646 seconds
2019-02-06 07:24:07 [WARNING ] (13, 1, 'bot')
2019-02-06 07:24:07 [WARNING ] (13, 1, 'bot')
2019-02-06 07:24:07 [WARNING ] (13, 1, 'bot')
2019-02-06 07:24:07 [WARNING ] (13, 1, 'bot')
2019-02-06 07:24:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:24:07 [DEBUG   ] Finished updating board flags in 1.618 seconds
2019-02-06 07:24:27 [DEBUG   ] Finished updating ant stats in 0.559 seconds
2019-02-06 07:24:48 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-02-06 07:25:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:25:07 [DEBUG   ] Got command RPT from MCS: ref #1417287
2019-02-06 07:25:07 [DEBUG   ] summary = ERROR
2019-02-06 07:25:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417287  13 58520 26707377 A  ERRORERROR'
2019-02-06 07:25:07 [DEBUG   ] Got command RPT from MCS: ref #1417288
2019-02-06 07:25:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 07:25:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417288  77 58520 26707581 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 07:25:07 [WARNING ] (13, 1, 'bot')
2019-02-06 07:25:07 [WARNING ] (13, 1, 'bot')
2019-02-06 07:25:07 [WARNING ] (13, 1, 'bot')
2019-02-06 07:25:07 [WARNING ] (13, 1, 'bot')
2019-02-06 07:25:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:25:07 [DEBUG   ] Finished updating board flags in 1.595 seconds
2019-02-06 07:25:07 [DEBUG   ] Got command RPT from MCS: ref #1417289
2019-02-06 07:25:07 [DEBUG   ] summary = ERROR
2019-02-06 07:25:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417289  13 58520 26707786 A  ERRORERROR'
2019-02-06 07:25:07 [DEBUG   ] Got command RPT from MCS: ref #1417291
2019-02-06 07:25:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 07:25:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417291  77 58520 26707977 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 07:25:08 [DEBUG   ] Got command RPT from MCS: ref #1417292
2019-02-06 07:25:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 07:25:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417292  12 58520 26708185 A  ERRORB—™š'
2019-02-06 07:25:08 [DEBUG   ] Finished updating ant stats in 1.214 seconds
2019-02-06 07:25:28 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2019-02-06 07:25:48 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-02-06 07:26:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:26:07 [WARNING ] (13, 1, 'bot')
2019-02-06 07:26:07 [WARNING ] (13, 1, 'bot')
2019-02-06 07:26:07 [WARNING ] (13, 1, 'bot')
2019-02-06 07:26:07 [WARNING ] (13, 1, 'bot')
2019-02-06 07:26:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:26:07 [DEBUG   ] Finished updating board flags in 1.457 seconds
2019-02-06 07:26:08 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-06 07:26:12 [DEBUG   ] Got command RPT from MCS: ref #1417297
2019-02-06 07:26:12 [DEBUG   ] summary = ERROR
2019-02-06 07:26:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417297  13 58520 26772165 A  ERRORERROR'
2019-02-06 07:26:12 [DEBUG   ] Got command RPT from MCS: ref #1417298
2019-02-06 07:26:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 07:26:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417298  77 58520 26772166 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 07:26:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 07:26:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 07:27:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:27:07 [WARNING ] (13, 1, 'bot')
2019-02-06 07:27:07 [WARNING ] (13, 1, 'bot')
2019-02-06 07:27:07 [WARNING ] (13, 1, 'bot')
2019-02-06 07:27:07 [WARNING ] (13, 1, 'bot')
2019-02-06 07:27:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:27:07 [DEBUG   ] Finished updating board flags in 1.484 seconds
2019-02-06 07:27:08 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-02-06 07:27:28 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-02-06 07:27:48 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-02-06 07:28:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:28:07 [WARNING ] (13, 1, 'bot')
2019-02-06 07:28:07 [WARNING ] (13, 1, 'bot')
2019-02-06 07:28:07 [WARNING ] (13, 1, 'bot')
2019-02-06 07:28:07 [WARNING ] (13, 1, 'bot')
2019-02-06 07:28:07 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:28:07 [DEBUG   ] Finished updating board flags in 1.440 seconds
2019-02-06 07:28:08 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-06 07:28:29 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-02-06 07:28:49 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-06 07:29:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 07:29:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:29:08 [WARNING ] (13, 1, 'bot')
2019-02-06 07:29:08 [WARNING ] (13, 1, 'bot')
2019-02-06 07:29:08 [WARNING ] (13, 1, 'bot')
2019-02-06 07:29:08 [WARNING ] (13, 1, 'bot')
2019-02-06 07:29:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:29:08 [DEBUG   ] Finished updating board flags in 2.232 seconds
2019-02-06 07:29:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 07:29:29 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 07:29:49 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-02-06 07:30:07 [DEBUG   ] Got command RPT from MCS: ref #1417322
2019-02-06 07:30:07 [DEBUG   ] summary = ERROR
2019-02-06 07:30:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417322  13 58520 27007601 A  ERRORERROR'
2019-02-06 07:30:07 [DEBUG   ] Got command RPT from MCS: ref #1417323
2019-02-06 07:30:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 07:30:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417323  77 58520 27007658 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 07:30:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:30:07 [DEBUG   ] Got command RPT from MCS: ref #1417324
2019-02-06 07:30:07 [DEBUG   ] summary = ERROR
2019-02-06 07:30:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417324  13 58520 27007862 A  ERRORERROR'
2019-02-06 07:30:08 [DEBUG   ] Got command RPT from MCS: ref #1417325
2019-02-06 07:30:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 07:30:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417325  77 58520 27008066 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 07:30:08 [DEBUG   ] Got command RPT from MCS: ref #1417326
2019-02-06 07:30:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 07:30:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417326  12 58520 27008258 A  ERRORB’™š'
2019-02-06 07:30:08 [WARNING ] (13, 1, 'bot')
2019-02-06 07:30:08 [WARNING ] (13, 1, 'bot')
2019-02-06 07:30:08 [WARNING ] (13, 1, 'bot')
2019-02-06 07:30:08 [WARNING ] (13, 1, 'bot')
2019-02-06 07:30:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:30:08 [DEBUG   ] Finished updating board flags in 2.296 seconds
2019-02-06 07:30:09 [DEBUG   ] Finished updating ant stats in 1.017 seconds
2019-02-06 07:30:29 [DEBUG   ] Finished updating ant stats in 0.983 seconds
2019-02-06 07:30:49 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 07:31:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 07:31:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:31:08 [WARNING ] (13, 1, 'bot')
2019-02-06 07:31:08 [WARNING ] (13, 1, 'bot')
2019-02-06 07:31:08 [WARNING ] (13, 1, 'bot')
2019-02-06 07:31:08 [WARNING ] (13, 1, 'bot')
2019-02-06 07:31:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:31:08 [DEBUG   ] Finished updating board flags in 2.087 seconds
2019-02-06 07:31:09 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-02-06 07:31:12 [DEBUG   ] Got command RPT from MCS: ref #1417327
2019-02-06 07:31:12 [DEBUG   ] summary = ERROR
2019-02-06 07:31:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417327  13 58520 27072165 A  ERRORERROR'
2019-02-06 07:31:12 [DEBUG   ] Got command RPT from MCS: ref #1417328
2019-02-06 07:31:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 07:31:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417328  77 58520 27072166 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 07:31:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 07:31:49 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 07:32:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 07:32:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:32:08 [WARNING ] (13, 1, 'bot')
2019-02-06 07:32:08 [WARNING ] (13, 1, 'bot')
2019-02-06 07:32:08 [WARNING ] (13, 1, 'bot')
2019-02-06 07:32:08 [WARNING ] (13, 1, 'bot')
2019-02-06 07:32:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:32:08 [DEBUG   ] Finished updating board flags in 1.972 seconds
2019-02-06 07:32:09 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-02-06 07:32:29 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 07:32:50 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-02-06 07:33:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:33:08 [WARNING ] (13, 1, 'bot')
2019-02-06 07:33:08 [WARNING ] (13, 1, 'bot')
2019-02-06 07:33:08 [WARNING ] (13, 1, 'bot')
2019-02-06 07:33:08 [WARNING ] (13, 1, 'bot')
2019-02-06 07:33:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:33:08 [DEBUG   ] Finished updating board flags in 1.782 seconds
2019-02-06 07:33:09 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-06 07:33:29 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-02-06 07:33:50 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-02-06 07:34:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:34:08 [WARNING ] (13, 1, 'bot')
2019-02-06 07:34:08 [WARNING ] (13, 1, 'bot')
2019-02-06 07:34:08 [WARNING ] (13, 1, 'bot')
2019-02-06 07:34:08 [WARNING ] (13, 1, 'bot')
2019-02-06 07:34:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:34:08 [DEBUG   ] Finished updating board flags in 1.621 seconds
2019-02-06 07:34:10 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-02-06 07:34:30 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-02-06 07:34:50 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 07:35:07 [DEBUG   ] Got command RPT from MCS: ref #1417350
2019-02-06 07:35:07 [DEBUG   ] summary = ERROR
2019-02-06 07:35:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417350  13 58520 27307541 A  ERRORERROR'
2019-02-06 07:35:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:35:07 [DEBUG   ] Got command RPT from MCS: ref #1417351
2019-02-06 07:35:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 07:35:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417351  77 58520 27307745 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 07:35:07 [DEBUG   ] Got command RPT from MCS: ref #1417352
2019-02-06 07:35:07 [DEBUG   ] summary = ERROR
2019-02-06 07:35:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417352  13 58520 27307941 A  ERRORERROR'
2019-02-06 07:35:08 [DEBUG   ] Got command RPT from MCS: ref #1417354
2019-02-06 07:35:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 07:35:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417354  77 58520 27308145 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 07:35:08 [DEBUG   ] Got command RPT from MCS: ref #1417355
2019-02-06 07:35:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 07:35:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417355  12 58520 27308337 A  ERRORB‘™š'
2019-02-06 07:35:08 [WARNING ] (13, 1, 'bot')
2019-02-06 07:35:08 [WARNING ] (13, 1, 'bot')
2019-02-06 07:35:08 [WARNING ] (13, 1, 'bot')
2019-02-06 07:35:08 [WARNING ] (13, 1, 'bot')
2019-02-06 07:35:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:35:08 [DEBUG   ] Finished updating board flags in 1.597 seconds
2019-02-06 07:35:10 [DEBUG   ] Finished updating ant stats in 1.011 seconds
2019-02-06 07:35:30 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2019-02-06 07:35:50 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-06 07:36:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:36:10 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 07:36:10 [WARNING ] (13, 1, 'bot')
2019-02-06 07:36:10 [WARNING ] (13, 1, 'bot')
2019-02-06 07:36:10 [WARNING ] (13, 1, 'bot')
2019-02-06 07:36:10 [WARNING ] (13, 1, 'bot')
2019-02-06 07:36:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:36:10 [DEBUG   ] Finished updating board flags in 3.149 seconds
2019-02-06 07:36:12 [DEBUG   ] Got command RPT from MCS: ref #1417364
2019-02-06 07:36:12 [DEBUG   ] summary = ERROR
2019-02-06 07:36:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417364  13 58520 27372173 A  ERRORERROR'
2019-02-06 07:36:12 [DEBUG   ] Got command RPT from MCS: ref #1417365
2019-02-06 07:36:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 07:36:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417365  77 58520 27372174 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 07:36:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 07:36:50 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 07:37:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:37:08 [WARNING ] (13, 1, 'bot')
2019-02-06 07:37:08 [WARNING ] (13, 1, 'bot')
2019-02-06 07:37:08 [WARNING ] (13, 1, 'bot')
2019-02-06 07:37:08 [WARNING ] (13, 1, 'bot')
2019-02-06 07:37:08 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:37:08 [DEBUG   ] Finished updating board flags in 1.313 seconds
2019-02-06 07:37:10 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-02-06 07:37:30 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 07:37:51 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-02-06 07:38:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:38:09 [WARNING ] (13, 1, 'bot')
2019-02-06 07:38:09 [WARNING ] (13, 1, 'bot')
2019-02-06 07:38:09 [WARNING ] (13, 1, 'bot')
2019-02-06 07:38:09 [WARNING ] (13, 1, 'bot')
2019-02-06 07:38:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:38:09 [DEBUG   ] Finished updating board flags in 2.135 seconds
2019-02-06 07:38:10 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-02-06 07:38:31 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-02-06 07:38:51 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-02-06 07:39:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 07:39:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:39:09 [WARNING ] (13, 1, 'bot')
2019-02-06 07:39:09 [WARNING ] (13, 1, 'bot')
2019-02-06 07:39:09 [WARNING ] (13, 1, 'bot')
2019-02-06 07:39:09 [WARNING ] (13, 1, 'bot')
2019-02-06 07:39:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:39:09 [DEBUG   ] Finished updating board flags in 2.007 seconds
2019-02-06 07:39:11 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-02-06 07:39:31 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-02-06 07:39:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 07:40:07 [DEBUG   ] Got command RPT from MCS: ref #1417385
2019-02-06 07:40:07 [DEBUG   ] summary = ERROR
2019-02-06 07:40:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417385  13 58520 27607617 A  ERRORERROR'
2019-02-06 07:40:07 [DEBUG   ] Got command RPT from MCS: ref #1417386
2019-02-06 07:40:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 07:40:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417386  77 58520 27607821 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 07:40:08 [DEBUG   ] Got command RPT from MCS: ref #1417387
2019-02-06 07:40:08 [DEBUG   ] summary = ERROR
2019-02-06 07:40:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417387  13 58520 27608029 A  ERRORERROR'
2019-02-06 07:40:08 [DEBUG   ] Got command RPT from MCS: ref #1417388
2019-02-06 07:40:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 07:40:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417388  77 58520 27608222 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 07:40:08 [DEBUG   ] Got command RPT from MCS: ref #1417389
2019-02-06 07:40:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 07:40:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417389  12 58520 27608429 A  ERRORB�ÌÍ'
2019-02-06 07:40:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:40:09 [WARNING ] (13, 1, 'bot')
2019-02-06 07:40:09 [WARNING ] (13, 1, 'bot')
2019-02-06 07:40:09 [WARNING ] (13, 1, 'bot')
2019-02-06 07:40:09 [WARNING ] (13, 1, 'bot')
2019-02-06 07:40:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:40:09 [DEBUG   ] Finished updating board flags in 1.989 seconds
2019-02-06 07:40:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 07:40:31 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-02-06 07:40:51 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-06 07:41:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 07:41:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:41:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-02-06 07:41:09 [WARNING ] (13, 1, 'bot')
2019-02-06 07:41:09 [WARNING ] (13, 1, 'bot')
2019-02-06 07:41:09 [WARNING ] (13, 1, 'bot')
2019-02-06 07:41:09 [WARNING ] (13, 1, 'bot')
2019-02-06 07:41:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:41:09 [DEBUG   ] Finished updating board flags in 1.847 seconds
2019-02-06 07:41:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 07:41:12 [DEBUG   ] Got command RPT from MCS: ref #1417390
2019-02-06 07:41:12 [DEBUG   ] summary = ERROR
2019-02-06 07:41:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417390  13 58520 27672165 A  ERRORERROR'
2019-02-06 07:41:12 [DEBUG   ] Got command RPT from MCS: ref #1417391
2019-02-06 07:41:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 07:41:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417391  77 58520 27672166 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 07:41:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 07:41:51 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-02-06 07:42:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:42:09 [WARNING ] (13, 1, 'bot')
2019-02-06 07:42:09 [WARNING ] (13, 1, 'bot')
2019-02-06 07:42:09 [WARNING ] (13, 1, 'bot')
2019-02-06 07:42:09 [WARNING ] (13, 1, 'bot')
2019-02-06 07:42:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:42:09 [DEBUG   ] Finished updating board flags in 1.766 seconds
2019-02-06 07:42:11 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 07:42:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 07:42:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 07:43:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:43:09 [WARNING ] (13, 1, 'bot')
2019-02-06 07:43:09 [WARNING ] (13, 1, 'bot')
2019-02-06 07:43:09 [WARNING ] (13, 1, 'bot')
2019-02-06 07:43:09 [WARNING ] (13, 1, 'bot')
2019-02-06 07:43:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:43:09 [DEBUG   ] Finished updating board flags in 1.603 seconds
2019-02-06 07:43:11 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 07:43:31 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 07:43:52 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-02-06 07:44:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:44:09 [WARNING ] (13, 1, 'bot')
2019-02-06 07:44:09 [WARNING ] (13, 1, 'bot')
2019-02-06 07:44:09 [WARNING ] (13, 1, 'bot')
2019-02-06 07:44:09 [WARNING ] (13, 1, 'bot')
2019-02-06 07:44:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:44:09 [DEBUG   ] Finished updating board flags in 1.594 seconds
2019-02-06 07:44:12 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-02-06 07:44:32 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 07:44:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 07:45:07 [DEBUG   ] Got command RPT from MCS: ref #1417422
2019-02-06 07:45:07 [DEBUG   ] summary = ERROR
2019-02-06 07:45:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417422  13 58520 27907701 A  ERRORERROR'
2019-02-06 07:45:07 [DEBUG   ] Got command RPT from MCS: ref #1417423
2019-02-06 07:45:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 07:45:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417423  77 58520 27907905 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 07:45:08 [DEBUG   ] Got command RPT from MCS: ref #1417424
2019-02-06 07:45:08 [DEBUG   ] summary = ERROR
2019-02-06 07:45:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417424  13 58520 27908109 A  ERRORERROR'
2019-02-06 07:45:08 [DEBUG   ] Got command RPT from MCS: ref #1417426
2019-02-06 07:45:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 07:45:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417426  77 58520 27908301 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 07:45:08 [DEBUG   ] Got command RPT from MCS: ref #1417427
2019-02-06 07:45:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 07:45:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417427  12 58520 27908509 A  ERRORB„ÌÍ'
2019-02-06 07:45:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:45:09 [WARNING ] (13, 1, 'bot')
2019-02-06 07:45:09 [WARNING ] (13, 1, 'bot')
2019-02-06 07:45:09 [WARNING ] (13, 1, 'bot')
2019-02-06 07:45:09 [WARNING ] (13, 1, 'bot')
2019-02-06 07:45:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:45:09 [DEBUG   ] Finished updating board flags in 1.420 seconds
2019-02-06 07:45:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 07:45:32 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-02-06 07:45:52 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-06 07:46:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:46:09 [WARNING ] (13, 1, 'bot')
2019-02-06 07:46:09 [WARNING ] (13, 1, 'bot')
2019-02-06 07:46:09 [WARNING ] (13, 1, 'bot')
2019-02-06 07:46:09 [WARNING ] (13, 1, 'bot')
2019-02-06 07:46:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:46:09 [DEBUG   ] Finished updating board flags in 1.391 seconds
2019-02-06 07:46:12 [DEBUG   ] Got command RPT from MCS: ref #1417436
2019-02-06 07:46:12 [DEBUG   ] summary = ERROR
2019-02-06 07:46:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417436  13 58520 27972177 A  ERRORERROR'
2019-02-06 07:46:12 [DEBUG   ] Got command RPT from MCS: ref #1417437
2019-02-06 07:46:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 07:46:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417437  77 58520 27972178 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 07:46:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 07:46:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 07:46:52 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-02-06 07:47:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:47:09 [WARNING ] (13, 1, 'bot')
2019-02-06 07:47:09 [WARNING ] (13, 1, 'bot')
2019-02-06 07:47:09 [WARNING ] (13, 1, 'bot')
2019-02-06 07:47:09 [WARNING ] (13, 1, 'bot')
2019-02-06 07:47:09 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:47:09 [DEBUG   ] Finished updating board flags in 1.387 seconds
2019-02-06 07:47:12 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 07:47:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 07:47:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 07:48:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:48:10 [WARNING ] (13, 1, 'bot')
2019-02-06 07:48:10 [WARNING ] (13, 1, 'bot')
2019-02-06 07:48:10 [WARNING ] (13, 1, 'bot')
2019-02-06 07:48:10 [WARNING ] (13, 1, 'bot')
2019-02-06 07:48:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:48:10 [DEBUG   ] Finished updating board flags in 2.033 seconds
2019-02-06 07:48:12 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 07:48:32 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2019-02-06 07:48:53 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-02-06 07:49:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:49:10 [WARNING ] (13, 1, 'bot')
2019-02-06 07:49:10 [WARNING ] (13, 1, 'bot')
2019-02-06 07:49:10 [WARNING ] (13, 1, 'bot')
2019-02-06 07:49:10 [WARNING ] (13, 1, 'bot')
2019-02-06 07:49:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:49:10 [DEBUG   ] Finished updating board flags in 1.986 seconds
2019-02-06 07:49:13 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-02-06 07:49:33 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-02-06 07:49:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 07:50:07 [DEBUG   ] Got command RPT from MCS: ref #1417458
2019-02-06 07:50:07 [DEBUG   ] summary = ERROR
2019-02-06 07:50:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417458  13 58520 28207781 A  ERRORERROR'
2019-02-06 07:50:07 [DEBUG   ] Got command RPT from MCS: ref #1417459
2019-02-06 07:50:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 07:50:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417459  77 58520 28207985 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 07:50:08 [DEBUG   ] Got command RPT from MCS: ref #1417460
2019-02-06 07:50:08 [DEBUG   ] summary = ERROR
2019-02-06 07:50:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417460  13 58520 28208189 A  ERRORERROR'
2019-02-06 07:50:08 [DEBUG   ] Got command RPT from MCS: ref #1417461
2019-02-06 07:50:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 07:50:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417461  77 58520 28208381 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 07:50:08 [DEBUG   ] Got command RPT from MCS: ref #1417462
2019-02-06 07:50:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 07:50:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417462  12 58520 28208589 A  ERRORB—™š'
2019-02-06 07:50:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:50:10 [WARNING ] (13, 1, 'bot')
2019-02-06 07:50:10 [WARNING ] (13, 1, 'bot')
2019-02-06 07:50:10 [WARNING ] (13, 1, 'bot')
2019-02-06 07:50:10 [WARNING ] (13, 1, 'bot')
2019-02-06 07:50:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:50:10 [DEBUG   ] Finished updating board flags in 1.799 seconds
2019-02-06 07:50:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 07:50:33 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-06 07:50:53 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-06 07:51:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:51:10 [WARNING ] (13, 1, 'bot')
2019-02-06 07:51:10 [WARNING ] (13, 1, 'bot')
2019-02-06 07:51:10 [WARNING ] (13, 1, 'bot')
2019-02-06 07:51:10 [WARNING ] (13, 1, 'bot')
2019-02-06 07:51:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:51:10 [DEBUG   ] Finished updating board flags in 1.630 seconds
2019-02-06 07:51:12 [DEBUG   ] Got command RPT from MCS: ref #1417467
2019-02-06 07:51:12 [DEBUG   ] summary = ERROR
2019-02-06 07:51:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417467  13 58520 28272173 A  ERRORERROR'
2019-02-06 07:51:12 [DEBUG   ] Got command RPT from MCS: ref #1417468
2019-02-06 07:51:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 07:51:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417468  77 58520 28272174 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 07:51:13 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-06 07:51:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 07:51:53 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-02-06 07:52:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:52:10 [WARNING ] (13, 1, 'bot')
2019-02-06 07:52:10 [WARNING ] (13, 1, 'bot')
2019-02-06 07:52:10 [WARNING ] (13, 1, 'bot')
2019-02-06 07:52:10 [WARNING ] (13, 1, 'bot')
2019-02-06 07:52:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:52:10 [DEBUG   ] Finished updating board flags in 1.568 seconds
2019-02-06 07:52:13 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 07:52:33 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-06 07:52:53 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-06 07:53:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:53:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-02-06 07:53:10 [WARNING ] (13, 1, 'bot')
2019-02-06 07:53:10 [WARNING ] (13, 1, 'bot')
2019-02-06 07:53:10 [WARNING ] (13, 1, 'bot')
2019-02-06 07:53:10 [WARNING ] (13, 1, 'bot')
2019-02-06 07:53:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:53:10 [DEBUG   ] Finished updating board flags in 1.426 seconds
2019-02-06 07:53:14 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-02-06 07:53:34 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-02-06 07:53:54 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 07:54:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:54:10 [WARNING ] (13, 1, 'bot')
2019-02-06 07:54:10 [WARNING ] (13, 1, 'bot')
2019-02-06 07:54:10 [WARNING ] (13, 1, 'bot')
2019-02-06 07:54:10 [WARNING ] (13, 1, 'bot')
2019-02-06 07:54:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:54:10 [DEBUG   ] Finished updating board flags in 1.377 seconds
2019-02-06 07:54:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-06 07:54:34 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-02-06 07:54:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 07:55:07 [DEBUG   ] Got command RPT from MCS: ref #1417490
2019-02-06 07:55:07 [DEBUG   ] summary = ERROR
2019-02-06 07:55:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417490  13 58520 28507869 A  ERRORERROR'
2019-02-06 07:55:08 [DEBUG   ] Got command RPT from MCS: ref #1417491
2019-02-06 07:55:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 07:55:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417491  77 58520 28508061 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 07:55:08 [DEBUG   ] Got command RPT from MCS: ref #1417492
2019-02-06 07:55:08 [DEBUG   ] summary = ERROR
2019-02-06 07:55:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417492  13 58520 28508265 A  ERRORERROR'
2019-02-06 07:55:08 [DEBUG   ] Got command RPT from MCS: ref #1417494
2019-02-06 07:55:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 07:55:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417494  77 58520 28508469 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 07:55:08 [DEBUG   ] Got command RPT from MCS: ref #1417496
2019-02-06 07:55:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 07:55:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417496  12 58520 28508661 A  ERRORB–™š'
2019-02-06 07:55:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:55:10 [WARNING ] (13, 1, 'bot')
2019-02-06 07:55:10 [WARNING ] (13, 1, 'bot')
2019-02-06 07:55:10 [WARNING ] (13, 1, 'bot')
2019-02-06 07:55:10 [WARNING ] (13, 1, 'bot')
2019-02-06 07:55:10 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:55:10 [DEBUG   ] Finished updating board flags in 1.366 seconds
2019-02-06 07:55:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 07:55:34 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-02-06 07:55:54 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-06 07:56:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:56:11 [WARNING ] (13, 1, 'bot')
2019-02-06 07:56:11 [WARNING ] (13, 1, 'bot')
2019-02-06 07:56:11 [WARNING ] (13, 1, 'bot')
2019-02-06 07:56:11 [WARNING ] (13, 1, 'bot')
2019-02-06 07:56:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:56:11 [DEBUG   ] Finished updating board flags in 2.061 seconds
2019-02-06 07:56:12 [DEBUG   ] Got command RPT from MCS: ref #1417500
2019-02-06 07:56:12 [DEBUG   ] summary = ERROR
2019-02-06 07:56:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417500  13 58520 28572177 A  ERRORERROR'
2019-02-06 07:56:12 [DEBUG   ] Got command RPT from MCS: ref #1417501
2019-02-06 07:56:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 07:56:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417501  77 58520 28572178 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 07:56:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 07:56:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 07:56:54 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-06 07:57:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:57:11 [WARNING ] (13, 1, 'bot')
2019-02-06 07:57:11 [WARNING ] (13, 1, 'bot')
2019-02-06 07:57:11 [WARNING ] (13, 1, 'bot')
2019-02-06 07:57:11 [WARNING ] (13, 1, 'bot')
2019-02-06 07:57:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:57:11 [DEBUG   ] Finished updating board flags in 1.983 seconds
2019-02-06 07:57:14 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2019-02-06 07:57:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 07:57:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 07:58:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:58:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-06 07:58:11 [WARNING ] (13, 1, 'bot')
2019-02-06 07:58:11 [WARNING ] (13, 1, 'bot')
2019-02-06 07:58:11 [WARNING ] (13, 1, 'bot')
2019-02-06 07:58:11 [WARNING ] (13, 1, 'bot')
2019-02-06 07:58:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:58:11 [DEBUG   ] Finished updating board flags in 1.822 seconds
2019-02-06 07:58:14 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-02-06 07:58:34 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 07:58:54 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-06 07:59:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 07:59:11 [WARNING ] (13, 1, 'bot')
2019-02-06 07:59:11 [WARNING ] (13, 1, 'bot')
2019-02-06 07:59:11 [WARNING ] (13, 1, 'bot')
2019-02-06 07:59:11 [WARNING ] (13, 1, 'bot')
2019-02-06 07:59:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 07:59:11 [DEBUG   ] Finished updating board flags in 1.782 seconds
2019-02-06 07:59:15 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-02-06 07:59:35 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-06 07:59:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 08:00:07 [DEBUG   ] Got command RPT from MCS: ref #1417525
2019-02-06 08:00:07 [DEBUG   ] summary = ERROR
2019-02-06 08:00:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417525  13 58520 28807941 A  ERRORERROR'
2019-02-06 08:00:08 [DEBUG   ] Got command RPT from MCS: ref #1417526
2019-02-06 08:00:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 08:00:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417526  77 58520 28808145 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 08:00:08 [DEBUG   ] Got command RPT from MCS: ref #1417527
2019-02-06 08:00:08 [DEBUG   ] summary = ERROR
2019-02-06 08:00:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417527  13 58520 28808349 A  ERRORERROR'
2019-02-06 08:00:08 [DEBUG   ] Got command RPT from MCS: ref #1417528
2019-02-06 08:00:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 08:00:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417528  77 58520 28808541 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 08:00:08 [DEBUG   ] Got command RPT from MCS: ref #1417529
2019-02-06 08:00:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 08:00:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417529  12 58520 28808745 A  ERRORB˜™š'
2019-02-06 08:00:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:00:11 [WARNING ] (13, 1, 'bot')
2019-02-06 08:00:11 [WARNING ] (13, 1, 'bot')
2019-02-06 08:00:11 [WARNING ] (13, 1, 'bot')
2019-02-06 08:00:11 [WARNING ] (13, 1, 'bot')
2019-02-06 08:00:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:00:11 [DEBUG   ] Finished updating board flags in 1.616 seconds
2019-02-06 08:00:15 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-02-06 08:00:35 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 08:00:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 08:01:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:01:11 [WARNING ] (13, 1, 'bot')
2019-02-06 08:01:11 [WARNING ] (13, 1, 'bot')
2019-02-06 08:01:11 [WARNING ] (13, 1, 'bot')
2019-02-06 08:01:11 [WARNING ] (13, 1, 'bot')
2019-02-06 08:01:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:01:11 [DEBUG   ] Finished updating board flags in 1.604 seconds
2019-02-06 08:01:12 [DEBUG   ] Got command RPT from MCS: ref #1417530
2019-02-06 08:01:12 [DEBUG   ] summary = ERROR
2019-02-06 08:01:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417530  13 58520 28872173 A  ERRORERROR'
2019-02-06 08:01:12 [DEBUG   ] Got command RPT from MCS: ref #1417531
2019-02-06 08:01:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 08:01:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417531  77 58520 28872174 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 08:01:15 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-06 08:01:35 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-02-06 08:01:55 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 08:02:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:02:11 [WARNING ] (13, 1, 'bot')
2019-02-06 08:02:11 [WARNING ] (13, 1, 'bot')
2019-02-06 08:02:11 [WARNING ] (13, 1, 'bot')
2019-02-06 08:02:11 [WARNING ] (13, 1, 'bot')
2019-02-06 08:02:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:02:11 [DEBUG   ] Finished updating board flags in 1.587 seconds
2019-02-06 08:02:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 08:02:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 08:02:55 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-02-06 08:03:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:03:11 [WARNING ] (13, 1, 'bot')
2019-02-06 08:03:11 [WARNING ] (13, 1, 'bot')
2019-02-06 08:03:11 [WARNING ] (13, 1, 'bot')
2019-02-06 08:03:11 [WARNING ] (13, 1, 'bot')
2019-02-06 08:03:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:03:11 [DEBUG   ] Finished updating board flags in 1.417 seconds
2019-02-06 08:03:15 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 08:03:35 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-06 08:03:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-06 08:04:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:04:11 [WARNING ] (13, 1, 'bot')
2019-02-06 08:04:11 [WARNING ] (13, 1, 'bot')
2019-02-06 08:04:11 [WARNING ] (13, 1, 'bot')
2019-02-06 08:04:11 [WARNING ] (13, 1, 'bot')
2019-02-06 08:04:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:04:11 [DEBUG   ] Finished updating board flags in 1.393 seconds
2019-02-06 08:04:16 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-02-06 08:04:36 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-06 08:04:56 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 08:05:08 [DEBUG   ] Got command RPT from MCS: ref #1417553
2019-02-06 08:05:08 [DEBUG   ] summary = ERROR
2019-02-06 08:05:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417553  13 58520 29108021 A  ERRORERROR'
2019-02-06 08:05:08 [DEBUG   ] Got command RPT from MCS: ref #1417554
2019-02-06 08:05:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 08:05:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417554  77 58520 29108225 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 08:05:08 [DEBUG   ] Got command RPT from MCS: ref #1417555
2019-02-06 08:05:08 [DEBUG   ] summary = ERROR
2019-02-06 08:05:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417555  13 58520 29108417 A  ERRORERROR'
2019-02-06 08:05:08 [DEBUG   ] Got command RPT from MCS: ref #1417557
2019-02-06 08:05:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 08:05:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417557  77 58520 29108621 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 08:05:08 [DEBUG   ] Got command RPT from MCS: ref #1417558
2019-02-06 08:05:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 08:05:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417558  12 58520 29108825 A  ERRORB—™š'
2019-02-06 08:05:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:05:11 [WARNING ] (13, 1, 'bot')
2019-02-06 08:05:11 [WARNING ] (13, 1, 'bot')
2019-02-06 08:05:11 [WARNING ] (13, 1, 'bot')
2019-02-06 08:05:11 [WARNING ] (13, 1, 'bot')
2019-02-06 08:05:11 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:05:11 [DEBUG   ] Finished updating board flags in 1.352 seconds
2019-02-06 08:05:16 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 08:05:36 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 08:05:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 08:06:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:06:12 [DEBUG   ] Got command RPT from MCS: ref #1417567
2019-02-06 08:06:12 [DEBUG   ] summary = ERROR
2019-02-06 08:06:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417567  13 58520 29172178 A  ERRORERROR'
2019-02-06 08:06:12 [DEBUG   ] Got command RPT from MCS: ref #1417568
2019-02-06 08:06:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 08:06:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417568  77 58520 29172178 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 08:06:12 [WARNING ] (13, 1, 'bot')
2019-02-06 08:06:12 [WARNING ] (13, 1, 'bot')
2019-02-06 08:06:12 [WARNING ] (13, 1, 'bot')
2019-02-06 08:06:12 [WARNING ] (13, 1, 'bot')
2019-02-06 08:06:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:06:12 [DEBUG   ] Finished updating board flags in 2.077 seconds
2019-02-06 08:06:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 08:06:36 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-02-06 08:06:56 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-06 08:07:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:07:12 [WARNING ] (13, 1, 'bot')
2019-02-06 08:07:12 [WARNING ] (13, 1, 'bot')
2019-02-06 08:07:12 [WARNING ] (13, 1, 'bot')
2019-02-06 08:07:12 [WARNING ] (13, 1, 'bot')
2019-02-06 08:07:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:07:12 [DEBUG   ] Finished updating board flags in 1.990 seconds
2019-02-06 08:07:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 08:07:36 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-06 08:07:56 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-02-06 08:08:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:08:12 [WARNING ] (13, 1, 'bot')
2019-02-06 08:08:12 [WARNING ] (13, 1, 'bot')
2019-02-06 08:08:12 [WARNING ] (13, 1, 'bot')
2019-02-06 08:08:12 [WARNING ] (13, 1, 'bot')
2019-02-06 08:08:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:08:12 [DEBUG   ] Finished updating board flags in 1.790 seconds
2019-02-06 08:08:16 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 08:08:36 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-06 08:08:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-06 08:09:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:09:12 [WARNING ] (13, 1, 'bot')
2019-02-06 08:09:12 [WARNING ] (13, 1, 'bot')
2019-02-06 08:09:12 [WARNING ] (13, 1, 'bot')
2019-02-06 08:09:12 [WARNING ] (13, 1, 'bot')
2019-02-06 08:09:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:09:12 [DEBUG   ] Finished updating board flags in 1.629 seconds
2019-02-06 08:09:17 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-02-06 08:09:37 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-06 08:09:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 08:10:08 [DEBUG   ] Got command RPT from MCS: ref #1417588
2019-02-06 08:10:08 [DEBUG   ] summary = ERROR
2019-02-06 08:10:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417588  13 58520 29408105 A  ERRORERROR'
2019-02-06 08:10:08 [DEBUG   ] Got command RPT from MCS: ref #1417589
2019-02-06 08:10:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 08:10:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417589  77 58520 29408297 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 08:10:08 [DEBUG   ] Got command RPT from MCS: ref #1417590
2019-02-06 08:10:08 [DEBUG   ] summary = ERROR
2019-02-06 08:10:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417590  13 58520 29408501 A  ERRORERROR'
2019-02-06 08:10:08 [DEBUG   ] Got command RPT from MCS: ref #1417591
2019-02-06 08:10:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 08:10:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417591  77 58520 29408705 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 08:10:08 [DEBUG   ] Got command RPT from MCS: ref #1417592
2019-02-06 08:10:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 08:10:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417592  12 58520 29408909 A  ERRORB–™š'
2019-02-06 08:10:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:10:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-02-06 08:10:12 [WARNING ] (13, 1, 'bot')
2019-02-06 08:10:12 [WARNING ] (13, 1, 'bot')
2019-02-06 08:10:12 [WARNING ] (13, 1, 'bot')
2019-02-06 08:10:12 [WARNING ] (13, 1, 'bot')
2019-02-06 08:10:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:10:12 [DEBUG   ] Finished updating board flags in 1.600 seconds
2019-02-06 08:10:17 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-06 08:10:37 [DEBUG   ] Finished updating ant stats in 1.176 seconds
2019-02-06 08:10:57 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-02-06 08:11:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:11:12 [DEBUG   ] Got command RPT from MCS: ref #1417593
2019-02-06 08:11:12 [DEBUG   ] summary = ERROR
2019-02-06 08:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417593  13 58520 29472174 A  ERRORERROR'
2019-02-06 08:11:12 [DEBUG   ] Got command RPT from MCS: ref #1417594
2019-02-06 08:11:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 08:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417594  77 58520 29472174 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 08:11:12 [WARNING ] (13, 1, 'bot')
2019-02-06 08:11:12 [WARNING ] (13, 1, 'bot')
2019-02-06 08:11:12 [WARNING ] (13, 1, 'bot')
2019-02-06 08:11:12 [WARNING ] (13, 1, 'bot')
2019-02-06 08:11:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:11:12 [DEBUG   ] Finished updating board flags in 1.590 seconds
2019-02-06 08:11:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 08:11:37 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 08:11:57 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 08:12:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 08:12:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:12:12 [WARNING ] (13, 1, 'bot')
2019-02-06 08:12:12 [WARNING ] (13, 1, 'bot')
2019-02-06 08:12:12 [WARNING ] (13, 1, 'bot')
2019-02-06 08:12:12 [WARNING ] (13, 1, 'bot')
2019-02-06 08:12:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:12:12 [DEBUG   ] Finished updating board flags in 1.434 seconds
2019-02-06 08:12:17 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-06 08:12:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 08:12:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 08:13:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:13:12 [WARNING ] (13, 1, 'bot')
2019-02-06 08:13:12 [WARNING ] (13, 1, 'bot')
2019-02-06 08:13:12 [WARNING ] (13, 1, 'bot')
2019-02-06 08:13:12 [WARNING ] (13, 1, 'bot')
2019-02-06 08:13:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:13:12 [DEBUG   ] Finished updating board flags in 1.353 seconds
2019-02-06 08:13:17 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2019-02-06 08:13:38 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-02-06 08:13:58 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-02-06 08:14:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:14:12 [WARNING ] (13, 1, 'bot')
2019-02-06 08:14:12 [WARNING ] (13, 1, 'bot')
2019-02-06 08:14:12 [WARNING ] (13, 1, 'bot')
2019-02-06 08:14:12 [WARNING ] (13, 1, 'bot')
2019-02-06 08:14:12 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:14:12 [DEBUG   ] Finished updating board flags in 1.372 seconds
2019-02-06 08:14:18 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-02-06 08:14:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 08:14:58 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 08:15:08 [DEBUG   ] Got command RPT from MCS: ref #1417620
2019-02-06 08:15:08 [DEBUG   ] summary = ERROR
2019-02-06 08:15:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417620  13 58520 29708185 A  ERRORERROR'
2019-02-06 08:15:08 [DEBUG   ] Got command RPT from MCS: ref #1417621
2019-02-06 08:15:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 08:15:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417621  77 58520 29708377 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 08:15:08 [DEBUG   ] Got command RPT from MCS: ref #1417622
2019-02-06 08:15:08 [DEBUG   ] summary = ERROR
2019-02-06 08:15:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417622  13 58520 29708581 A  ERRORERROR'
2019-02-06 08:15:08 [DEBUG   ] Got command RPT from MCS: ref #1417624
2019-02-06 08:15:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 08:15:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417624  77 58520 29708785 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 08:15:08 [DEBUG   ] Got command RPT from MCS: ref #1417626
2019-02-06 08:15:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 08:15:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417626  12 58520 29708989 A  ERRORB—™š'
2019-02-06 08:15:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:15:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-06 08:15:13 [WARNING ] (13, 1, 'bot')
2019-02-06 08:15:13 [WARNING ] (13, 1, 'bot')
2019-02-06 08:15:13 [WARNING ] (13, 1, 'bot')
2019-02-06 08:15:13 [WARNING ] (13, 1, 'bot')
2019-02-06 08:15:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:15:13 [DEBUG   ] Finished updating board flags in 2.034 seconds
2019-02-06 08:15:18 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-06 08:15:38 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-02-06 08:15:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 08:16:12 [DEBUG   ] Got command RPT from MCS: ref #1417630
2019-02-06 08:16:12 [DEBUG   ] summary = ERROR
2019-02-06 08:16:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417630  13 58520 29772181 A  ERRORERROR'
2019-02-06 08:16:12 [DEBUG   ] Got command RPT from MCS: ref #1417631
2019-02-06 08:16:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 08:16:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417631  77 58520 29772182 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 08:16:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:16:13 [WARNING ] (13, 1, 'bot')
2019-02-06 08:16:13 [WARNING ] (13, 1, 'bot')
2019-02-06 08:16:13 [WARNING ] (13, 1, 'bot')
2019-02-06 08:16:13 [WARNING ] (13, 1, 'bot')
2019-02-06 08:16:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:16:13 [DEBUG   ] Finished updating board flags in 1.989 seconds
2019-02-06 08:16:18 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 08:16:38 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-02-06 08:16:58 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 08:17:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:17:13 [WARNING ] (13, 1, 'bot')
2019-02-06 08:17:13 [WARNING ] (13, 1, 'bot')
2019-02-06 08:17:13 [WARNING ] (13, 1, 'bot')
2019-02-06 08:17:13 [WARNING ] (13, 1, 'bot')
2019-02-06 08:17:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:17:13 [DEBUG   ] Finished updating board flags in 1.834 seconds
2019-02-06 08:17:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 08:17:38 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 08:17:58 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-02-06 08:18:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:18:13 [WARNING ] (13, 1, 'bot')
2019-02-06 08:18:13 [WARNING ] (13, 1, 'bot')
2019-02-06 08:18:13 [WARNING ] (13, 1, 'bot')
2019-02-06 08:18:13 [WARNING ] (13, 1, 'bot')
2019-02-06 08:18:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:18:13 [DEBUG   ] Finished updating board flags in 1.806 seconds
2019-02-06 08:18:18 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-02-06 08:18:39 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-02-06 08:18:58 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-02-06 08:19:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:19:13 [WARNING ] (13, 1, 'bot')
2019-02-06 08:19:13 [WARNING ] (13, 1, 'bot')
2019-02-06 08:19:13 [WARNING ] (13, 1, 'bot')
2019-02-06 08:19:13 [WARNING ] (13, 1, 'bot')
2019-02-06 08:19:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:19:13 [DEBUG   ] Finished updating board flags in 1.809 seconds
2019-02-06 08:19:18 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2019-02-06 08:19:39 [DEBUG   ] Finished updating ant stats in 1.390 seconds
2019-02-06 08:19:59 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-02-06 08:20:08 [DEBUG   ] Got command RPT from MCS: ref #1417651
2019-02-06 08:20:08 [DEBUG   ] summary = ERROR
2019-02-06 08:20:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417651  13 58520 30008261 A  ERRORERROR'
2019-02-06 08:20:08 [DEBUG   ] Got command RPT from MCS: ref #1417652
2019-02-06 08:20:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 08:20:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417652  77 58520 30008465 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 08:20:08 [DEBUG   ] Got command RPT from MCS: ref #1417653
2019-02-06 08:20:08 [DEBUG   ] summary = ERROR
2019-02-06 08:20:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417653  13 58520 30008669 A  ERRORERROR'
2019-02-06 08:20:08 [DEBUG   ] Got command RPT from MCS: ref #1417654
2019-02-06 08:20:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 08:20:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417654  77 58520 30008861 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 08:20:09 [DEBUG   ] Got command RPT from MCS: ref #1417655
2019-02-06 08:20:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 08:20:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417655  12 58520 30009065 A  ERRORB—™š'
2019-02-06 08:20:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 08:20:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:20:13 [WARNING ] (13, 1, 'bot')
2019-02-06 08:20:13 [WARNING ] (13, 1, 'bot')
2019-02-06 08:20:13 [WARNING ] (13, 1, 'bot')
2019-02-06 08:20:13 [WARNING ] (13, 1, 'bot')
2019-02-06 08:20:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:20:13 [DEBUG   ] Finished updating board flags in 1.772 seconds
2019-02-06 08:20:19 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 08:20:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 08:20:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 08:21:12 [DEBUG   ] Got command RPT from MCS: ref #1417660
2019-02-06 08:21:12 [DEBUG   ] summary = ERROR
2019-02-06 08:21:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417660  13 58520 30072181 A  ERRORERROR'
2019-02-06 08:21:12 [DEBUG   ] Got command RPT from MCS: ref #1417661
2019-02-06 08:21:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 08:21:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417661  77 58520 30072182 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 08:21:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:21:13 [WARNING ] (13, 1, 'bot')
2019-02-06 08:21:13 [WARNING ] (13, 1, 'bot')
2019-02-06 08:21:13 [WARNING ] (13, 1, 'bot')
2019-02-06 08:21:13 [WARNING ] (13, 1, 'bot')
2019-02-06 08:21:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:21:13 [DEBUG   ] Finished updating board flags in 1.622 seconds
2019-02-06 08:21:19 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 08:21:39 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-02-06 08:21:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 08:22:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:22:13 [WARNING ] (13, 1, 'bot')
2019-02-06 08:22:13 [WARNING ] (13, 1, 'bot')
2019-02-06 08:22:13 [WARNING ] (13, 1, 'bot')
2019-02-06 08:22:13 [WARNING ] (13, 1, 'bot')
2019-02-06 08:22:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:22:13 [DEBUG   ] Finished updating board flags in 1.608 seconds
2019-02-06 08:22:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 08:22:39 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 08:22:59 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 08:23:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:23:13 [WARNING ] (13, 1, 'bot')
2019-02-06 08:23:13 [WARNING ] (13, 1, 'bot')
2019-02-06 08:23:13 [WARNING ] (13, 1, 'bot')
2019-02-06 08:23:13 [WARNING ] (13, 1, 'bot')
2019-02-06 08:23:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:23:13 [DEBUG   ] Finished updating board flags in 1.570 seconds
2019-02-06 08:23:19 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-06 08:23:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 08:23:59 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 08:24:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 4
2019-02-06 08:24:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:24:13 [WARNING ] (13, 1, 'bot')
2019-02-06 08:24:13 [WARNING ] (13, 1, 'bot')
2019-02-06 08:24:13 [WARNING ] (13, 1, 'bot')
2019-02-06 08:24:13 [WARNING ] (13, 1, 'bot')
2019-02-06 08:24:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:24:13 [DEBUG   ] Finished updating board flags in 1.424 seconds
2019-02-06 08:24:19 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 08:24:40 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-02-06 08:25:00 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-02-06 08:25:08 [DEBUG   ] Got command RPT from MCS: ref #1417683
2019-02-06 08:25:08 [DEBUG   ] summary = ERROR
2019-02-06 08:25:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417683  13 58520 30308349 A  ERRORERROR'
2019-02-06 08:25:08 [DEBUG   ] Got command RPT from MCS: ref #1417684
2019-02-06 08:25:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 08:25:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417684  77 58520 30308541 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 08:25:08 [DEBUG   ] Got command RPT from MCS: ref #1417685
2019-02-06 08:25:08 [DEBUG   ] summary = ERROR
2019-02-06 08:25:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417685  13 58520 30308745 A  ERRORERROR'
2019-02-06 08:25:08 [DEBUG   ] Got command RPT from MCS: ref #1417687
2019-02-06 08:25:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 08:25:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417687  77 58520 30308949 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 08:25:09 [DEBUG   ] Got command RPT from MCS: ref #1417688
2019-02-06 08:25:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 08:25:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417688  12 58520 30309153 A  ERRORB–™š'
2019-02-06 08:25:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:25:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:25:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:25:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:25:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:25:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:25:14 [DEBUG   ] Finished updating board flags in 2.407 seconds
2019-02-06 08:25:20 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 08:25:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 08:26:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 08:26:12 [DEBUG   ] Got command RPT from MCS: ref #1417693
2019-02-06 08:26:12 [DEBUG   ] summary = ERROR
2019-02-06 08:26:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417693  13 58520 30372181 A  ERRORERROR'
2019-02-06 08:26:12 [DEBUG   ] Got command RPT from MCS: ref #1417694
2019-02-06 08:26:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 08:26:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417694  77 58520 30372182 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 08:26:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 08:26:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:26:13 [WARNING ] (13, 1, 'bot')
2019-02-06 08:26:13 [WARNING ] (13, 1, 'bot')
2019-02-06 08:26:13 [WARNING ] (13, 1, 'bot')
2019-02-06 08:26:13 [WARNING ] (13, 1, 'bot')
2019-02-06 08:26:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:26:13 [DEBUG   ] Finished updating board flags in 1.369 seconds
2019-02-06 08:26:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 08:26:40 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-06 08:27:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 08:27:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:27:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-02-06 08:27:13 [WARNING ] (13, 1, 'bot')
2019-02-06 08:27:13 [WARNING ] (13, 1, 'bot')
2019-02-06 08:27:13 [WARNING ] (13, 1, 'bot')
2019-02-06 08:27:13 [WARNING ] (13, 1, 'bot')
2019-02-06 08:27:13 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:27:13 [DEBUG   ] Finished updating board flags in 1.354 seconds
2019-02-06 08:27:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 08:27:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 08:28:00 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 08:28:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:28:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:28:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:28:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:28:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:28:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:28:14 [DEBUG   ] Finished updating board flags in 2.072 seconds
2019-02-06 08:28:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 08:28:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 08:29:00 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 08:29:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:29:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-06 08:29:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:29:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:29:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:29:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:29:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:29:14 [DEBUG   ] Finished updating board flags in 2.013 seconds
2019-02-06 08:29:20 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 08:29:40 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-06 08:30:01 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-02-06 08:30:08 [DEBUG   ] Got command RPT from MCS: ref #1417718
2019-02-06 08:30:08 [DEBUG   ] summary = ERROR
2019-02-06 08:30:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417718  13 58520 30608421 A  ERRORERROR'
2019-02-06 08:30:08 [DEBUG   ] Got command RPT from MCS: ref #1417719
2019-02-06 08:30:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 08:30:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417719  77 58520 30608625 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 08:30:08 [DEBUG   ] Got command RPT from MCS: ref #1417720
2019-02-06 08:30:08 [DEBUG   ] summary = ERROR
2019-02-06 08:30:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417720  13 58520 30608829 A  ERRORERROR'
2019-02-06 08:30:09 [DEBUG   ] Got command RPT from MCS: ref #1417721
2019-02-06 08:30:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 08:30:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417721  77 58520 30609033 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 08:30:09 [DEBUG   ] Got command RPT from MCS: ref #1417722
2019-02-06 08:30:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 08:30:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417722  12 58520 30609225 A  ERRORB˜™š'
2019-02-06 08:30:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:30:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:30:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:30:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:30:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:30:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:30:14 [DEBUG   ] Finished updating board flags in 1.980 seconds
2019-02-06 08:30:21 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-02-06 08:30:41 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-06 08:31:01 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-02-06 08:31:12 [DEBUG   ] Got command RPT from MCS: ref #1417723
2019-02-06 08:31:12 [DEBUG   ] summary = ERROR
2019-02-06 08:31:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417723  13 58520 30672185 A  ERRORERROR'
2019-02-06 08:31:12 [DEBUG   ] Got command RPT from MCS: ref #1417724
2019-02-06 08:31:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 08:31:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417724  77 58520 30672186 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 08:31:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:31:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:31:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:31:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:31:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:31:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:31:14 [DEBUG   ] Finished updating board flags in 1.810 seconds
2019-02-06 08:31:21 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-06 08:31:41 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 08:32:01 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 08:32:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:32:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:32:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:32:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:32:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:32:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:32:14 [DEBUG   ] Finished updating board flags in 1.791 seconds
2019-02-06 08:32:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 08:32:41 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 08:33:01 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-06 08:33:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:33:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:33:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:33:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:33:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:33:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:33:14 [DEBUG   ] Finished updating board flags in 1.611 seconds
2019-02-06 08:33:21 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-06 08:33:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 08:34:01 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-02-06 08:34:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:34:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-06 08:34:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:34:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:34:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:34:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:34:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:34:14 [DEBUG   ] Finished updating board flags in 1.605 seconds
2019-02-06 08:34:21 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 08:34:42 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-02-06 08:35:02 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-02-06 08:35:08 [DEBUG   ] Got command RPT from MCS: ref #1417746
2019-02-06 08:35:08 [DEBUG   ] summary = ERROR
2019-02-06 08:35:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417746  13 58520 30908501 A  ERRORERROR'
2019-02-06 08:35:08 [DEBUG   ] Got command RPT from MCS: ref #1417747
2019-02-06 08:35:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 08:35:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417747  77 58520 30908705 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 08:35:08 [DEBUG   ] Got command RPT from MCS: ref #1417748
2019-02-06 08:35:08 [DEBUG   ] summary = ERROR
2019-02-06 08:35:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417748  13 58520 30908909 A  ERRORERROR'
2019-02-06 08:35:09 [DEBUG   ] Got command RPT from MCS: ref #1417750
2019-02-06 08:35:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 08:35:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417750  77 58520 30909113 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 08:35:09 [DEBUG   ] Got command RPT from MCS: ref #1417752
2019-02-06 08:35:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 08:35:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417752  12 58520 30909305 A  ERRORB—™š'
2019-02-06 08:35:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:35:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:35:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:35:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:35:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:35:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:35:14 [DEBUG   ] Finished updating board flags in 1.607 seconds
2019-02-06 08:35:22 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-02-06 08:35:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 08:36:02 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 08:36:12 [DEBUG   ] Got command RPT from MCS: ref #1417760
2019-02-06 08:36:12 [DEBUG   ] summary = ERROR
2019-02-06 08:36:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417760  13 58520 30972181 A  ERRORERROR'
2019-02-06 08:36:12 [DEBUG   ] Got command RPT from MCS: ref #1417761
2019-02-06 08:36:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 08:36:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417761  77 58520 30972182 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 08:36:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:36:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:36:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:36:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:36:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:36:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:36:14 [DEBUG   ] Finished updating board flags in 1.586 seconds
2019-02-06 08:36:22 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-06 08:36:42 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-06 08:37:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 08:37:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:37:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:37:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:37:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:37:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:37:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:37:14 [DEBUG   ] Finished updating board flags in 1.415 seconds
2019-02-06 08:37:22 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 08:37:42 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-02-06 08:38:02 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-06 08:38:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:38:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-02-06 08:38:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:38:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:38:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:38:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:38:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:38:14 [DEBUG   ] Finished updating board flags in 1.445 seconds
2019-02-06 08:38:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 08:38:42 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 08:39:02 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-02-06 08:39:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 08:39:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:39:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:39:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:39:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:39:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:39:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:39:14 [DEBUG   ] Finished updating board flags in 1.435 seconds
2019-02-06 08:39:22 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 08:39:43 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-02-06 08:40:02 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-02-06 08:40:08 [DEBUG   ] Got command RPT from MCS: ref #1417781
2019-02-06 08:40:08 [DEBUG   ] summary = ERROR
2019-02-06 08:40:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417781  13 58520 31208581 A  ERRORERROR'
2019-02-06 08:40:08 [DEBUG   ] Got command RPT from MCS: ref #1417782
2019-02-06 08:40:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 08:40:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417782  77 58520 31208785 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 08:40:08 [DEBUG   ] Got command RPT from MCS: ref #1417783
2019-02-06 08:40:08 [DEBUG   ] summary = ERROR
2019-02-06 08:40:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417783  13 58520 31208989 A  ERRORERROR'
2019-02-06 08:40:09 [DEBUG   ] Got command RPT from MCS: ref #1417784
2019-02-06 08:40:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 08:40:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417784  77 58520 31209193 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 08:40:09 [DEBUG   ] Got command RPT from MCS: ref #1417785
2019-02-06 08:40:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 08:40:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417785  12 58520 31209385 A  ERRORB—™š'
2019-02-06 08:40:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 08:40:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:40:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-02-06 08:40:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:40:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:40:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:40:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:40:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:40:14 [DEBUG   ] Finished updating board flags in 1.443 seconds
2019-02-06 08:40:23 [DEBUG   ] Finished updating ant stats in 1.390 seconds
2019-02-06 08:40:43 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-02-06 08:41:03 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 08:41:12 [DEBUG   ] Got command RPT from MCS: ref #1417786
2019-02-06 08:41:12 [DEBUG   ] summary = ERROR
2019-02-06 08:41:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417786  13 58520 31272185 A  ERRORERROR'
2019-02-06 08:41:12 [DEBUG   ] Got command RPT from MCS: ref #1417787
2019-02-06 08:41:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 08:41:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417787  77 58520 31272186 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 08:41:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:41:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:41:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:41:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:41:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:41:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:41:14 [DEBUG   ] Finished updating board flags in 1.432 seconds
2019-02-06 08:41:23 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 08:41:43 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-06 08:42:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 08:42:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:42:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:42:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:42:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:42:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:42:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:42:14 [DEBUG   ] Finished updating board flags in 1.434 seconds
2019-02-06 08:42:23 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 08:42:43 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-02-06 08:43:03 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-06 08:43:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:43:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-06 08:43:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:43:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:43:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:43:14 [WARNING ] (13, 1, 'bot')
2019-02-06 08:43:14 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:43:14 [DEBUG   ] Finished updating board flags in 1.431 seconds
2019-02-06 08:43:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 08:43:43 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 08:44:03 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 08:44:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:44:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:44:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:44:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:44:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:44:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:44:15 [DEBUG   ] Finished updating board flags in 2.237 seconds
2019-02-06 08:44:23 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-06 08:44:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 08:45:03 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-02-06 08:45:08 [DEBUG   ] Got command RPT from MCS: ref #1417813
2019-02-06 08:45:08 [DEBUG   ] summary = ERROR
2019-02-06 08:45:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417813  13 58520 31508673 A  ERRORERROR'
2019-02-06 08:45:08 [DEBUG   ] Got command RPT from MCS: ref #1417814
2019-02-06 08:45:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 08:45:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417814  77 58520 31508869 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 08:45:09 [DEBUG   ] Got command RPT from MCS: ref #1417815
2019-02-06 08:45:09 [DEBUG   ] summary = ERROR
2019-02-06 08:45:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417815  13 58520 31509073 A  ERRORERROR'
2019-02-06 08:45:09 [DEBUG   ] Got command RPT from MCS: ref #1417817
2019-02-06 08:45:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 08:45:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417817  77 58520 31509277 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 08:45:09 [DEBUG   ] Got command RPT from MCS: ref #1417819
2019-02-06 08:45:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 08:45:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417819  12 58520 31509469 A  ERRORB˜™š'
2019-02-06 08:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:45:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:45:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:45:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:45:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:45:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:45:15 [DEBUG   ] Finished updating board flags in 2.141 seconds
2019-02-06 08:45:23 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-02-06 08:45:44 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-02-06 08:46:04 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-02-06 08:46:12 [DEBUG   ] Got command RPT from MCS: ref #1417823
2019-02-06 08:46:12 [DEBUG   ] summary = ERROR
2019-02-06 08:46:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417823  13 58520 31572249 A  ERRORERROR'
2019-02-06 08:46:12 [DEBUG   ] Got command RPT from MCS: ref #1417824
2019-02-06 08:46:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 08:46:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417824  77 58520 31572249 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 08:46:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:46:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:46:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:46:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:46:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:46:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:46:15 [DEBUG   ] Finished updating board flags in 2.016 seconds
2019-02-06 08:46:24 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 08:46:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 08:47:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 08:47:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:47:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:47:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:47:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:47:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:47:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:47:15 [DEBUG   ] Finished updating board flags in 2.012 seconds
2019-02-06 08:47:24 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 08:47:44 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-06 08:48:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 08:48:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:48:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:48:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:48:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:48:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:48:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:48:15 [DEBUG   ] Finished updating board flags in 1.993 seconds
2019-02-06 08:48:24 [DEBUG   ] Finished updating ant stats in 0.778 seconds
2019-02-06 08:48:44 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 08:49:04 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 08:49:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:49:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-02-06 08:49:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:49:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:49:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:49:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:49:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:49:15 [DEBUG   ] Finished updating board flags in 1.802 seconds
2019-02-06 08:49:25 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-02-06 08:49:45 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-02-06 08:50:05 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-02-06 08:50:08 [DEBUG   ] Got command RPT from MCS: ref #1417844
2019-02-06 08:50:08 [DEBUG   ] summary = ERROR
2019-02-06 08:50:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417844  13 58520 31808749 A  ERRORERROR'
2019-02-06 08:50:08 [DEBUG   ] Got command RPT from MCS: ref #1417845
2019-02-06 08:50:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 08:50:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417845  77 58520 31808953 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 08:50:09 [DEBUG   ] Got command RPT from MCS: ref #1417846
2019-02-06 08:50:09 [DEBUG   ] summary = ERROR
2019-02-06 08:50:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417846  13 58520 31809157 A  ERRORERROR'
2019-02-06 08:50:09 [DEBUG   ] Got command RPT from MCS: ref #1417847
2019-02-06 08:50:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 08:50:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417847  77 58520 31809353 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 08:50:09 [DEBUG   ] Got command RPT from MCS: ref #1417848
2019-02-06 08:50:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 08:50:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417848  12 58520 31809557 A  ERRORB—™š'
2019-02-06 08:50:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:50:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-02-06 08:50:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:50:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:50:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:50:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:50:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:50:15 [DEBUG   ] Finished updating board flags in 1.803 seconds
2019-02-06 08:50:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 08:50:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 08:51:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 08:51:12 [DEBUG   ] Got command RPT from MCS: ref #1417853
2019-02-06 08:51:12 [DEBUG   ] summary = ERROR
2019-02-06 08:51:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417853  13 58520 31872181 A  ERRORERROR'
2019-02-06 08:51:12 [DEBUG   ] Got command RPT from MCS: ref #1417854
2019-02-06 08:51:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 08:51:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417854  77 58520 31872182 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 08:51:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:51:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:51:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:51:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:51:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:51:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:51:15 [DEBUG   ] Finished updating board flags in 1.799 seconds
2019-02-06 08:51:25 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-06 08:51:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 08:52:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 08:52:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 08:52:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:52:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-02-06 08:52:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:52:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:52:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:52:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:52:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:52:15 [DEBUG   ] Finished updating board flags in 1.615 seconds
2019-02-06 08:52:25 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 08:52:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 08:53:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 08:53:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:53:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:53:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:53:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:53:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:53:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:53:15 [DEBUG   ] Finished updating board flags in 1.633 seconds
2019-02-06 08:53:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 08:53:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 08:54:05 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 08:54:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2019-02-06 08:54:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:54:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2019-02-06 08:54:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:54:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:54:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:54:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:54:15 [WARNING ] (25, 5, 'bot')
2019-02-06 08:54:15 [WARNING ] (25, 5, 'bot')
2019-02-06 08:54:15 [WARNING ] (25, 5, 'bot')
2019-02-06 08:54:15 [WARNING ] (25, 5, 'bot')
2019-02-06 08:54:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:54:15 [DEBUG   ] Finished updating board flags in 1.610 seconds
2019-02-06 08:54:25 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-02-06 08:54:46 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-02-06 08:55:06 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-06 08:55:08 [DEBUG   ] Got command RPT from MCS: ref #1417876
2019-02-06 08:55:08 [DEBUG   ] summary = ERROR
2019-02-06 08:55:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417876  13 58520 32108829 A  ERRORERROR'
2019-02-06 08:55:09 [DEBUG   ] Got command RPT from MCS: ref #1417877
2019-02-06 08:55:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 08:55:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417877  77 58520 32109033 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 08:55:09 [DEBUG   ] Got command RPT from MCS: ref #1417878
2019-02-06 08:55:09 [DEBUG   ] summary = ERROR
2019-02-06 08:55:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417878  13 58520 32109237 A  ERRORERROR'
2019-02-06 08:55:09 [DEBUG   ] Got command RPT from MCS: ref #1417880
2019-02-06 08:55:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 08:55:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417880  77 58520 32109429 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 08:55:09 [DEBUG   ] Got command RPT from MCS: ref #1417882
2019-02-06 08:55:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 08:55:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417882  12 58520 32109633 A  ERRORB—™š'
2019-02-06 08:55:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:55:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:55:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:55:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:55:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:55:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:55:15 [DEBUG   ] Finished updating board flags in 1.549 seconds
2019-02-06 08:55:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 08:55:46 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 08:56:06 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-02-06 08:56:12 [DEBUG   ] Got command RPT from MCS: ref #1417886
2019-02-06 08:56:12 [DEBUG   ] summary = ERROR
2019-02-06 08:56:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417886  13 58520 32172181 A  ERRORERROR'
2019-02-06 08:56:12 [DEBUG   ] Got command RPT from MCS: ref #1417887
2019-02-06 08:56:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 08:56:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417887  77 58520 32172182 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 08:56:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:56:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:56:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:56:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:56:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:56:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:56:15 [DEBUG   ] Finished updating board flags in 1.420 seconds
2019-02-06 08:56:26 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-02-06 08:56:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 08:57:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 08:57:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 08:57:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:57:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:57:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:57:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:57:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:57:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:57:15 [DEBUG   ] Finished updating board flags in 1.414 seconds
2019-02-06 08:57:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 08:57:46 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-02-06 08:58:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 08:58:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 08:58:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:58:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:58:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:58:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:58:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:58:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:58:15 [DEBUG   ] Finished updating board flags in 1.418 seconds
2019-02-06 08:58:26 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 08:58:46 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-02-06 08:59:06 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-06 08:59:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 08:59:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:59:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:59:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:59:15 [WARNING ] (13, 1, 'bot')
2019-02-06 08:59:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 08:59:15 [DEBUG   ] Finished updating board flags in 1.430 seconds
2019-02-06 08:59:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 08:59:46 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 09:00:06 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-02-06 09:00:08 [DEBUG   ] Got command RPT from MCS: ref #1417911
2019-02-06 09:00:08 [DEBUG   ] summary = ERROR
2019-02-06 09:00:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417911  13 58520 32408909 A  ERRORERROR'
2019-02-06 09:00:09 [DEBUG   ] Got command RPT from MCS: ref #1417912
2019-02-06 09:00:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 09:00:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417912  77 58520 32409113 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 09:00:09 [DEBUG   ] Got command RPT from MCS: ref #1417913
2019-02-06 09:00:09 [DEBUG   ] summary = ERROR
2019-02-06 09:00:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417913  13 58520 32409317 A  ERRORERROR'
2019-02-06 09:00:09 [DEBUG   ] Got command RPT from MCS: ref #1417914
2019-02-06 09:00:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 09:00:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417914  77 58520 32409521 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 09:00:09 [DEBUG   ] Got command RPT from MCS: ref #1417915
2019-02-06 09:00:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 09:00:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417915  12 58520 32409713 A  ERRORB˜™š'
2019-02-06 09:00:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:00:15 [WARNING ] (13, 1, 'bot')
2019-02-06 09:00:15 [WARNING ] (13, 1, 'bot')
2019-02-06 09:00:15 [WARNING ] (13, 1, 'bot')
2019-02-06 09:00:15 [WARNING ] (13, 1, 'bot')
2019-02-06 09:00:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:00:15 [DEBUG   ] Finished updating board flags in 1.432 seconds
2019-02-06 09:00:27 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-02-06 09:00:47 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-02-06 09:01:07 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 09:01:12 [DEBUG   ] Got command RPT from MCS: ref #1417916
2019-02-06 09:01:12 [DEBUG   ] summary = ERROR
2019-02-06 09:01:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417916  13 58520 32472181 A  ERRORERROR'
2019-02-06 09:01:12 [DEBUG   ] Got command RPT from MCS: ref #1417917
2019-02-06 09:01:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 09:01:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417917  77 58520 32472182 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 09:01:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:01:15 [WARNING ] (13, 1, 'bot')
2019-02-06 09:01:15 [WARNING ] (13, 1, 'bot')
2019-02-06 09:01:15 [WARNING ] (13, 1, 'bot')
2019-02-06 09:01:15 [WARNING ] (13, 1, 'bot')
2019-02-06 09:01:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:01:15 [DEBUG   ] Finished updating board flags in 1.431 seconds
2019-02-06 09:01:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-06 09:01:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 09:02:07 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 09:02:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:02:15 [WARNING ] (13, 1, 'bot')
2019-02-06 09:02:15 [WARNING ] (13, 1, 'bot')
2019-02-06 09:02:15 [WARNING ] (13, 1, 'bot')
2019-02-06 09:02:15 [WARNING ] (13, 1, 'bot')
2019-02-06 09:02:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:02:15 [DEBUG   ] Finished updating board flags in 1.422 seconds
2019-02-06 09:02:27 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-06 09:02:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 09:03:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 09:03:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:03:15 [WARNING ] (13, 1, 'bot')
2019-02-06 09:03:15 [WARNING ] (13, 1, 'bot')
2019-02-06 09:03:15 [WARNING ] (13, 1, 'bot')
2019-02-06 09:03:15 [WARNING ] (13, 1, 'bot')
2019-02-06 09:03:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:03:15 [DEBUG   ] Finished updating board flags in 1.427 seconds
2019-02-06 09:03:27 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 09:03:47 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 09:04:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 09:04:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:04:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-02-06 09:04:15 [WARNING ] (13, 1, 'bot')
2019-02-06 09:04:15 [WARNING ] (13, 1, 'bot')
2019-02-06 09:04:15 [WARNING ] (13, 1, 'bot')
2019-02-06 09:04:15 [WARNING ] (13, 1, 'bot')
2019-02-06 09:04:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:04:15 [DEBUG   ] Finished updating board flags in 1.425 seconds
2019-02-06 09:04:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 09:04:47 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 09:05:07 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 09:05:08 [DEBUG   ] Got command RPT from MCS: ref #1417939
2019-02-06 09:05:08 [DEBUG   ] summary = ERROR
2019-02-06 09:05:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417939  13 58520 32708997 A  ERRORERROR'
2019-02-06 09:05:09 [DEBUG   ] Got command RPT from MCS: ref #1417940
2019-02-06 09:05:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 09:05:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417940  77 58520 32709189 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 09:05:09 [DEBUG   ] Got command RPT from MCS: ref #1417941
2019-02-06 09:05:09 [DEBUG   ] summary = ERROR
2019-02-06 09:05:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417941  13 58520 32709393 A  ERRORERROR'
2019-02-06 09:05:09 [DEBUG   ] Got command RPT from MCS: ref #1417943
2019-02-06 09:05:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 09:05:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417943  77 58520 32709597 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 09:05:09 [DEBUG   ] Got command RPT from MCS: ref #1417944
2019-02-06 09:05:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 09:05:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417944  12 58520 32709789 A  ERRORB–™š'
2019-02-06 09:05:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:05:15 [WARNING ] (13, 1, 'bot')
2019-02-06 09:05:15 [WARNING ] (13, 1, 'bot')
2019-02-06 09:05:15 [WARNING ] (13, 1, 'bot')
2019-02-06 09:05:15 [WARNING ] (13, 1, 'bot')
2019-02-06 09:05:15 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:05:15 [DEBUG   ] Finished updating board flags in 1.438 seconds
2019-02-06 09:05:27 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-06 09:05:47 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-06 09:06:08 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2019-02-06 09:06:12 [DEBUG   ] Got command RPT from MCS: ref #1417953
2019-02-06 09:06:12 [DEBUG   ] summary = ERROR
2019-02-06 09:06:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417953  13 58520 32772193 A  ERRORERROR'
2019-02-06 09:06:12 [DEBUG   ] Got command RPT from MCS: ref #1417954
2019-02-06 09:06:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 09:06:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417954  77 58520 32772194 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 09:06:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:06:16 [WARNING ] (13, 1, 'bot')
2019-02-06 09:06:16 [WARNING ] (13, 1, 'bot')
2019-02-06 09:06:16 [WARNING ] (13, 1, 'bot')
2019-02-06 09:06:16 [WARNING ] (13, 1, 'bot')
2019-02-06 09:06:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:06:16 [DEBUG   ] Finished updating board flags in 2.207 seconds
2019-02-06 09:06:28 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-06 09:06:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 09:07:08 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 09:07:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:07:16 [WARNING ] (13, 1, 'bot')
2019-02-06 09:07:16 [WARNING ] (13, 1, 'bot')
2019-02-06 09:07:16 [WARNING ] (13, 1, 'bot')
2019-02-06 09:07:16 [WARNING ] (13, 1, 'bot')
2019-02-06 09:07:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:07:16 [DEBUG   ] Finished updating board flags in 2.194 seconds
2019-02-06 09:07:28 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 09:07:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 09:08:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 09:08:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:08:16 [WARNING ] (13, 1, 'bot')
2019-02-06 09:08:16 [WARNING ] (13, 1, 'bot')
2019-02-06 09:08:16 [WARNING ] (13, 1, 'bot')
2019-02-06 09:08:16 [WARNING ] (13, 1, 'bot')
2019-02-06 09:08:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:08:16 [DEBUG   ] Finished updating board flags in 2.014 seconds
2019-02-06 09:08:28 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-02-06 09:08:48 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-06 09:09:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 09:09:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:09:16 [WARNING ] (13, 1, 'bot')
2019-02-06 09:09:16 [WARNING ] (13, 1, 'bot')
2019-02-06 09:09:16 [WARNING ] (13, 1, 'bot')
2019-02-06 09:09:16 [WARNING ] (13, 1, 'bot')
2019-02-06 09:09:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:09:16 [DEBUG   ] Finished updating board flags in 1.977 seconds
2019-02-06 09:09:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 09:09:48 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 09:10:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 09:10:09 [DEBUG   ] Got command RPT from MCS: ref #1417974
2019-02-06 09:10:09 [DEBUG   ] summary = ERROR
2019-02-06 09:10:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417974  13 58520 33009070 A  ERRORERROR'
2019-02-06 09:10:09 [DEBUG   ] Got command RPT from MCS: ref #1417975
2019-02-06 09:10:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 09:10:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417975  77 58520 33009273 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 09:10:09 [DEBUG   ] Got command RPT from MCS: ref #1417976
2019-02-06 09:10:09 [DEBUG   ] summary = ERROR
2019-02-06 09:10:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417976  13 58520 33009477 A  ERRORERROR'
2019-02-06 09:10:09 [DEBUG   ] Got command RPT from MCS: ref #1417977
2019-02-06 09:10:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 09:10:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417977  77 58520 33009682 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 09:10:09 [DEBUG   ] Got command RPT from MCS: ref #1417978
2019-02-06 09:10:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 09:10:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417978  12 58520 33009874 A  ERRORB—™š'
2019-02-06 09:10:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:10:16 [WARNING ] (13, 1, 'bot')
2019-02-06 09:10:16 [WARNING ] (13, 1, 'bot')
2019-02-06 09:10:16 [WARNING ] (13, 1, 'bot')
2019-02-06 09:10:16 [WARNING ] (13, 1, 'bot')
2019-02-06 09:10:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:10:16 [DEBUG   ] Finished updating board flags in 1.892 seconds
2019-02-06 09:10:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 09:10:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 09:11:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 09:11:12 [DEBUG   ] Got command RPT from MCS: ref #1417979
2019-02-06 09:11:12 [DEBUG   ] summary = ERROR
2019-02-06 09:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417979  13 58520 33072193 A  ERRORERROR'
2019-02-06 09:11:12 [DEBUG   ] Got command RPT from MCS: ref #1417980
2019-02-06 09:11:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 09:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1417980  77 58520 33072194 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 09:11:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:11:16 [WARNING ] (13, 1, 'bot')
2019-02-06 09:11:16 [WARNING ] (13, 1, 'bot')
2019-02-06 09:11:16 [WARNING ] (13, 1, 'bot')
2019-02-06 09:11:16 [WARNING ] (13, 1, 'bot')
2019-02-06 09:11:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:11:16 [DEBUG   ] Finished updating board flags in 1.713 seconds
2019-02-06 09:11:28 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2019-02-06 09:11:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 09:12:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 09:12:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:12:16 [WARNING ] (13, 1, 'bot')
2019-02-06 09:12:16 [WARNING ] (13, 1, 'bot')
2019-02-06 09:12:16 [WARNING ] (13, 1, 'bot')
2019-02-06 09:12:16 [WARNING ] (13, 1, 'bot')
2019-02-06 09:12:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:12:16 [DEBUG   ] Finished updating board flags in 1.590 seconds
2019-02-06 09:12:28 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 09:12:48 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-02-06 09:13:08 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-06 09:13:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:13:16 [WARNING ] (13, 1, 'bot')
2019-02-06 09:13:16 [WARNING ] (13, 1, 'bot')
2019-02-06 09:13:16 [WARNING ] (13, 1, 'bot')
2019-02-06 09:13:16 [WARNING ] (13, 1, 'bot')
2019-02-06 09:13:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:13:16 [DEBUG   ] Finished updating board flags in 1.416 seconds
2019-02-06 09:13:29 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-02-06 09:13:48 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-02-06 09:14:09 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-02-06 09:14:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:14:16 [WARNING ] (13, 1, 'bot')
2019-02-06 09:14:16 [WARNING ] (13, 1, 'bot')
2019-02-06 09:14:16 [WARNING ] (13, 1, 'bot')
2019-02-06 09:14:16 [WARNING ] (13, 1, 'bot')
2019-02-06 09:14:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:14:16 [DEBUG   ] Finished updating board flags in 1.411 seconds
2019-02-06 09:14:29 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-06 09:14:49 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 09:15:09 [DEBUG   ] Got command RPT from MCS: ref #1418006
2019-02-06 09:15:09 [DEBUG   ] summary = ERROR
2019-02-06 09:15:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418006  13 58520 33309149 A  ERRORERROR'
2019-02-06 09:15:09 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-02-06 09:15:09 [DEBUG   ] Got command RPT from MCS: ref #1418007
2019-02-06 09:15:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 09:15:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418007  77 58520 33309353 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 09:15:09 [DEBUG   ] Got command RPT from MCS: ref #1418008
2019-02-06 09:15:09 [DEBUG   ] summary = ERROR
2019-02-06 09:15:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418008  13 58520 33309557 A  ERRORERROR'
2019-02-06 09:15:09 [DEBUG   ] Got command RPT from MCS: ref #1418010
2019-02-06 09:15:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 09:15:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418010  77 58520 33309749 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 09:15:09 [DEBUG   ] Got command RPT from MCS: ref #1418011
2019-02-06 09:15:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 09:15:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418011  12 58520 33309953 A  ERRORB–™š'
2019-02-06 09:15:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:15:16 [WARNING ] (13, 1, 'bot')
2019-02-06 09:15:16 [WARNING ] (13, 1, 'bot')
2019-02-06 09:15:16 [WARNING ] (13, 1, 'bot')
2019-02-06 09:15:16 [WARNING ] (13, 1, 'bot')
2019-02-06 09:15:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:15:16 [DEBUG   ] Finished updating board flags in 1.406 seconds
2019-02-06 09:15:29 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-02-06 09:15:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 09:16:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 09:16:12 [DEBUG   ] Got command RPT from MCS: ref #1418016
2019-02-06 09:16:12 [DEBUG   ] summary = ERROR
2019-02-06 09:16:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418016  13 58520 33372189 A  ERRORERROR'
2019-02-06 09:16:12 [DEBUG   ] Got command RPT from MCS: ref #1418017
2019-02-06 09:16:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 09:16:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418017  77 58520 33372190 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 09:16:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:16:16 [WARNING ] (13, 1, 'bot')
2019-02-06 09:16:16 [WARNING ] (13, 1, 'bot')
2019-02-06 09:16:16 [WARNING ] (13, 1, 'bot')
2019-02-06 09:16:16 [WARNING ] (13, 1, 'bot')
2019-02-06 09:16:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:16:16 [DEBUG   ] Finished updating board flags in 1.422 seconds
2019-02-06 09:16:29 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 09:16:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 09:17:09 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 09:17:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 09:17:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:17:16 [WARNING ] (13, 1, 'bot')
2019-02-06 09:17:16 [WARNING ] (13, 1, 'bot')
2019-02-06 09:17:16 [WARNING ] (13, 1, 'bot')
2019-02-06 09:17:16 [WARNING ] (13, 1, 'bot')
2019-02-06 09:17:16 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:17:16 [DEBUG   ] Finished updating board flags in 1.375 seconds
2019-02-06 09:17:29 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-02-06 09:17:49 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 09:18:09 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-06 09:18:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:18:17 [WARNING ] (13, 1, 'bot')
2019-02-06 09:18:17 [WARNING ] (13, 1, 'bot')
2019-02-06 09:18:17 [WARNING ] (13, 1, 'bot')
2019-02-06 09:18:17 [WARNING ] (13, 1, 'bot')
2019-02-06 09:18:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:18:17 [DEBUG   ] Finished updating board flags in 2.190 seconds
2019-02-06 09:18:30 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-02-06 09:18:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 09:19:10 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 09:19:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-02-06 09:19:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:19:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-02-06 09:19:17 [WARNING ] (13, 1, 'bot')
2019-02-06 09:19:17 [WARNING ] (13, 1, 'bot')
2019-02-06 09:19:17 [WARNING ] (13, 1, 'bot')
2019-02-06 09:19:17 [WARNING ] (13, 1, 'bot')
2019-02-06 09:19:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:19:17 [DEBUG   ] Finished updating board flags in 2.005 seconds
2019-02-06 09:19:30 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 09:19:50 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 09:20:09 [DEBUG   ] Got command RPT from MCS: ref #1418037
2019-02-06 09:20:09 [DEBUG   ] summary = ERROR
2019-02-06 09:20:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418037  13 58520 33609230 A  ERRORERROR'
2019-02-06 09:20:09 [DEBUG   ] Got command RPT from MCS: ref #1418038
2019-02-06 09:20:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 09:20:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418038  77 58520 33609433 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 09:20:09 [DEBUG   ] Got command RPT from MCS: ref #1418039
2019-02-06 09:20:09 [DEBUG   ] summary = ERROR
2019-02-06 09:20:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418039  13 58520 33609638 A  ERRORERROR'
2019-02-06 09:20:09 [DEBUG   ] Got command RPT from MCS: ref #1418040
2019-02-06 09:20:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 09:20:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418040  77 58520 33609842 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 09:20:10 [DEBUG   ] Got command RPT from MCS: ref #1418041
2019-02-06 09:20:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 09:20:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418041  12 58520 33610034 A  ERRORB˜™š'
2019-02-06 09:20:10 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-02-06 09:20:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:20:17 [WARNING ] (13, 1, 'bot')
2019-02-06 09:20:17 [WARNING ] (13, 1, 'bot')
2019-02-06 09:20:17 [WARNING ] (13, 1, 'bot')
2019-02-06 09:20:17 [WARNING ] (13, 1, 'bot')
2019-02-06 09:20:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:20:17 [DEBUG   ] Finished updating board flags in 1.992 seconds
2019-02-06 09:20:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 09:20:50 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 09:21:10 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-06 09:21:12 [DEBUG   ] Got command RPT from MCS: ref #1418046
2019-02-06 09:21:12 [DEBUG   ] summary = ERROR
2019-02-06 09:21:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418046  13 58520 33672193 A  ERRORERROR'
2019-02-06 09:21:12 [DEBUG   ] Got command RPT from MCS: ref #1418047
2019-02-06 09:21:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 09:21:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418047  77 58520 33672194 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 09:21:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:21:17 [WARNING ] (13, 1, 'bot')
2019-02-06 09:21:17 [WARNING ] (13, 1, 'bot')
2019-02-06 09:21:17 [WARNING ] (13, 1, 'bot')
2019-02-06 09:21:17 [WARNING ] (13, 1, 'bot')
2019-02-06 09:21:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:21:17 [DEBUG   ] Finished updating board flags in 1.807 seconds
2019-02-06 09:21:30 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-02-06 09:21:50 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 09:22:10 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 09:22:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:22:17 [WARNING ] (13, 1, 'bot')
2019-02-06 09:22:17 [WARNING ] (13, 1, 'bot')
2019-02-06 09:22:17 [WARNING ] (13, 1, 'bot')
2019-02-06 09:22:17 [WARNING ] (13, 1, 'bot')
2019-02-06 09:22:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:22:17 [DEBUG   ] Finished updating board flags in 1.809 seconds
2019-02-06 09:22:30 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 09:22:50 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-02-06 09:23:11 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-02-06 09:23:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 09:23:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:23:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-06 09:23:17 [WARNING ] (13, 1, 'bot')
2019-02-06 09:23:17 [WARNING ] (13, 1, 'bot')
2019-02-06 09:23:17 [WARNING ] (13, 1, 'bot')
2019-02-06 09:23:17 [WARNING ] (13, 1, 'bot')
2019-02-06 09:23:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:23:17 [DEBUG   ] Finished updating board flags in 1.788 seconds
2019-02-06 09:23:31 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-02-06 09:23:51 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-06 09:24:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 09:24:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 09:24:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:24:17 [WARNING ] (13, 1, 'bot')
2019-02-06 09:24:17 [WARNING ] (13, 1, 'bot')
2019-02-06 09:24:17 [WARNING ] (13, 1, 'bot')
2019-02-06 09:24:17 [WARNING ] (13, 1, 'bot')
2019-02-06 09:24:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:24:17 [DEBUG   ] Finished updating board flags in 1.612 seconds
2019-02-06 09:24:31 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 09:24:51 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 09:25:09 [DEBUG   ] Got command RPT from MCS: ref #1418069
2019-02-06 09:25:09 [DEBUG   ] summary = ERROR
2019-02-06 09:25:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418069  13 58520 33909317 A  ERRORERROR'
2019-02-06 09:25:09 [DEBUG   ] Got command RPT from MCS: ref #1418070
2019-02-06 09:25:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 09:25:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418070  77 58520 33909509 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 09:25:09 [DEBUG   ] Got command RPT from MCS: ref #1418071
2019-02-06 09:25:09 [DEBUG   ] summary = ERROR
2019-02-06 09:25:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418071  13 58520 33909713 A  ERRORERROR'
2019-02-06 09:25:09 [DEBUG   ] Got command RPT from MCS: ref #1418073
2019-02-06 09:25:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 09:25:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418073  77 58520 33909917 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 09:25:10 [DEBUG   ] Got command RPT from MCS: ref #1418075
2019-02-06 09:25:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 09:25:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418075  12 58520 33910121 A  ERRORB—™š'
2019-02-06 09:25:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 09:25:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:25:17 [WARNING ] (13, 1, 'bot')
2019-02-06 09:25:17 [WARNING ] (13, 1, 'bot')
2019-02-06 09:25:17 [WARNING ] (13, 1, 'bot')
2019-02-06 09:25:17 [WARNING ] (13, 1, 'bot')
2019-02-06 09:25:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:25:17 [DEBUG   ] Finished updating board flags in 1.588 seconds
2019-02-06 09:25:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 09:25:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 09:26:11 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-06 09:26:12 [DEBUG   ] Got command RPT from MCS: ref #1418079
2019-02-06 09:26:12 [DEBUG   ] summary = ERROR
2019-02-06 09:26:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418079  13 58520 33972197 A  ERRORERROR'
2019-02-06 09:26:12 [DEBUG   ] Got command RPT from MCS: ref #1418080
2019-02-06 09:26:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 09:26:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418080  77 58520 33972198 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 09:26:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:26:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-02-06 09:26:17 [WARNING ] (13, 1, 'bot')
2019-02-06 09:26:17 [WARNING ] (13, 1, 'bot')
2019-02-06 09:26:17 [WARNING ] (13, 1, 'bot')
2019-02-06 09:26:17 [WARNING ] (13, 1, 'bot')
2019-02-06 09:26:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:26:17 [DEBUG   ] Finished updating board flags in 1.438 seconds
2019-02-06 09:26:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 09:26:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 09:27:11 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-02-06 09:27:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:27:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-02-06 09:27:17 [WARNING ] (13, 1, 'bot')
2019-02-06 09:27:17 [WARNING ] (13, 1, 'bot')
2019-02-06 09:27:17 [WARNING ] (13, 1, 'bot')
2019-02-06 09:27:17 [WARNING ] (13, 1, 'bot')
2019-02-06 09:27:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:27:17 [DEBUG   ] Finished updating board flags in 1.377 seconds
2019-02-06 09:27:31 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 09:27:52 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-02-06 09:28:12 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-02-06 09:28:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:28:17 [WARNING ] (13, 1, 'bot')
2019-02-06 09:28:17 [WARNING ] (13, 1, 'bot')
2019-02-06 09:28:17 [WARNING ] (13, 1, 'bot')
2019-02-06 09:28:17 [WARNING ] (13, 1, 'bot')
2019-02-06 09:28:17 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:28:17 [DEBUG   ] Finished updating board flags in 1.377 seconds
2019-02-06 09:28:32 [DEBUG   ] Finished updating ant stats in 1.151 seconds
2019-02-06 09:28:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 09:29:12 [DEBUG   ] Finished updating ant stats in 0.922 seconds
2019-02-06 09:29:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:29:18 [WARNING ] (13, 1, 'bot')
2019-02-06 09:29:18 [WARNING ] (13, 1, 'bot')
2019-02-06 09:29:18 [WARNING ] (13, 1, 'bot')
2019-02-06 09:29:18 [WARNING ] (13, 1, 'bot')
2019-02-06 09:29:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:29:18 [DEBUG   ] Finished updating board flags in 2.031 seconds
2019-02-06 09:29:32 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-02-06 09:29:52 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 09:30:09 [DEBUG   ] Got command RPT from MCS: ref #1418104
2019-02-06 09:30:09 [DEBUG   ] summary = ERROR
2019-02-06 09:30:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418104  13 58520 34209393 A  ERRORERROR'
2019-02-06 09:30:09 [DEBUG   ] Got command RPT from MCS: ref #1418105
2019-02-06 09:30:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 09:30:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418105  77 58520 34209598 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 09:30:09 [DEBUG   ] Got command RPT from MCS: ref #1418106
2019-02-06 09:30:09 [DEBUG   ] summary = ERROR
2019-02-06 09:30:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418106  13 58520 34209789 A  ERRORERROR'
2019-02-06 09:30:09 [DEBUG   ] Got command RPT from MCS: ref #1418107
2019-02-06 09:30:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 09:30:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418107  77 58520 34209993 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 09:30:10 [DEBUG   ] Got command RPT from MCS: ref #1418108
2019-02-06 09:30:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 09:30:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418108  12 58520 34210197 A  ERRORB—™š'
2019-02-06 09:30:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 09:30:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:30:18 [WARNING ] (13, 1, 'bot')
2019-02-06 09:30:18 [WARNING ] (13, 1, 'bot')
2019-02-06 09:30:18 [WARNING ] (13, 1, 'bot')
2019-02-06 09:30:18 [WARNING ] (13, 1, 'bot')
2019-02-06 09:30:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:30:18 [DEBUG   ] Finished updating board flags in 1.994 seconds
2019-02-06 09:30:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 09:30:52 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 09:31:12 [DEBUG   ] Got command RPT from MCS: ref #1418109
2019-02-06 09:31:12 [DEBUG   ] summary = ERROR
2019-02-06 09:31:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418109  13 58520 34272197 A  ERRORERROR'
2019-02-06 09:31:12 [DEBUG   ] Got command RPT from MCS: ref #1418110
2019-02-06 09:31:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 09:31:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418110  77 58520 34272198 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 09:31:12 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 09:31:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:31:18 [WARNING ] (13, 1, 'bot')
2019-02-06 09:31:18 [WARNING ] (13, 1, 'bot')
2019-02-06 09:31:18 [WARNING ] (13, 1, 'bot')
2019-02-06 09:31:18 [WARNING ] (13, 1, 'bot')
2019-02-06 09:31:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:31:18 [DEBUG   ] Finished updating board flags in 1.835 seconds
2019-02-06 09:31:32 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-06 09:31:53 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-02-06 09:32:12 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-02-06 09:32:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 09:32:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:32:18 [WARNING ] (13, 1, 'bot')
2019-02-06 09:32:18 [WARNING ] (13, 1, 'bot')
2019-02-06 09:32:18 [WARNING ] (13, 1, 'bot')
2019-02-06 09:32:18 [WARNING ] (13, 1, 'bot')
2019-02-06 09:32:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:32:18 [DEBUG   ] Finished updating board flags in 1.767 seconds
2019-02-06 09:32:33 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2019-02-06 09:32:53 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-06 09:33:13 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 09:33:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:33:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-06 09:33:18 [WARNING ] (13, 1, 'bot')
2019-02-06 09:33:18 [WARNING ] (13, 1, 'bot')
2019-02-06 09:33:18 [WARNING ] (13, 1, 'bot')
2019-02-06 09:33:18 [WARNING ] (13, 1, 'bot')
2019-02-06 09:33:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:33:18 [DEBUG   ] Finished updating board flags in 1.621 seconds
2019-02-06 09:33:33 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 09:33:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 09:34:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 09:34:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 09:34:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:34:18 [WARNING ] (13, 1, 'bot')
2019-02-06 09:34:18 [WARNING ] (13, 1, 'bot')
2019-02-06 09:34:18 [WARNING ] (13, 1, 'bot')
2019-02-06 09:34:18 [WARNING ] (13, 1, 'bot')
2019-02-06 09:34:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:34:18 [DEBUG   ] Finished updating board flags in 1.589 seconds
2019-02-06 09:34:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 09:34:53 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-06 09:35:09 [DEBUG   ] Got command RPT from MCS: ref #1418132
2019-02-06 09:35:09 [DEBUG   ] summary = ERROR
2019-02-06 09:35:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418132  13 58520 34509469 A  ERRORERROR'
2019-02-06 09:35:09 [DEBUG   ] Got command RPT from MCS: ref #1418133
2019-02-06 09:35:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 09:35:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418133  77 58520 34509673 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 09:35:09 [DEBUG   ] Got command RPT from MCS: ref #1418134
2019-02-06 09:35:09 [DEBUG   ] summary = ERROR
2019-02-06 09:35:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418134  13 58520 34509877 A  ERRORERROR'
2019-02-06 09:35:10 [DEBUG   ] Got command RPT from MCS: ref #1418136
2019-02-06 09:35:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 09:35:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418136  77 58520 34510081 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 09:35:10 [DEBUG   ] Got command RPT from MCS: ref #1418137
2019-02-06 09:35:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 09:35:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418137  12 58520 34510273 A  ERRORB˜™š'
2019-02-06 09:35:13 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-06 09:35:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:35:18 [WARNING ] (13, 1, 'bot')
2019-02-06 09:35:18 [WARNING ] (13, 1, 'bot')
2019-02-06 09:35:18 [WARNING ] (13, 1, 'bot')
2019-02-06 09:35:18 [WARNING ] (13, 1, 'bot')
2019-02-06 09:35:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:35:18 [DEBUG   ] Finished updating board flags in 1.403 seconds
2019-02-06 09:35:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 09:35:53 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 09:36:12 [DEBUG   ] Got command RPT from MCS: ref #1418146
2019-02-06 09:36:12 [DEBUG   ] summary = ERROR
2019-02-06 09:36:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418146  13 58520 34572189 A  ERRORERROR'
2019-02-06 09:36:12 [DEBUG   ] Got command RPT from MCS: ref #1418147
2019-02-06 09:36:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 09:36:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418147  77 58520 34572393 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 09:36:13 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 09:36:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:36:18 [WARNING ] (13, 1, 'bot')
2019-02-06 09:36:18 [WARNING ] (13, 1, 'bot')
2019-02-06 09:36:18 [WARNING ] (13, 1, 'bot')
2019-02-06 09:36:18 [WARNING ] (13, 1, 'bot')
2019-02-06 09:36:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:36:18 [DEBUG   ] Finished updating board flags in 1.391 seconds
2019-02-06 09:36:33 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-06 09:36:54 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-02-06 09:37:14 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-06 09:37:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:37:18 [WARNING ] (13, 1, 'bot')
2019-02-06 09:37:18 [WARNING ] (13, 1, 'bot')
2019-02-06 09:37:18 [WARNING ] (13, 1, 'bot')
2019-02-06 09:37:18 [WARNING ] (13, 1, 'bot')
2019-02-06 09:37:18 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:37:18 [DEBUG   ] Finished updating board flags in 1.352 seconds
2019-02-06 09:37:34 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 09:37:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 09:38:14 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 09:38:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:38:19 [WARNING ] (13, 1, 'bot')
2019-02-06 09:38:19 [WARNING ] (13, 1, 'bot')
2019-02-06 09:38:19 [WARNING ] (13, 1, 'bot')
2019-02-06 09:38:19 [WARNING ] (13, 1, 'bot')
2019-02-06 09:38:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:38:19 [DEBUG   ] Finished updating board flags in 2.060 seconds
2019-02-06 09:38:34 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 09:38:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 09:39:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 09:39:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:39:19 [WARNING ] (13, 1, 'bot')
2019-02-06 09:39:19 [WARNING ] (13, 1, 'bot')
2019-02-06 09:39:19 [WARNING ] (13, 1, 'bot')
2019-02-06 09:39:19 [WARNING ] (13, 1, 'bot')
2019-02-06 09:39:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:39:19 [DEBUG   ] Finished updating board flags in 2.005 seconds
2019-02-06 09:39:34 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 09:39:54 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-02-06 09:40:09 [DEBUG   ] Got command RPT from MCS: ref #1418167
2019-02-06 09:40:09 [DEBUG   ] summary = ERROR
2019-02-06 09:40:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418167  13 58520 34809550 A  ERRORERROR'
2019-02-06 09:40:09 [DEBUG   ] Got command RPT from MCS: ref #1418168
2019-02-06 09:40:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 09:40:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418168  77 58520 34809753 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 09:40:09 [DEBUG   ] Got command RPT from MCS: ref #1418169
2019-02-06 09:40:09 [DEBUG   ] summary = ERROR
2019-02-06 09:40:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418169  13 58520 34809957 A  ERRORERROR'
2019-02-06 09:40:10 [DEBUG   ] Got command RPT from MCS: ref #1418170
2019-02-06 09:40:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 09:40:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418170  77 58520 34810161 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 09:40:10 [DEBUG   ] Got command RPT from MCS: ref #1418171
2019-02-06 09:40:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 09:40:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418171  12 58520 34810354 A  ERRORB—™š'
2019-02-06 09:40:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 09:40:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:40:19 [WARNING ] (13, 1, 'bot')
2019-02-06 09:40:19 [WARNING ] (13, 1, 'bot')
2019-02-06 09:40:19 [WARNING ] (13, 1, 'bot')
2019-02-06 09:40:19 [WARNING ] (13, 1, 'bot')
2019-02-06 09:40:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:40:19 [DEBUG   ] Finished updating board flags in 2.008 seconds
2019-02-06 09:40:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 09:40:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 09:41:12 [DEBUG   ] Got command RPT from MCS: ref #1418172
2019-02-06 09:41:12 [DEBUG   ] summary = ERROR
2019-02-06 09:41:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418172  13 58520 34872201 A  ERRORERROR'
2019-02-06 09:41:12 [DEBUG   ] Got command RPT from MCS: ref #1418173
2019-02-06 09:41:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 09:41:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418173  77 58520 34872202 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 09:41:14 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-06 09:41:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:41:19 [WARNING ] (13, 1, 'bot')
2019-02-06 09:41:19 [WARNING ] (13, 1, 'bot')
2019-02-06 09:41:19 [WARNING ] (13, 1, 'bot')
2019-02-06 09:41:19 [WARNING ] (13, 1, 'bot')
2019-02-06 09:41:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:41:19 [DEBUG   ] Finished updating board flags in 1.998 seconds
2019-02-06 09:41:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 09:41:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 09:42:11 [DEBUG   ] Got command TBW from MCS: ref #1418194
2019-02-06 09:42:11 [DEBUG   ] tbw = exited with status True, code 0x00
2019-02-06 09:42:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW  1418194   8 58520 34931522 A  ERROR'
2019-02-06 09:42:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2019-02-06 09:42:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2019-02-06 09:42:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2019-02-06 09:42:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2019-02-06 09:42:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2019-02-06 09:42:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2019-02-06 09:42:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2019-02-06 09:42:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2019-02-06 09:42:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2019-02-06 09:42:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2019-02-06 09:42:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2019-02-06 09:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2019-02-06 09:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2019-02-06 09:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2019-02-06 09:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2019-02-06 09:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2019-02-06 09:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2019-02-06 09:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2019-02-06 09:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2019-02-06 09:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2019-02-06 09:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2019-02-06 09:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2019-02-06 09:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2019-02-06 09:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2019-02-06 09:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2019-02-06 09:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2019-02-06 09:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2019-02-06 09:42:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2019-02-06 09:42:15 [DEBUG   ] spawn_process: at 2019-02-06 09:42:15 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2019-02-06 09:42:15 [DEBUG   ] spawn_process: at 2019-02-06 09:42:15 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2019-02-06 09:42:15 [DEBUG   ] spawn_process: at 2019-02-06 09:42:15 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2019-02-06 09:42:15 [DEBUG   ] spawn_process: at 2019-02-06 09:42:15 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2019-02-06 09:42:15 [DEBUG   ] spawn_process: at 2019-02-06 09:42:15 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2019-02-06 09:42:15 [DEBUG   ] spawn_process: at 2019-02-06 09:42:15 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2019-02-06 09:42:15 [DEBUG   ] spawn_process: at 2019-02-06 09:42:15 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2019-02-06 09:42:15 [DEBUG   ] spawn_process: at 2019-02-06 09:42:15 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2019-02-06 09:42:15 [DEBUG   ] spawn_process: at 2019-02-06 09:42:15 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2019-02-06 09:42:15 [DEBUG   ] spawn_process: at 2019-02-06 09:42:15 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2019-02-06 09:42:15 [DEBUG   ] spawn_process: at 2019-02-06 09:42:15 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2019-02-06 09:42:15 [DEBUG   ] spawn_process: at 2019-02-06 09:42:15 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2019-02-06 09:42:15 [DEBUG   ] spawn_process: at 2019-02-06 09:42:15 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2019-02-06 09:42:15 [DEBUG   ] spawn_process: at 2019-02-06 09:42:15 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2019-02-06 09:42:15 [DEBUG   ] spawn_process: at 2019-02-06 09:42:15 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2019-02-06 09:42:15 [DEBUG   ] spawn_process: at 2019-02-06 09:42:15 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2019-02-06 09:42:15 [DEBUG   ] spawn_process: at 2019-02-06 09:42:15 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2019-02-06 09:42:15 [DEBUG   ] spawn_process: at 2019-02-06 09:42:15 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2019-02-06 09:42:15 [DEBUG   ] spawn_process: at 2019-02-06 09:42:15 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2019-02-06 09:42:15 [DEBUG   ] spawn_process: at 2019-02-06 09:42:15 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2019-02-06 09:42:15 [DEBUG   ] spawn_process: at 2019-02-06 09:42:15 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2019-02-06 09:42:15 [DEBUG   ] spawn_process: at 2019-02-06 09:42:15 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2019-02-06 09:42:15 [DEBUG   ] spawn_process: at 2019-02-06 09:42:15 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2019-02-06 09:42:15 [DEBUG   ] spawn_process: at 2019-02-06 09:42:15 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2019-02-06 09:42:15 [DEBUG   ] spawn_process: at 2019-02-06 09:42:15 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2019-02-06 09:42:15 [DEBUG   ] spawn_process: at 2019-02-06 09:42:15 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2019-02-06 09:42:15 [INFO    ] Finished spawning TBW
2019-02-06 09:42:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:42:19 [WARNING ] (13, 1, 'bot')
2019-02-06 09:42:19 [WARNING ] (13, 1, 'bot')
2019-02-06 09:42:19 [WARNING ] (13, 1, 'bot')
2019-02-06 09:42:19 [WARNING ] (13, 1, 'bot')
2019-02-06 09:42:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:42:19 [DEBUG   ] Finished updating board flags in 1.618 seconds
2019-02-06 09:43:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:43:19 [WARNING ] (13, 1, 'bot')
2019-02-06 09:43:19 [WARNING ] (13, 1, 'bot')
2019-02-06 09:43:19 [WARNING ] (13, 1, 'bot')
2019-02-06 09:43:19 [WARNING ] (13, 1, 'bot')
2019-02-06 09:43:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:43:19 [DEBUG   ] Finished updating board flags in 1.752 seconds
2019-02-06 09:44:03 [INFO    ] __waitForTBW - TBW finished in 108.829 s
2019-02-06 09:44:04 [INFO    ] Started antennas statistics background thread
2019-02-06 09:44:04 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2019-02-06 09:44:04 [DEBUG   ] spawn_process: at 2019-02-06 09:44:04 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1549446246']
2019-02-06 09:44:04 [DEBUG   ] spawn_process: at 2019-02-06 09:44:04 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1549446246']
2019-02-06 09:44:04 [DEBUG   ] spawn_process: at 2019-02-06 09:44:04 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1549446246']
2019-02-06 09:44:04 [DEBUG   ] spawn_process: at 2019-02-06 09:44:04 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1549446246']
2019-02-06 09:44:04 [DEBUG   ] spawn_process: at 2019-02-06 09:44:04 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1549446246']
2019-02-06 09:44:04 [DEBUG   ] spawn_process: at 2019-02-06 09:44:04 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1549446246']
2019-02-06 09:44:04 [DEBUG   ] spawn_process: at 2019-02-06 09:44:04 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1549446246']
2019-02-06 09:44:04 [DEBUG   ] spawn_process: at 2019-02-06 09:44:04 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1549446246']
2019-02-06 09:44:04 [DEBUG   ] spawn_process: at 2019-02-06 09:44:04 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1549446246']
2019-02-06 09:44:04 [DEBUG   ] spawn_process: at 2019-02-06 09:44:04 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1549446246']
2019-02-06 09:44:04 [DEBUG   ] spawn_process: at 2019-02-06 09:44:04 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1549446246']
2019-02-06 09:44:04 [DEBUG   ] spawn_process: at 2019-02-06 09:44:04 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1549446246']
2019-02-06 09:44:04 [DEBUG   ] spawn_process: at 2019-02-06 09:44:04 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1549446246']
2019-02-06 09:44:04 [DEBUG   ] spawn_process: at 2019-02-06 09:44:04 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1549446246']
2019-02-06 09:44:04 [DEBUG   ] spawn_process: at 2019-02-06 09:44:04 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1549446246']
2019-02-06 09:44:04 [DEBUG   ] spawn_process: at 2019-02-06 09:44:04 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1549446246']
2019-02-06 09:44:04 [DEBUG   ] spawn_process: at 2019-02-06 09:44:04 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1549446246']
2019-02-06 09:44:05 [DEBUG   ] spawn_process: at 2019-02-06 09:44:05 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1549446246']
2019-02-06 09:44:05 [DEBUG   ] spawn_process: at 2019-02-06 09:44:05 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1549446246']
2019-02-06 09:44:05 [DEBUG   ] spawn_process: at 2019-02-06 09:44:05 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1549446246']
2019-02-06 09:44:05 [DEBUG   ] spawn_process: at 2019-02-06 09:44:05 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1549446246']
2019-02-06 09:44:05 [DEBUG   ] spawn_process: at 2019-02-06 09:44:05 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1549446246']
2019-02-06 09:44:05 [DEBUG   ] spawn_process: at 2019-02-06 09:44:05 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1549446246']
2019-02-06 09:44:05 [DEBUG   ] spawn_process: at 2019-02-06 09:44:05 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1549446246']
2019-02-06 09:44:05 [DEBUG   ] spawn_process: at 2019-02-06 09:44:05 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1549446246']
2019-02-06 09:44:05 [DEBUG   ] spawn_process: at 2019-02-06 09:44:05 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1549446246']
2019-02-06 09:44:05 [INFO    ] Finished spawning TBN in 0.054 s
2019-02-06 09:44:05 [DEBUG   ] Finished updating ant stats in 1.286 seconds
2019-02-06 09:44:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:44:19 [WARNING ] (13, 1, 'bot')
2019-02-06 09:44:19 [WARNING ] (13, 1, 'bot')
2019-02-06 09:44:19 [WARNING ] (13, 1, 'bot')
2019-02-06 09:44:19 [WARNING ] (13, 1, 'bot')
2019-02-06 09:44:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:44:19 [DEBUG   ] Finished updating board flags in 1.782 seconds
2019-02-06 09:44:25 [DEBUG   ] Finished updating ant stats in 1.267 seconds
2019-02-06 09:44:45 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-02-06 09:45:05 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 09:45:09 [DEBUG   ] Got command RPT from MCS: ref #1418208
2019-02-06 09:45:09 [DEBUG   ] summary = ERROR
2019-02-06 09:45:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418208  13 58520 35109633 A  ERRORERROR'
2019-02-06 09:45:09 [DEBUG   ] Got command RPT from MCS: ref #1418209
2019-02-06 09:45:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 09:45:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418209  77 58520 35109837 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 09:45:10 [DEBUG   ] Got command RPT from MCS: ref #1418210
2019-02-06 09:45:10 [DEBUG   ] summary = ERROR
2019-02-06 09:45:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418210  13 58520 35110029 A  ERRORERROR'
2019-02-06 09:45:10 [DEBUG   ] Got command RPT from MCS: ref #1418212
2019-02-06 09:45:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 09:45:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418212  77 58520 35110233 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 09:45:10 [DEBUG   ] Got command RPT from MCS: ref #1418213
2019-02-06 09:45:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 09:45:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418213  12 58520 35110437 A  ERRORB–™š'
2019-02-06 09:45:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:45:19 [WARNING ] (13, 1, 'bot')
2019-02-06 09:45:19 [WARNING ] (13, 1, 'bot')
2019-02-06 09:45:19 [WARNING ] (13, 1, 'bot')
2019-02-06 09:45:19 [WARNING ] (13, 1, 'bot')
2019-02-06 09:45:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:45:19 [DEBUG   ] Finished updating board flags in 1.630 seconds
2019-02-06 09:45:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 09:45:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 09:46:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 09:46:12 [DEBUG   ] Got command RPT from MCS: ref #1418218
2019-02-06 09:46:12 [DEBUG   ] summary = ERROR
2019-02-06 09:46:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418218  13 58520 35172201 A  ERRORERROR'
2019-02-06 09:46:12 [DEBUG   ] Got command RPT from MCS: ref #1418219
2019-02-06 09:46:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 09:46:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418219  77 58520 35172202 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 09:46:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:46:19 [WARNING ] (13, 1, 'bot')
2019-02-06 09:46:19 [WARNING ] (13, 1, 'bot')
2019-02-06 09:46:19 [WARNING ] (13, 1, 'bot')
2019-02-06 09:46:19 [WARNING ] (13, 1, 'bot')
2019-02-06 09:46:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:46:19 [DEBUG   ] Finished updating board flags in 1.633 seconds
2019-02-06 09:46:25 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2019-02-06 09:46:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 09:47:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 09:47:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:47:19 [WARNING ] (13, 1, 'bot')
2019-02-06 09:47:19 [WARNING ] (13, 1, 'bot')
2019-02-06 09:47:19 [WARNING ] (13, 1, 'bot')
2019-02-06 09:47:19 [WARNING ] (13, 1, 'bot')
2019-02-06 09:47:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:47:19 [DEBUG   ] Finished updating board flags in 1.634 seconds
2019-02-06 09:47:25 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 09:47:45 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 09:48:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 09:48:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:48:19 [WARNING ] (13, 1, 'bot')
2019-02-06 09:48:19 [WARNING ] (13, 1, 'bot')
2019-02-06 09:48:19 [WARNING ] (13, 1, 'bot')
2019-02-06 09:48:19 [WARNING ] (13, 1, 'bot')
2019-02-06 09:48:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:48:19 [DEBUG   ] Finished updating board flags in 1.643 seconds
2019-02-06 09:48:25 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 09:48:45 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 09:49:05 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 09:49:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:49:19 [WARNING ] (13, 1, 'bot')
2019-02-06 09:49:19 [WARNING ] (13, 1, 'bot')
2019-02-06 09:49:19 [WARNING ] (13, 1, 'bot')
2019-02-06 09:49:19 [WARNING ] (13, 1, 'bot')
2019-02-06 09:49:19 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:49:19 [DEBUG   ] Finished updating board flags in 1.640 seconds
2019-02-06 09:49:25 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-06 09:49:45 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-06 09:50:05 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2019-02-06 09:50:09 [DEBUG   ] Got command RPT from MCS: ref #1418239
2019-02-06 09:50:09 [DEBUG   ] summary = ERROR
2019-02-06 09:50:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418239  13 58520 35409713 A  ERRORERROR'
2019-02-06 09:50:09 [DEBUG   ] Got command RPT from MCS: ref #1418240
2019-02-06 09:50:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 09:50:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418240  77 58520 35409917 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 09:50:10 [DEBUG   ] Got command RPT from MCS: ref #1418241
2019-02-06 09:50:10 [DEBUG   ] summary = ERROR
2019-02-06 09:50:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418241  13 58520 35410113 A  ERRORERROR'
2019-02-06 09:50:10 [DEBUG   ] Got command RPT from MCS: ref #1418242
2019-02-06 09:50:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 09:50:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418242  77 58520 35410317 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 09:50:10 [DEBUG   ] Got command RPT from MCS: ref #1418243
2019-02-06 09:50:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 09:50:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418243  12 58520 35410513 A  ERRORB—™š'
2019-02-06 09:50:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:50:20 [WARNING ] (13, 1, 'bot')
2019-02-06 09:50:20 [WARNING ] (13, 1, 'bot')
2019-02-06 09:50:20 [WARNING ] (13, 1, 'bot')
2019-02-06 09:50:20 [WARNING ] (13, 1, 'bot')
2019-02-06 09:50:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:50:20 [DEBUG   ] Finished updating board flags in 1.638 seconds
2019-02-06 09:50:26 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-02-06 09:50:46 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-02-06 09:51:06 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-02-06 09:51:12 [DEBUG   ] Got command RPT from MCS: ref #1418248
2019-02-06 09:51:12 [DEBUG   ] summary = ERROR
2019-02-06 09:51:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418248  13 58520 35472201 A  ERRORERROR'
2019-02-06 09:51:12 [DEBUG   ] Got command RPT from MCS: ref #1418249
2019-02-06 09:51:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 09:51:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418249  77 58520 35472202 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 09:51:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:51:20 [WARNING ] (13, 1, 'bot')
2019-02-06 09:51:20 [WARNING ] (13, 1, 'bot')
2019-02-06 09:51:20 [WARNING ] (13, 1, 'bot')
2019-02-06 09:51:20 [WARNING ] (13, 1, 'bot')
2019-02-06 09:51:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:51:20 [DEBUG   ] Finished updating board flags in 1.640 seconds
2019-02-06 09:51:26 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-02-06 09:51:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 09:52:06 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 09:52:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:52:20 [WARNING ] (13, 1, 'bot')
2019-02-06 09:52:20 [WARNING ] (13, 1, 'bot')
2019-02-06 09:52:20 [WARNING ] (13, 1, 'bot')
2019-02-06 09:52:20 [WARNING ] (13, 1, 'bot')
2019-02-06 09:52:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:52:20 [DEBUG   ] Finished updating board flags in 1.638 seconds
2019-02-06 09:52:26 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-06 09:52:46 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-02-06 09:53:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 09:53:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 09:53:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:53:20 [WARNING ] (13, 1, 'bot')
2019-02-06 09:53:20 [WARNING ] (13, 1, 'bot')
2019-02-06 09:53:20 [WARNING ] (13, 1, 'bot')
2019-02-06 09:53:20 [WARNING ] (13, 1, 'bot')
2019-02-06 09:53:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:53:20 [DEBUG   ] Finished updating board flags in 2.320 seconds
2019-02-06 09:53:26 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 09:53:46 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-02-06 09:54:06 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-06 09:54:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:54:20 [WARNING ] (13, 1, 'bot')
2019-02-06 09:54:20 [WARNING ] (13, 1, 'bot')
2019-02-06 09:54:20 [WARNING ] (13, 1, 'bot')
2019-02-06 09:54:20 [WARNING ] (13, 1, 'bot')
2019-02-06 09:54:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:54:20 [DEBUG   ] Finished updating board flags in 2.077 seconds
2019-02-06 09:54:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 09:54:46 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 09:55:06 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-06 09:55:09 [DEBUG   ] Got command RPT from MCS: ref #1418271
2019-02-06 09:55:09 [DEBUG   ] summary = ERROR
2019-02-06 09:55:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418271  13 58520 35709793 A  ERRORERROR'
2019-02-06 09:55:09 [DEBUG   ] Got command RPT from MCS: ref #1418272
2019-02-06 09:55:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 09:55:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418272  77 58520 35709997 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 09:55:10 [DEBUG   ] Got command RPT from MCS: ref #1418273
2019-02-06 09:55:10 [DEBUG   ] summary = ERROR
2019-02-06 09:55:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418273  13 58520 35710189 A  ERRORERROR'
2019-02-06 09:55:10 [DEBUG   ] Got command RPT from MCS: ref #1418275
2019-02-06 09:55:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 09:55:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418275  77 58520 35710393 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 09:55:10 [DEBUG   ] Got command RPT from MCS: ref #1418276
2019-02-06 09:55:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 09:55:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418276  12 58520 35710597 A  ERRORB—™š'
2019-02-06 09:55:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:55:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-02-06 09:55:20 [WARNING ] (13, 1, 'bot')
2019-02-06 09:55:20 [WARNING ] (13, 1, 'bot')
2019-02-06 09:55:20 [WARNING ] (13, 1, 'bot')
2019-02-06 09:55:20 [WARNING ] (13, 1, 'bot')
2019-02-06 09:55:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:55:20 [DEBUG   ] Finished updating board flags in 1.999 seconds
2019-02-06 09:55:26 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-02-06 09:55:47 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-02-06 09:56:07 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-02-06 09:56:12 [DEBUG   ] Got command RPT from MCS: ref #1418281
2019-02-06 09:56:12 [DEBUG   ] summary = ERROR
2019-02-06 09:56:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418281  13 58520 35772193 A  ERRORERROR'
2019-02-06 09:56:12 [DEBUG   ] Got command RPT from MCS: ref #1418282
2019-02-06 09:56:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 09:56:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418282  77 58520 35772194 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 09:56:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:56:20 [WARNING ] (13, 1, 'bot')
2019-02-06 09:56:20 [WARNING ] (13, 1, 'bot')
2019-02-06 09:56:20 [WARNING ] (13, 1, 'bot')
2019-02-06 09:56:20 [WARNING ] (13, 1, 'bot')
2019-02-06 09:56:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:56:20 [DEBUG   ] Finished updating board flags in 1.793 seconds
2019-02-06 09:56:27 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-06 09:56:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 09:57:07 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 09:57:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:57:20 [WARNING ] (13, 1, 'bot')
2019-02-06 09:57:20 [WARNING ] (13, 1, 'bot')
2019-02-06 09:57:20 [WARNING ] (13, 1, 'bot')
2019-02-06 09:57:20 [WARNING ] (13, 1, 'bot')
2019-02-06 09:57:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:57:20 [DEBUG   ] Finished updating board flags in 1.601 seconds
2019-02-06 09:57:27 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 09:57:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 09:58:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 09:58:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:58:20 [WARNING ] (13, 1, 'bot')
2019-02-06 09:58:20 [WARNING ] (13, 1, 'bot')
2019-02-06 09:58:20 [WARNING ] (13, 1, 'bot')
2019-02-06 09:58:20 [WARNING ] (13, 1, 'bot')
2019-02-06 09:58:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:58:20 [DEBUG   ] Finished updating board flags in 1.604 seconds
2019-02-06 09:58:27 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 09:58:47 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-06 09:59:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 09:59:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 09:59:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-06 09:59:20 [WARNING ] (13, 1, 'bot')
2019-02-06 09:59:20 [WARNING ] (13, 1, 'bot')
2019-02-06 09:59:20 [WARNING ] (13, 1, 'bot')
2019-02-06 09:59:20 [WARNING ] (13, 1, 'bot')
2019-02-06 09:59:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 09:59:20 [DEBUG   ] Finished updating board flags in 1.587 seconds
2019-02-06 09:59:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 09:59:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 10:00:07 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 10:00:09 [DEBUG   ] Got command RPT from MCS: ref #1418306
2019-02-06 10:00:09 [DEBUG   ] summary = ERROR
2019-02-06 10:00:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418306  13 58520 36009869 A  ERRORERROR'
2019-02-06 10:00:10 [DEBUG   ] Got command RPT from MCS: ref #1418307
2019-02-06 10:00:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 10:00:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418307  77 58520 36010073 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 10:00:10 [DEBUG   ] Got command RPT from MCS: ref #1418308
2019-02-06 10:00:10 [DEBUG   ] summary = ERROR
2019-02-06 10:00:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418308  13 58520 36010277 A  ERRORERROR'
2019-02-06 10:00:10 [DEBUG   ] Got command RPT from MCS: ref #1418309
2019-02-06 10:00:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 10:00:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418309  77 58520 36010469 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 10:00:10 [DEBUG   ] Got command RPT from MCS: ref #1418310
2019-02-06 10:00:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 10:00:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418310  12 58520 36010673 A  ERRORB—™š'
2019-02-06 10:00:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:00:20 [WARNING ] (13, 1, 'bot')
2019-02-06 10:00:20 [WARNING ] (13, 1, 'bot')
2019-02-06 10:00:20 [WARNING ] (13, 1, 'bot')
2019-02-06 10:00:20 [WARNING ] (13, 1, 'bot')
2019-02-06 10:00:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:00:20 [DEBUG   ] Finished updating board flags in 1.427 seconds
2019-02-06 10:00:27 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 10:00:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 10:01:07 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-02-06 10:01:12 [DEBUG   ] Got command RPT from MCS: ref #1418311
2019-02-06 10:01:12 [DEBUG   ] summary = ERROR
2019-02-06 10:01:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418311  13 58520 36072205 A  ERRORERROR'
2019-02-06 10:01:12 [DEBUG   ] Got command RPT from MCS: ref #1418312
2019-02-06 10:01:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 10:01:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418312  77 58520 36072206 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 10:01:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:01:20 [WARNING ] (13, 1, 'bot')
2019-02-06 10:01:20 [WARNING ] (13, 1, 'bot')
2019-02-06 10:01:20 [WARNING ] (13, 1, 'bot')
2019-02-06 10:01:20 [WARNING ] (13, 1, 'bot')
2019-02-06 10:01:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:01:20 [DEBUG   ] Finished updating board flags in 1.376 seconds
2019-02-06 10:01:27 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 10:01:48 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-02-06 10:02:08 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-02-06 10:02:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:02:20 [WARNING ] (13, 1, 'bot')
2019-02-06 10:02:20 [WARNING ] (13, 1, 'bot')
2019-02-06 10:02:20 [WARNING ] (13, 1, 'bot')
2019-02-06 10:02:20 [WARNING ] (13, 1, 'bot')
2019-02-06 10:02:20 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:02:20 [DEBUG   ] Finished updating board flags in 1.357 seconds
2019-02-06 10:02:28 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-02-06 10:02:48 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-02-06 10:03:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 10:03:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:03:21 [WARNING ] (13, 1, 'bot')
2019-02-06 10:03:21 [WARNING ] (13, 1, 'bot')
2019-02-06 10:03:21 [WARNING ] (13, 1, 'bot')
2019-02-06 10:03:21 [WARNING ] (13, 1, 'bot')
2019-02-06 10:03:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:03:21 [DEBUG   ] Finished updating board flags in 2.081 seconds
2019-02-06 10:03:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 10:03:48 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 10:04:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 10:04:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:04:21 [WARNING ] (13, 1, 'bot')
2019-02-06 10:04:21 [WARNING ] (13, 1, 'bot')
2019-02-06 10:04:21 [WARNING ] (13, 1, 'bot')
2019-02-06 10:04:21 [WARNING ] (13, 1, 'bot')
2019-02-06 10:04:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:04:21 [DEBUG   ] Finished updating board flags in 1.983 seconds
2019-02-06 10:04:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 10:04:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 10:05:08 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 10:05:09 [DEBUG   ] Got command RPT from MCS: ref #1418334
2019-02-06 10:05:09 [DEBUG   ] summary = ERROR
2019-02-06 10:05:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418334  13 58520 36309957 A  ERRORERROR'
2019-02-06 10:05:10 [DEBUG   ] Got command RPT from MCS: ref #1418335
2019-02-06 10:05:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 10:05:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418335  77 58520 36310149 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 10:05:10 [DEBUG   ] Got command RPT from MCS: ref #1418336
2019-02-06 10:05:10 [DEBUG   ] summary = ERROR
2019-02-06 10:05:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418336  13 58520 36310353 A  ERRORERROR'
2019-02-06 10:05:10 [DEBUG   ] Got command RPT from MCS: ref #1418338
2019-02-06 10:05:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 10:05:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418338  77 58520 36310557 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 10:05:10 [DEBUG   ] Got command RPT from MCS: ref #1418339
2019-02-06 10:05:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 10:05:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418339  12 58520 36310761 A  ERRORB˜™š'
2019-02-06 10:05:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 10:05:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:05:21 [WARNING ] (13, 1, 'bot')
2019-02-06 10:05:21 [WARNING ] (13, 1, 'bot')
2019-02-06 10:05:21 [WARNING ] (13, 1, 'bot')
2019-02-06 10:05:21 [WARNING ] (13, 1, 'bot')
2019-02-06 10:05:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:05:21 [DEBUG   ] Finished updating board flags in 1.790 seconds
2019-02-06 10:05:28 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-06 10:05:49 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-02-06 10:06:09 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-02-06 10:06:12 [DEBUG   ] Got command RPT from MCS: ref #1418348
2019-02-06 10:06:12 [DEBUG   ] summary = ERROR
2019-02-06 10:06:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418348  13 58520 36372201 A  ERRORERROR'
2019-02-06 10:06:12 [DEBUG   ] Got command RPT from MCS: ref #1418349
2019-02-06 10:06:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 10:06:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418349  77 58520 36372202 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 10:06:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:06:21 [WARNING ] (13, 1, 'bot')
2019-02-06 10:06:21 [WARNING ] (13, 1, 'bot')
2019-02-06 10:06:21 [WARNING ] (13, 1, 'bot')
2019-02-06 10:06:21 [WARNING ] (13, 1, 'bot')
2019-02-06 10:06:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:06:21 [DEBUG   ] Finished updating board flags in 1.613 seconds
2019-02-06 10:06:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 10:06:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 10:07:09 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 10:07:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:07:21 [WARNING ] (13, 1, 'bot')
2019-02-06 10:07:21 [WARNING ] (13, 1, 'bot')
2019-02-06 10:07:21 [WARNING ] (13, 1, 'bot')
2019-02-06 10:07:21 [WARNING ] (13, 1, 'bot')
2019-02-06 10:07:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:07:21 [DEBUG   ] Finished updating board flags in 1.611 seconds
2019-02-06 10:07:29 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 10:07:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 10:08:09 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 10:08:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:08:21 [WARNING ] (13, 1, 'bot')
2019-02-06 10:08:21 [WARNING ] (13, 1, 'bot')
2019-02-06 10:08:21 [WARNING ] (13, 1, 'bot')
2019-02-06 10:08:21 [WARNING ] (13, 1, 'bot')
2019-02-06 10:08:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:08:21 [DEBUG   ] Finished updating board flags in 1.588 seconds
2019-02-06 10:08:29 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-06 10:08:49 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-06 10:09:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 10:09:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:09:21 [WARNING ] (13, 1, 'bot')
2019-02-06 10:09:21 [WARNING ] (13, 1, 'bot')
2019-02-06 10:09:21 [WARNING ] (13, 1, 'bot')
2019-02-06 10:09:21 [WARNING ] (13, 1, 'bot')
2019-02-06 10:09:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:09:21 [DEBUG   ] Finished updating board flags in 1.408 seconds
2019-02-06 10:09:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 10:09:49 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 10:10:09 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2019-02-06 10:10:10 [DEBUG   ] Got command RPT from MCS: ref #1418369
2019-02-06 10:10:10 [DEBUG   ] summary = ERROR
2019-02-06 10:10:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418369  13 58520 36610033 A  ERRORERROR'
2019-02-06 10:10:10 [DEBUG   ] Got command RPT from MCS: ref #1418370
2019-02-06 10:10:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 10:10:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418370  77 58520 36610237 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 10:10:10 [DEBUG   ] Got command RPT from MCS: ref #1418371
2019-02-06 10:10:10 [DEBUG   ] summary = ERROR
2019-02-06 10:10:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418371  13 58520 36610429 A  ERRORERROR'
2019-02-06 10:10:10 [DEBUG   ] Got command RPT from MCS: ref #1418372
2019-02-06 10:10:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 10:10:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418372  77 58520 36610633 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 10:10:10 [DEBUG   ] Got command RPT from MCS: ref #1418373
2019-02-06 10:10:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 10:10:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418373  12 58520 36610837 A  ERRORB–™š'
2019-02-06 10:10:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:10:21 [WARNING ] (13, 1, 'bot')
2019-02-06 10:10:21 [WARNING ] (13, 1, 'bot')
2019-02-06 10:10:21 [WARNING ] (13, 1, 'bot')
2019-02-06 10:10:21 [WARNING ] (13, 1, 'bot')
2019-02-06 10:10:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:10:21 [DEBUG   ] Finished updating board flags in 1.411 seconds
2019-02-06 10:10:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 10:10:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 10:11:09 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 10:11:12 [DEBUG   ] Got command RPT from MCS: ref #1418374
2019-02-06 10:11:12 [DEBUG   ] summary = ERROR
2019-02-06 10:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418374  13 58520 36672197 A  ERRORERROR'
2019-02-06 10:11:12 [DEBUG   ] Got command RPT from MCS: ref #1418375
2019-02-06 10:11:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 10:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418375  77 58520 36672198 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 10:11:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:11:21 [WARNING ] (13, 1, 'bot')
2019-02-06 10:11:21 [WARNING ] (13, 1, 'bot')
2019-02-06 10:11:21 [WARNING ] (13, 1, 'bot')
2019-02-06 10:11:21 [WARNING ] (13, 1, 'bot')
2019-02-06 10:11:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:11:21 [DEBUG   ] Finished updating board flags in 1.391 seconds
2019-02-06 10:11:29 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 10:11:50 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-02-06 10:12:10 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-02-06 10:12:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:12:21 [WARNING ] (13, 1, 'bot')
2019-02-06 10:12:21 [WARNING ] (13, 1, 'bot')
2019-02-06 10:12:21 [WARNING ] (13, 1, 'bot')
2019-02-06 10:12:21 [WARNING ] (13, 1, 'bot')
2019-02-06 10:12:21 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:12:21 [DEBUG   ] Finished updating board flags in 1.353 seconds
2019-02-06 10:12:30 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-02-06 10:12:50 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 10:13:10 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 10:13:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:13:22 [WARNING ] (13, 1, 'bot')
2019-02-06 10:13:22 [WARNING ] (13, 1, 'bot')
2019-02-06 10:13:22 [WARNING ] (13, 1, 'bot')
2019-02-06 10:13:22 [WARNING ] (13, 1, 'bot')
2019-02-06 10:13:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:13:22 [DEBUG   ] Finished updating board flags in 2.060 seconds
2019-02-06 10:13:30 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-06 10:13:50 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-02-06 10:14:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 10:14:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:14:22 [WARNING ] (13, 1, 'bot')
2019-02-06 10:14:22 [WARNING ] (13, 1, 'bot')
2019-02-06 10:14:22 [WARNING ] (13, 1, 'bot')
2019-02-06 10:14:22 [WARNING ] (13, 1, 'bot')
2019-02-06 10:14:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:14:22 [DEBUG   ] Finished updating board flags in 2.000 seconds
2019-02-06 10:14:30 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 10:14:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 10:15:10 [DEBUG   ] Got command RPT from MCS: ref #1418401
2019-02-06 10:15:10 [DEBUG   ] summary = ERROR
2019-02-06 10:15:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418401  13 58520 36910109 A  ERRORERROR'
2019-02-06 10:15:10 [DEBUG   ] Got command RPT from MCS: ref #1418402
2019-02-06 10:15:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 10:15:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418402  77 58520 36910313 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 10:15:10 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 10:15:10 [DEBUG   ] Got command RPT from MCS: ref #1418403
2019-02-06 10:15:10 [DEBUG   ] summary = ERROR
2019-02-06 10:15:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418403  13 58520 36910517 A  ERRORERROR'
2019-02-06 10:15:10 [DEBUG   ] Got command RPT from MCS: ref #1418405
2019-02-06 10:15:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 10:15:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418405  77 58520 36910709 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 10:15:10 [DEBUG   ] Got command RPT from MCS: ref #1418406
2019-02-06 10:15:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 10:15:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418406  12 58520 36910913 A  ERRORB—™š'
2019-02-06 10:15:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:15:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2019-02-06 10:15:22 [WARNING ] (13, 1, 'bot')
2019-02-06 10:15:22 [WARNING ] (13, 1, 'bot')
2019-02-06 10:15:22 [WARNING ] (13, 1, 'bot')
2019-02-06 10:15:22 [WARNING ] (13, 1, 'bot')
2019-02-06 10:15:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:15:22 [DEBUG   ] Finished updating board flags in 2.005 seconds
2019-02-06 10:15:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 10:15:50 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 10:16:10 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-06 10:16:12 [DEBUG   ] Got command RPT from MCS: ref #1418411
2019-02-06 10:16:12 [DEBUG   ] summary = ERROR
2019-02-06 10:16:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418411  13 58520 36972201 A  ERRORERROR'
2019-02-06 10:16:12 [DEBUG   ] Got command RPT from MCS: ref #1418412
2019-02-06 10:16:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 10:16:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418412  77 58520 36972202 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 10:16:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:16:22 [WARNING ] (13, 1, 'bot')
2019-02-06 10:16:22 [WARNING ] (13, 1, 'bot')
2019-02-06 10:16:22 [WARNING ] (13, 1, 'bot')
2019-02-06 10:16:22 [WARNING ] (13, 1, 'bot')
2019-02-06 10:16:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:16:22 [DEBUG   ] Finished updating board flags in 2.018 seconds
2019-02-06 10:16:30 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 10:16:50 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-06 10:17:11 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-02-06 10:17:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:17:22 [WARNING ] (13, 1, 'bot')
2019-02-06 10:17:22 [WARNING ] (13, 1, 'bot')
2019-02-06 10:17:22 [WARNING ] (13, 1, 'bot')
2019-02-06 10:17:22 [WARNING ] (13, 1, 'bot')
2019-02-06 10:17:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:17:22 [DEBUG   ] Finished updating board flags in 1.974 seconds
2019-02-06 10:17:31 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-06 10:17:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 10:18:11 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-02-06 10:18:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:18:22 [WARNING ] (13, 1, 'bot')
2019-02-06 10:18:22 [WARNING ] (13, 1, 'bot')
2019-02-06 10:18:22 [WARNING ] (13, 1, 'bot')
2019-02-06 10:18:22 [WARNING ] (13, 1, 'bot')
2019-02-06 10:18:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:18:22 [DEBUG   ] Finished updating board flags in 1.820 seconds
2019-02-06 10:18:31 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 10:18:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 10:19:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 10:19:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:19:22 [WARNING ] (13, 1, 'bot')
2019-02-06 10:19:22 [WARNING ] (13, 1, 'bot')
2019-02-06 10:19:22 [WARNING ] (13, 1, 'bot')
2019-02-06 10:19:22 [WARNING ] (13, 1, 'bot')
2019-02-06 10:19:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:19:22 [DEBUG   ] Finished updating board flags in 1.787 seconds
2019-02-06 10:19:31 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 10:19:51 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-06 10:20:10 [DEBUG   ] Got command RPT from MCS: ref #1418432
2019-02-06 10:20:10 [DEBUG   ] summary = ERROR
2019-02-06 10:20:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418432  13 58520 37210197 A  ERRORERROR'
2019-02-06 10:20:10 [DEBUG   ] Got command RPT from MCS: ref #1418433
2019-02-06 10:20:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 10:20:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418433  77 58520 37210389 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 10:20:10 [DEBUG   ] Got command RPT from MCS: ref #1418434
2019-02-06 10:20:10 [DEBUG   ] summary = ERROR
2019-02-06 10:20:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418434  13 58520 37210593 A  ERRORERROR'
2019-02-06 10:20:10 [DEBUG   ] Got command RPT from MCS: ref #1418435
2019-02-06 10:20:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 10:20:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418435  77 58520 37210797 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 10:20:11 [DEBUG   ] Got command RPT from MCS: ref #1418436
2019-02-06 10:20:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 10:20:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418436  12 58520 37211001 A  ERRORB˜™š'
2019-02-06 10:20:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 10:20:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:20:22 [WARNING ] (13, 1, 'bot')
2019-02-06 10:20:22 [WARNING ] (13, 1, 'bot')
2019-02-06 10:20:22 [WARNING ] (13, 1, 'bot')
2019-02-06 10:20:22 [WARNING ] (13, 1, 'bot')
2019-02-06 10:20:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:20:22 [DEBUG   ] Finished updating board flags in 1.620 seconds
2019-02-06 10:20:31 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 10:20:51 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-06 10:21:11 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 10:21:12 [DEBUG   ] Got command RPT from MCS: ref #1418441
2019-02-06 10:21:12 [DEBUG   ] summary = ERROR
2019-02-06 10:21:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418441  13 58520 37272197 A  ERRORERROR'
2019-02-06 10:21:12 [DEBUG   ] Got command RPT from MCS: ref #1418442
2019-02-06 10:21:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 10:21:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418442  77 58520 37272198 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 10:21:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:21:22 [WARNING ] (13, 1, 'bot')
2019-02-06 10:21:22 [WARNING ] (13, 1, 'bot')
2019-02-06 10:21:22 [WARNING ] (13, 1, 'bot')
2019-02-06 10:21:22 [WARNING ] (13, 1, 'bot')
2019-02-06 10:21:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:21:22 [DEBUG   ] Finished updating board flags in 1.593 seconds
2019-02-06 10:21:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 10:21:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 10:22:11 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 10:22:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:22:22 [WARNING ] (13, 1, 'bot')
2019-02-06 10:22:22 [WARNING ] (13, 1, 'bot')
2019-02-06 10:22:22 [WARNING ] (13, 1, 'bot')
2019-02-06 10:22:22 [WARNING ] (13, 1, 'bot')
2019-02-06 10:22:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:22:22 [DEBUG   ] Finished updating board flags in 1.414 seconds
2019-02-06 10:22:31 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-02-06 10:22:51 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-06 10:23:12 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-02-06 10:23:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:23:22 [WARNING ] (13, 1, 'bot')
2019-02-06 10:23:22 [WARNING ] (13, 1, 'bot')
2019-02-06 10:23:22 [WARNING ] (13, 1, 'bot')
2019-02-06 10:23:22 [WARNING ] (13, 1, 'bot')
2019-02-06 10:23:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:23:22 [DEBUG   ] Finished updating board flags in 1.381 seconds
2019-02-06 10:23:32 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-02-06 10:23:52 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-06 10:24:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 10:24:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:24:22 [WARNING ] (13, 1, 'bot')
2019-02-06 10:24:22 [WARNING ] (13, 1, 'bot')
2019-02-06 10:24:22 [WARNING ] (13, 1, 'bot')
2019-02-06 10:24:22 [WARNING ] (13, 1, 'bot')
2019-02-06 10:24:22 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:24:22 [DEBUG   ] Finished updating board flags in 1.362 seconds
2019-02-06 10:24:32 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 10:24:52 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 10:25:10 [DEBUG   ] Got command RPT from MCS: ref #1418464
2019-02-06 10:25:10 [DEBUG   ] summary = ERROR
2019-02-06 10:25:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418464  13 58520 37510277 A  ERRORERROR'
2019-02-06 10:25:10 [DEBUG   ] Got command RPT from MCS: ref #1418465
2019-02-06 10:25:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 10:25:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418465  77 58520 37510469 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 10:25:10 [DEBUG   ] Got command RPT from MCS: ref #1418466
2019-02-06 10:25:10 [DEBUG   ] summary = ERROR
2019-02-06 10:25:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418466  13 58520 37510673 A  ERRORERROR'
2019-02-06 10:25:10 [DEBUG   ] Got command RPT from MCS: ref #1418468
2019-02-06 10:25:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 10:25:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418468  77 58520 37510877 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 10:25:11 [DEBUG   ] Got command RPT from MCS: ref #1418469
2019-02-06 10:25:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 10:25:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418469  12 58520 37511069 A  ERRORB–™š'
2019-02-06 10:25:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 10:25:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:25:23 [WARNING ] (13, 1, 'bot')
2019-02-06 10:25:23 [WARNING ] (13, 1, 'bot')
2019-02-06 10:25:23 [WARNING ] (13, 1, 'bot')
2019-02-06 10:25:23 [WARNING ] (13, 1, 'bot')
2019-02-06 10:25:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:25:23 [DEBUG   ] Finished updating board flags in 2.048 seconds
2019-02-06 10:25:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 10:25:52 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 10:26:12 [DEBUG   ] Got command RPT from MCS: ref #1418474
2019-02-06 10:26:12 [DEBUG   ] summary = ERROR
2019-02-06 10:26:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418474  13 58520 37572205 A  ERRORERROR'
2019-02-06 10:26:12 [DEBUG   ] Got command RPT from MCS: ref #1418475
2019-02-06 10:26:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 10:26:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418475  77 58520 37572206 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 10:26:12 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-06 10:26:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:26:23 [WARNING ] (13, 1, 'bot')
2019-02-06 10:26:23 [WARNING ] (13, 1, 'bot')
2019-02-06 10:26:23 [WARNING ] (13, 1, 'bot')
2019-02-06 10:26:23 [WARNING ] (13, 1, 'bot')
2019-02-06 10:26:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:26:23 [DEBUG   ] Finished updating board flags in 2.013 seconds
2019-02-06 10:26:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 10:26:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 10:27:12 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-02-06 10:27:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:27:23 [WARNING ] (13, 1, 'bot')
2019-02-06 10:27:23 [WARNING ] (13, 1, 'bot')
2019-02-06 10:27:23 [WARNING ] (13, 1, 'bot')
2019-02-06 10:27:23 [WARNING ] (13, 1, 'bot')
2019-02-06 10:27:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:27:23 [DEBUG   ] Finished updating board flags in 1.987 seconds
2019-02-06 10:27:32 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 10:27:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 10:28:12 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 10:28:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:28:23 [WARNING ] (13, 1, 'bot')
2019-02-06 10:28:23 [WARNING ] (13, 1, 'bot')
2019-02-06 10:28:23 [WARNING ] (13, 1, 'bot')
2019-02-06 10:28:23 [WARNING ] (13, 1, 'bot')
2019-02-06 10:28:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:28:23 [DEBUG   ] Finished updating board flags in 1.802 seconds
2019-02-06 10:28:32 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-06 10:28:52 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 10:29:13 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-02-06 10:29:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:29:23 [WARNING ] (13, 1, 'bot')
2019-02-06 10:29:23 [WARNING ] (13, 1, 'bot')
2019-02-06 10:29:23 [WARNING ] (13, 1, 'bot')
2019-02-06 10:29:23 [WARNING ] (13, 1, 'bot')
2019-02-06 10:29:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:29:23 [DEBUG   ] Finished updating board flags in 1.810 seconds
2019-02-06 10:29:33 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-02-06 10:29:53 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 10:30:10 [DEBUG   ] Got command RPT from MCS: ref #1418499
2019-02-06 10:30:10 [DEBUG   ] summary = ERROR
2019-02-06 10:30:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418499  13 58520 37810353 A  ERRORERROR'
2019-02-06 10:30:10 [DEBUG   ] Got command RPT from MCS: ref #1418500
2019-02-06 10:30:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 10:30:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418500  77 58520 37810557 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 10:30:10 [DEBUG   ] Got command RPT from MCS: ref #1418501
2019-02-06 10:30:10 [DEBUG   ] summary = ERROR
2019-02-06 10:30:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418501  13 58520 37810761 A  ERRORERROR'
2019-02-06 10:30:10 [DEBUG   ] Got command RPT from MCS: ref #1418502
2019-02-06 10:30:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 10:30:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418502  77 58520 37810953 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 10:30:11 [DEBUG   ] Got command RPT from MCS: ref #1418503
2019-02-06 10:30:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 10:30:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418503  12 58520 37811158 A  ERRORB—™š'
2019-02-06 10:30:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 10:30:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:30:23 [WARNING ] (13, 1, 'bot')
2019-02-06 10:30:23 [WARNING ] (13, 1, 'bot')
2019-02-06 10:30:23 [WARNING ] (13, 1, 'bot')
2019-02-06 10:30:23 [WARNING ] (13, 1, 'bot')
2019-02-06 10:30:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:30:23 [DEBUG   ] Finished updating board flags in 1.788 seconds
2019-02-06 10:30:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 10:30:53 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-02-06 10:31:12 [DEBUG   ] Got command RPT from MCS: ref #1418504
2019-02-06 10:31:12 [DEBUG   ] summary = ERROR
2019-02-06 10:31:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418504  13 58520 37872201 A  ERRORERROR'
2019-02-06 10:31:12 [DEBUG   ] Got command RPT from MCS: ref #1418505
2019-02-06 10:31:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 10:31:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418505  77 58520 37872202 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 10:31:13 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-06 10:31:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:31:23 [WARNING ] (13, 1, 'bot')
2019-02-06 10:31:23 [WARNING ] (13, 1, 'bot')
2019-02-06 10:31:23 [WARNING ] (13, 1, 'bot')
2019-02-06 10:31:23 [WARNING ] (13, 1, 'bot')
2019-02-06 10:31:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:31:23 [DEBUG   ] Finished updating board flags in 1.624 seconds
2019-02-06 10:31:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 10:31:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 10:32:13 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 10:32:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 10:32:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:32:23 [WARNING ] (13, 1, 'bot')
2019-02-06 10:32:23 [WARNING ] (13, 1, 'bot')
2019-02-06 10:32:23 [WARNING ] (13, 1, 'bot')
2019-02-06 10:32:23 [WARNING ] (13, 1, 'bot')
2019-02-06 10:32:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:32:23 [DEBUG   ] Finished updating board flags in 1.592 seconds
2019-02-06 10:32:33 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2019-02-06 10:32:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 10:33:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 10:33:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:33:23 [WARNING ] (13, 1, 'bot')
2019-02-06 10:33:23 [WARNING ] (13, 1, 'bot')
2019-02-06 10:33:23 [WARNING ] (13, 1, 'bot')
2019-02-06 10:33:23 [WARNING ] (13, 1, 'bot')
2019-02-06 10:33:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:33:23 [DEBUG   ] Finished updating board flags in 1.397 seconds
2019-02-06 10:33:33 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 10:33:53 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 10:34:14 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-02-06 10:34:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:34:23 [WARNING ] (13, 1, 'bot')
2019-02-06 10:34:23 [WARNING ] (13, 1, 'bot')
2019-02-06 10:34:23 [WARNING ] (13, 1, 'bot')
2019-02-06 10:34:23 [WARNING ] (13, 1, 'bot')
2019-02-06 10:34:23 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:34:23 [DEBUG   ] Finished updating board flags in 1.369 seconds
2019-02-06 10:34:34 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-02-06 10:34:54 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-02-06 10:35:10 [DEBUG   ] Got command RPT from MCS: ref #1418527
2019-02-06 10:35:10 [DEBUG   ] summary = ERROR
2019-02-06 10:35:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418527  13 58520 38110437 A  ERRORERROR'
2019-02-06 10:35:10 [DEBUG   ] Got command RPT from MCS: ref #1418528
2019-02-06 10:35:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 10:35:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418528  77 58520 38110629 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 10:35:10 [DEBUG   ] Got command RPT from MCS: ref #1418529
2019-02-06 10:35:10 [DEBUG   ] summary = ERROR
2019-02-06 10:35:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418529  13 58520 38110833 A  ERRORERROR'
2019-02-06 10:35:11 [DEBUG   ] Got command RPT from MCS: ref #1418531
2019-02-06 10:35:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 10:35:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418531  77 58520 38111037 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 10:35:11 [DEBUG   ] Got command RPT from MCS: ref #1418533
2019-02-06 10:35:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 10:35:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418533  12 58520 38111241 A  ERRORB—™š'
2019-02-06 10:35:14 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 10:35:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:35:24 [WARNING ] (13, 1, 'bot')
2019-02-06 10:35:24 [WARNING ] (13, 1, 'bot')
2019-02-06 10:35:24 [WARNING ] (13, 1, 'bot')
2019-02-06 10:35:24 [WARNING ] (13, 1, 'bot')
2019-02-06 10:35:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:35:24 [DEBUG   ] Finished updating board flags in 2.042 seconds
2019-02-06 10:35:34 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 10:35:54 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-06 10:36:12 [DEBUG   ] Got command RPT from MCS: ref #1418541
2019-02-06 10:36:12 [DEBUG   ] summary = ERROR
2019-02-06 10:36:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418541  13 58520 38172386 A  ERRORERROR'
2019-02-06 10:36:12 [DEBUG   ] Got command RPT from MCS: ref #1418542
2019-02-06 10:36:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 10:36:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418542  77 58520 38172387 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 10:36:14 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-02-06 10:36:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:36:24 [WARNING ] (13, 1, 'bot')
2019-02-06 10:36:24 [WARNING ] (13, 1, 'bot')
2019-02-06 10:36:24 [WARNING ] (13, 1, 'bot')
2019-02-06 10:36:24 [WARNING ] (13, 1, 'bot')
2019-02-06 10:36:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:36:24 [DEBUG   ] Finished updating board flags in 2.092 seconds
2019-02-06 10:36:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 10:36:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 10:37:14 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-02-06 10:37:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:37:24 [WARNING ] (13, 1, 'bot')
2019-02-06 10:37:24 [WARNING ] (13, 1, 'bot')
2019-02-06 10:37:24 [WARNING ] (13, 1, 'bot')
2019-02-06 10:37:24 [WARNING ] (13, 1, 'bot')
2019-02-06 10:37:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:37:24 [DEBUG   ] Finished updating board flags in 1.907 seconds
2019-02-06 10:37:34 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-06 10:37:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 10:38:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 10:38:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:38:24 [WARNING ] (13, 1, 'bot')
2019-02-06 10:38:24 [WARNING ] (13, 1, 'bot')
2019-02-06 10:38:24 [WARNING ] (13, 1, 'bot')
2019-02-06 10:38:24 [WARNING ] (13, 1, 'bot')
2019-02-06 10:38:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:38:24 [DEBUG   ] Finished updating board flags in 1.801 seconds
2019-02-06 10:38:34 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 10:38:54 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-02-06 10:39:14 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-06 10:39:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:39:24 [WARNING ] (13, 1, 'bot')
2019-02-06 10:39:24 [WARNING ] (13, 1, 'bot')
2019-02-06 10:39:24 [WARNING ] (13, 1, 'bot')
2019-02-06 10:39:24 [WARNING ] (13, 1, 'bot')
2019-02-06 10:39:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:39:24 [DEBUG   ] Finished updating board flags in 1.804 seconds
2019-02-06 10:39:35 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-02-06 10:39:55 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-06 10:40:10 [DEBUG   ] Got command RPT from MCS: ref #1418562
2019-02-06 10:40:10 [DEBUG   ] summary = ERROR
2019-02-06 10:40:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418562  13 58520 38410513 A  ERRORERROR'
2019-02-06 10:40:10 [DEBUG   ] Got command RPT from MCS: ref #1418563
2019-02-06 10:40:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 10:40:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418563  77 58520 38410717 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 10:40:10 [DEBUG   ] Got command RPT from MCS: ref #1418564
2019-02-06 10:40:10 [DEBUG   ] summary = ERROR
2019-02-06 10:40:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418564  13 58520 38410909 A  ERRORERROR'
2019-02-06 10:40:11 [DEBUG   ] Got command RPT from MCS: ref #1418565
2019-02-06 10:40:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 10:40:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418565  77 58520 38411117 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 10:40:11 [DEBUG   ] Got command RPT from MCS: ref #1418566
2019-02-06 10:40:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 10:40:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418566  12 58520 38411321 A  ERRORB–™š'
2019-02-06 10:40:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 10:40:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:40:24 [WARNING ] (13, 1, 'bot')
2019-02-06 10:40:24 [WARNING ] (13, 1, 'bot')
2019-02-06 10:40:24 [WARNING ] (13, 1, 'bot')
2019-02-06 10:40:24 [WARNING ] (13, 1, 'bot')
2019-02-06 10:40:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:40:24 [DEBUG   ] Finished updating board flags in 1.797 seconds
2019-02-06 10:40:35 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-02-06 10:40:55 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 10:41:12 [DEBUG   ] Got command RPT from MCS: ref #1418567
2019-02-06 10:41:12 [DEBUG   ] summary = ERROR
2019-02-06 10:41:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418567  13 58520 38472213 A  ERRORERROR'
2019-02-06 10:41:12 [DEBUG   ] Got command RPT from MCS: ref #1418568
2019-02-06 10:41:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 10:41:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418568  77 58520 38472214 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 10:41:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 10:41:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:41:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-06 10:41:24 [WARNING ] (13, 1, 'bot')
2019-02-06 10:41:24 [WARNING ] (13, 1, 'bot')
2019-02-06 10:41:24 [WARNING ] (13, 1, 'bot')
2019-02-06 10:41:24 [WARNING ] (13, 1, 'bot')
2019-02-06 10:41:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:41:24 [DEBUG   ] Finished updating board flags in 1.601 seconds
2019-02-06 10:41:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 10:41:55 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-02-06 10:42:15 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-06 10:42:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:42:24 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-06 10:42:24 [WARNING ] (13, 1, 'bot')
2019-02-06 10:42:24 [WARNING ] (13, 1, 'bot')
2019-02-06 10:42:24 [WARNING ] (13, 1, 'bot')
2019-02-06 10:42:24 [WARNING ] (13, 1, 'bot')
2019-02-06 10:42:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:42:24 [DEBUG   ] Finished updating board flags in 1.614 seconds
2019-02-06 10:42:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 10:42:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 10:43:15 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-02-06 10:43:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:43:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-06 10:43:24 [WARNING ] (13, 1, 'bot')
2019-02-06 10:43:24 [WARNING ] (13, 1, 'bot')
2019-02-06 10:43:24 [WARNING ] (13, 1, 'bot')
2019-02-06 10:43:24 [WARNING ] (13, 1, 'bot')
2019-02-06 10:43:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:43:24 [DEBUG   ] Finished updating board flags in 1.582 seconds
2019-02-06 10:43:35 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 10:43:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 10:44:15 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 10:44:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:44:24 [WARNING ] (13, 1, 'bot')
2019-02-06 10:44:24 [WARNING ] (13, 1, 'bot')
2019-02-06 10:44:24 [WARNING ] (13, 1, 'bot')
2019-02-06 10:44:24 [WARNING ] (13, 1, 'bot')
2019-02-06 10:44:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:44:24 [DEBUG   ] Finished updating board flags in 1.419 seconds
2019-02-06 10:44:35 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 10:44:55 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 10:45:10 [DEBUG   ] Got command RPT from MCS: ref #1418594
2019-02-06 10:45:10 [DEBUG   ] summary = ERROR
2019-02-06 10:45:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418594  13 58520 38710597 A  ERRORERROR'
2019-02-06 10:45:10 [DEBUG   ] Got command RPT from MCS: ref #1418595
2019-02-06 10:45:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 10:45:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418595  77 58520 38710789 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 10:45:10 [DEBUG   ] Got command RPT from MCS: ref #1418596
2019-02-06 10:45:10 [DEBUG   ] summary = ERROR
2019-02-06 10:45:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418596  13 58520 38710993 A  ERRORERROR'
2019-02-06 10:45:11 [DEBUG   ] Got command RPT from MCS: ref #1418598
2019-02-06 10:45:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 10:45:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418598  77 58520 38711197 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 10:45:11 [DEBUG   ] Got command RPT from MCS: ref #1418599
2019-02-06 10:45:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 10:45:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418599  12 58520 38711401 A  ERRORB˜™š'
2019-02-06 10:45:15 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-06 10:45:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:45:24 [WARNING ] (13, 1, 'bot')
2019-02-06 10:45:24 [WARNING ] (13, 1, 'bot')
2019-02-06 10:45:24 [WARNING ] (13, 1, 'bot')
2019-02-06 10:45:24 [WARNING ] (13, 1, 'bot')
2019-02-06 10:45:24 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:45:24 [DEBUG   ] Finished updating board flags in 1.397 seconds
2019-02-06 10:45:36 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-02-06 10:45:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 10:46:12 [DEBUG   ] Got command RPT from MCS: ref #1418604
2019-02-06 10:46:12 [DEBUG   ] summary = ERROR
2019-02-06 10:46:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418604  13 58520 38772294 A  ERRORERROR'
2019-02-06 10:46:12 [DEBUG   ] Got command RPT from MCS: ref #1418605
2019-02-06 10:46:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 10:46:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418605  77 58520 38772294 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 10:46:16 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 10:46:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:46:25 [WARNING ] (13, 1, 'bot')
2019-02-06 10:46:25 [WARNING ] (13, 1, 'bot')
2019-02-06 10:46:25 [WARNING ] (13, 1, 'bot')
2019-02-06 10:46:25 [WARNING ] (13, 1, 'bot')
2019-02-06 10:46:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:46:25 [DEBUG   ] Finished updating board flags in 2.200 seconds
2019-02-06 10:46:36 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 10:46:56 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 10:47:16 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-02-06 10:47:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:47:25 [WARNING ] (13, 1, 'bot')
2019-02-06 10:47:25 [WARNING ] (13, 1, 'bot')
2019-02-06 10:47:25 [WARNING ] (13, 1, 'bot')
2019-02-06 10:47:25 [WARNING ] (13, 1, 'bot')
2019-02-06 10:47:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:47:25 [DEBUG   ] Finished updating board flags in 1.999 seconds
2019-02-06 10:47:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 10:47:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 10:48:16 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-02-06 10:48:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:48:25 [WARNING ] (13, 1, 'bot')
2019-02-06 10:48:25 [WARNING ] (13, 1, 'bot')
2019-02-06 10:48:25 [WARNING ] (13, 1, 'bot')
2019-02-06 10:48:25 [WARNING ] (13, 1, 'bot')
2019-02-06 10:48:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:48:25 [DEBUG   ] Finished updating board flags in 1.806 seconds
2019-02-06 10:48:36 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 10:48:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 10:49:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 10:49:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:49:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-06 10:49:25 [WARNING ] (13, 1, 'bot')
2019-02-06 10:49:25 [WARNING ] (13, 1, 'bot')
2019-02-06 10:49:25 [WARNING ] (13, 1, 'bot')
2019-02-06 10:49:25 [WARNING ] (13, 1, 'bot')
2019-02-06 10:49:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:49:25 [DEBUG   ] Finished updating board flags in 1.795 seconds
2019-02-06 10:49:36 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 10:49:56 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 10:50:10 [DEBUG   ] Got command RPT from MCS: ref #1418625
2019-02-06 10:50:10 [DEBUG   ] summary = ERROR
2019-02-06 10:50:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418625  13 58520 39010673 A  ERRORERROR'
2019-02-06 10:50:10 [DEBUG   ] Got command RPT from MCS: ref #1418626
2019-02-06 10:50:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 10:50:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418626  77 58520 39010877 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 10:50:11 [DEBUG   ] Got command RPT from MCS: ref #1418627
2019-02-06 10:50:11 [DEBUG   ] summary = ERROR
2019-02-06 10:50:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418627  13 58520 39011081 A  ERRORERROR'
2019-02-06 10:50:11 [DEBUG   ] Got command RPT from MCS: ref #1418628
2019-02-06 10:50:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 10:50:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418628  77 58520 39011273 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 10:50:11 [DEBUG   ] Got command RPT from MCS: ref #1418629
2019-02-06 10:50:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 10:50:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418629  12 58520 39011477 A  ERRORB—™š'
2019-02-06 10:50:16 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2019-02-06 10:50:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:50:25 [WARNING ] (13, 1, 'bot')
2019-02-06 10:50:25 [WARNING ] (13, 1, 'bot')
2019-02-06 10:50:25 [WARNING ] (13, 1, 'bot')
2019-02-06 10:50:25 [WARNING ] (13, 1, 'bot')
2019-02-06 10:50:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:50:25 [DEBUG   ] Finished updating board flags in 1.616 seconds
2019-02-06 10:50:37 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-02-06 10:50:56 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2019-02-06 10:51:12 [DEBUG   ] Got command RPT from MCS: ref #1418634
2019-02-06 10:51:12 [DEBUG   ] summary = ERROR
2019-02-06 10:51:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418634  13 58520 39072209 A  ERRORERROR'
2019-02-06 10:51:12 [DEBUG   ] Got command RPT from MCS: ref #1418635
2019-02-06 10:51:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 10:51:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418635  77 58520 39072210 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 10:51:17 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-02-06 10:51:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:51:25 [WARNING ] (13, 1, 'bot')
2019-02-06 10:51:25 [WARNING ] (13, 1, 'bot')
2019-02-06 10:51:25 [WARNING ] (13, 1, 'bot')
2019-02-06 10:51:25 [WARNING ] (13, 1, 'bot')
2019-02-06 10:51:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:51:25 [DEBUG   ] Finished updating board flags in 1.594 seconds
2019-02-06 10:51:37 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-06 10:51:57 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 10:52:17 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 10:52:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:52:25 [WARNING ] (13, 1, 'bot')
2019-02-06 10:52:25 [WARNING ] (13, 1, 'bot')
2019-02-06 10:52:25 [WARNING ] (13, 1, 'bot')
2019-02-06 10:52:25 [WARNING ] (13, 1, 'bot')
2019-02-06 10:52:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:52:25 [DEBUG   ] Finished updating board flags in 1.409 seconds
2019-02-06 10:52:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 10:52:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 10:53:17 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-02-06 10:53:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:53:25 [WARNING ] (13, 1, 'bot')
2019-02-06 10:53:25 [WARNING ] (13, 1, 'bot')
2019-02-06 10:53:25 [WARNING ] (13, 1, 'bot')
2019-02-06 10:53:25 [WARNING ] (13, 1, 'bot')
2019-02-06 10:53:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:53:25 [DEBUG   ] Finished updating board flags in 1.388 seconds
2019-02-06 10:53:37 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-06 10:53:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 10:54:17 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-02-06 10:54:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:54:25 [WARNING ] (13, 1, 'bot')
2019-02-06 10:54:25 [WARNING ] (13, 1, 'bot')
2019-02-06 10:54:25 [WARNING ] (13, 1, 'bot')
2019-02-06 10:54:25 [WARNING ] (13, 1, 'bot')
2019-02-06 10:54:25 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:54:25 [DEBUG   ] Finished updating board flags in 1.356 seconds
2019-02-06 10:54:37 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-02-06 10:54:57 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 10:55:10 [DEBUG   ] Got command RPT from MCS: ref #1418657
2019-02-06 10:55:10 [DEBUG   ] summary = ERROR
2019-02-06 10:55:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418657  13 58520 39310761 A  ERRORERROR'
2019-02-06 10:55:10 [DEBUG   ] Got command RPT from MCS: ref #1418658
2019-02-06 10:55:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 10:55:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418658  77 58520 39310953 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 10:55:11 [DEBUG   ] Got command RPT from MCS: ref #1418659
2019-02-06 10:55:11 [DEBUG   ] summary = ERROR
2019-02-06 10:55:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418659  13 58520 39311157 A  ERRORERROR'
2019-02-06 10:55:11 [DEBUG   ] Got command RPT from MCS: ref #1418661
2019-02-06 10:55:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 10:55:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418661  77 58520 39311361 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 10:55:11 [DEBUG   ] Got command RPT from MCS: ref #1418662
2019-02-06 10:55:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 10:55:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418662  12 58520 39311553 A  ERRORB–™š'
2019-02-06 10:55:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 10:55:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:55:26 [WARNING ] (13, 1, 'bot')
2019-02-06 10:55:26 [WARNING ] (13, 1, 'bot')
2019-02-06 10:55:26 [WARNING ] (13, 1, 'bot')
2019-02-06 10:55:26 [WARNING ] (13, 1, 'bot')
2019-02-06 10:55:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:55:26 [DEBUG   ] Finished updating board flags in 2.061 seconds
2019-02-06 10:55:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 10:55:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 10:56:12 [DEBUG   ] Got command RPT from MCS: ref #1418667
2019-02-06 10:56:12 [DEBUG   ] summary = ERROR
2019-02-06 10:56:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418667  13 58520 39372293 A  ERRORERROR'
2019-02-06 10:56:12 [DEBUG   ] Got command RPT from MCS: ref #1418668
2019-02-06 10:56:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 10:56:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418668  77 58520 39372293 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 10:56:17 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-02-06 10:56:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:56:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-02-06 10:56:26 [WARNING ] (13, 1, 'bot')
2019-02-06 10:56:26 [WARNING ] (13, 1, 'bot')
2019-02-06 10:56:26 [WARNING ] (13, 1, 'bot')
2019-02-06 10:56:26 [WARNING ] (13, 1, 'bot')
2019-02-06 10:56:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:56:26 [DEBUG   ] Finished updating board flags in 2.026 seconds
2019-02-06 10:56:37 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-02-06 10:56:58 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-02-06 10:57:18 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-06 10:57:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:57:26 [WARNING ] (13, 1, 'bot')
2019-02-06 10:57:26 [WARNING ] (13, 1, 'bot')
2019-02-06 10:57:26 [WARNING ] (13, 1, 'bot')
2019-02-06 10:57:26 [WARNING ] (13, 1, 'bot')
2019-02-06 10:57:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:57:26 [DEBUG   ] Finished updating board flags in 2.013 seconds
2019-02-06 10:57:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 10:57:58 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 10:58:18 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-06 10:58:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:58:26 [WARNING ] (13, 1, 'bot')
2019-02-06 10:58:26 [WARNING ] (13, 1, 'bot')
2019-02-06 10:58:26 [WARNING ] (13, 1, 'bot')
2019-02-06 10:58:26 [WARNING ] (13, 1, 'bot')
2019-02-06 10:58:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:58:26 [DEBUG   ] Finished updating board flags in 1.950 seconds
2019-02-06 10:58:38 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-02-06 10:58:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 10:59:18 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 10:59:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 10:59:26 [WARNING ] (13, 1, 'bot')
2019-02-06 10:59:26 [WARNING ] (13, 1, 'bot')
2019-02-06 10:59:26 [WARNING ] (13, 1, 'bot')
2019-02-06 10:59:26 [WARNING ] (13, 1, 'bot')
2019-02-06 10:59:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 10:59:26 [DEBUG   ] Finished updating board flags in 1.814 seconds
2019-02-06 10:59:38 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-06 10:59:58 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-02-06 11:00:10 [DEBUG   ] Got command RPT from MCS: ref #1418692
2019-02-06 11:00:10 [DEBUG   ] summary = ERROR
2019-02-06 11:00:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418692  13 58520 39610837 A  ERRORERROR'
2019-02-06 11:00:11 [DEBUG   ] Got command RPT from MCS: ref #1418693
2019-02-06 11:00:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 11:00:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418693  77 58520 39611041 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 11:00:11 [DEBUG   ] Got command RPT from MCS: ref #1418694
2019-02-06 11:00:11 [DEBUG   ] summary = ERROR
2019-02-06 11:00:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418694  13 58520 39611245 A  ERRORERROR'
2019-02-06 11:00:11 [DEBUG   ] Got command RPT from MCS: ref #1418695
2019-02-06 11:00:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 11:00:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418695  77 58520 39611437 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 11:00:11 [DEBUG   ] Got command RPT from MCS: ref #1418696
2019-02-06 11:00:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 11:00:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418696  12 58520 39611641 A  ERRORB˜™š'
2019-02-06 11:00:18 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2019-02-06 11:00:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:00:26 [WARNING ] (13, 1, 'bot')
2019-02-06 11:00:26 [WARNING ] (13, 1, 'bot')
2019-02-06 11:00:26 [WARNING ] (13, 1, 'bot')
2019-02-06 11:00:26 [WARNING ] (13, 1, 'bot')
2019-02-06 11:00:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:00:26 [DEBUG   ] Finished updating board flags in 1.810 seconds
2019-02-06 11:00:38 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-02-06 11:00:58 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-02-06 11:01:12 [DEBUG   ] Got command RPT from MCS: ref #1418697
2019-02-06 11:01:12 [DEBUG   ] summary = ERROR
2019-02-06 11:01:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418697  13 58520 39672213 A  ERRORERROR'
2019-02-06 11:01:12 [DEBUG   ] Got command RPT from MCS: ref #1418698
2019-02-06 11:01:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 11:01:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418698  77 58520 39672214 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 11:01:19 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-02-06 11:01:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:01:26 [WARNING ] (13, 1, 'bot')
2019-02-06 11:01:26 [WARNING ] (13, 1, 'bot')
2019-02-06 11:01:26 [WARNING ] (13, 1, 'bot')
2019-02-06 11:01:26 [WARNING ] (13, 1, 'bot')
2019-02-06 11:01:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:01:26 [DEBUG   ] Finished updating board flags in 1.784 seconds
2019-02-06 11:01:39 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2019-02-06 11:01:59 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-02-06 11:02:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 11:02:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:02:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-06 11:02:26 [WARNING ] (13, 1, 'bot')
2019-02-06 11:02:26 [WARNING ] (13, 1, 'bot')
2019-02-06 11:02:26 [WARNING ] (13, 1, 'bot')
2019-02-06 11:02:26 [WARNING ] (13, 1, 'bot')
2019-02-06 11:02:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:02:26 [DEBUG   ] Finished updating board flags in 1.619 seconds
2019-02-06 11:02:39 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-02-06 11:02:59 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-06 11:03:19 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-06 11:03:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:03:26 [WARNING ] (13, 1, 'bot')
2019-02-06 11:03:26 [WARNING ] (13, 1, 'bot')
2019-02-06 11:03:26 [WARNING ] (13, 1, 'bot')
2019-02-06 11:03:26 [WARNING ] (13, 1, 'bot')
2019-02-06 11:03:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:03:26 [DEBUG   ] Finished updating board flags in 1.585 seconds
2019-02-06 11:03:39 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-06 11:03:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 11:04:19 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-02-06 11:04:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:04:26 [WARNING ] (13, 1, 'bot')
2019-02-06 11:04:26 [WARNING ] (13, 1, 'bot')
2019-02-06 11:04:26 [WARNING ] (13, 1, 'bot')
2019-02-06 11:04:26 [WARNING ] (13, 1, 'bot')
2019-02-06 11:04:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:04:26 [DEBUG   ] Finished updating board flags in 1.418 seconds
2019-02-06 11:04:39 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2019-02-06 11:04:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-06 11:05:10 [DEBUG   ] Got command RPT from MCS: ref #1418720
2019-02-06 11:05:10 [DEBUG   ] summary = ERROR
2019-02-06 11:05:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418720  13 58520 39910913 A  ERRORERROR'
2019-02-06 11:05:11 [DEBUG   ] Got command RPT from MCS: ref #1418721
2019-02-06 11:05:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 11:05:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418721  77 58520 39911117 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 11:05:11 [DEBUG   ] Got command RPT from MCS: ref #1418722
2019-02-06 11:05:11 [DEBUG   ] summary = ERROR
2019-02-06 11:05:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418722  13 58520 39911321 A  ERRORERROR'
2019-02-06 11:05:11 [DEBUG   ] Got command RPT from MCS: ref #1418724
2019-02-06 11:05:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 11:05:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418724  77 58520 39911525 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 11:05:11 [DEBUG   ] Got command RPT from MCS: ref #1418725
2019-02-06 11:05:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 11:05:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418725  12 58520 39911717 A  ERRORB—™š'
2019-02-06 11:05:20 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-02-06 11:05:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:05:26 [WARNING ] (13, 1, 'bot')
2019-02-06 11:05:26 [WARNING ] (13, 1, 'bot')
2019-02-06 11:05:26 [WARNING ] (13, 1, 'bot')
2019-02-06 11:05:26 [WARNING ] (13, 1, 'bot')
2019-02-06 11:05:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:05:26 [DEBUG   ] Finished updating board flags in 1.385 seconds
2019-02-06 11:05:39 [DEBUG   ] Finished updating ant stats in 0.409 seconds
2019-02-06 11:05:59 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2019-02-06 11:06:12 [DEBUG   ] Got command RPT from MCS: ref #1418734
2019-02-06 11:06:12 [DEBUG   ] summary = ERROR
2019-02-06 11:06:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418734  13 58520 39972213 A  ERRORERROR'
2019-02-06 11:06:12 [DEBUG   ] Got command RPT from MCS: ref #1418735
2019-02-06 11:06:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 11:06:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418735  77 58520 39972214 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 11:06:20 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 11:06:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:06:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-02-06 11:06:26 [WARNING ] (13, 1, 'bot')
2019-02-06 11:06:26 [WARNING ] (13, 1, 'bot')
2019-02-06 11:06:26 [WARNING ] (13, 1, 'bot')
2019-02-06 11:06:26 [WARNING ] (13, 1, 'bot')
2019-02-06 11:06:26 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:06:26 [DEBUG   ] Finished updating board flags in 1.394 seconds
2019-02-06 11:06:40 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 11:07:00 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 11:07:20 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 11:07:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:07:27 [WARNING ] (13, 1, 'bot')
2019-02-06 11:07:27 [WARNING ] (13, 1, 'bot')
2019-02-06 11:07:27 [WARNING ] (13, 1, 'bot')
2019-02-06 11:07:27 [WARNING ] (13, 1, 'bot')
2019-02-06 11:07:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:07:27 [DEBUG   ] Finished updating board flags in 2.020 seconds
2019-02-06 11:07:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 11:08:00 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 11:08:20 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-06 11:08:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:08:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-02-06 11:08:27 [WARNING ] (13, 1, 'bot')
2019-02-06 11:08:27 [WARNING ] (13, 1, 'bot')
2019-02-06 11:08:27 [WARNING ] (13, 1, 'bot')
2019-02-06 11:08:27 [WARNING ] (13, 1, 'bot')
2019-02-06 11:08:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:08:27 [DEBUG   ] Finished updating board flags in 2.010 seconds
2019-02-06 11:08:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 11:09:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 11:09:20 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 11:09:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:09:27 [WARNING ] (13, 1, 'bot')
2019-02-06 11:09:27 [WARNING ] (13, 1, 'bot')
2019-02-06 11:09:27 [WARNING ] (13, 1, 'bot')
2019-02-06 11:09:27 [WARNING ] (13, 1, 'bot')
2019-02-06 11:09:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:09:27 [DEBUG   ] Finished updating board flags in 1.977 seconds
2019-02-06 11:09:40 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2019-02-06 11:10:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 11:10:10 [DEBUG   ] Got command RPT from MCS: ref #1418755
2019-02-06 11:10:10 [DEBUG   ] summary = ERROR
2019-02-06 11:10:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418755  13 58520 40210997 A  ERRORERROR'
2019-02-06 11:10:11 [DEBUG   ] Got command RPT from MCS: ref #1418756
2019-02-06 11:10:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 11:10:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418756  77 58520 40211201 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 11:10:11 [DEBUG   ] Got command RPT from MCS: ref #1418757
2019-02-06 11:10:11 [DEBUG   ] summary = ERROR
2019-02-06 11:10:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418757  13 58520 40211405 A  ERRORERROR'
2019-02-06 11:10:11 [DEBUG   ] Got command RPT from MCS: ref #1418758
2019-02-06 11:10:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 11:10:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418758  77 58520 40211609 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 11:10:11 [DEBUG   ] Got command RPT from MCS: ref #1418759
2019-02-06 11:10:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 11:10:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418759  12 58520 40211801 A  ERRORB–™š'
2019-02-06 11:10:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 11:10:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:10:27 [WARNING ] (13, 1, 'bot')
2019-02-06 11:10:27 [WARNING ] (13, 1, 'bot')
2019-02-06 11:10:27 [WARNING ] (13, 1, 'bot')
2019-02-06 11:10:27 [WARNING ] (13, 1, 'bot')
2019-02-06 11:10:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:10:27 [DEBUG   ] Finished updating board flags in 1.821 seconds
2019-02-06 11:10:40 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 11:11:00 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-02-06 11:11:12 [DEBUG   ] Got command RPT from MCS: ref #1418760
2019-02-06 11:11:12 [DEBUG   ] summary = ERROR
2019-02-06 11:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418760  13 58520 40272213 A  ERRORERROR'
2019-02-06 11:11:12 [DEBUG   ] Got command RPT from MCS: ref #1418761
2019-02-06 11:11:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 11:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418761  77 58520 40272214 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 11:11:21 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-02-06 11:11:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 11:11:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:11:27 [WARNING ] (13, 1, 'bot')
2019-02-06 11:11:27 [WARNING ] (13, 1, 'bot')
2019-02-06 11:11:27 [WARNING ] (13, 1, 'bot')
2019-02-06 11:11:27 [WARNING ] (13, 1, 'bot')
2019-02-06 11:11:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:11:27 [DEBUG   ] Finished updating board flags in 1.799 seconds
2019-02-06 11:11:41 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-02-06 11:12:01 [DEBUG   ] Finished updating ant stats in 1.211 seconds
2019-02-06 11:12:21 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 11:12:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:12:27 [WARNING ] (13, 1, 'bot')
2019-02-06 11:12:27 [WARNING ] (13, 1, 'bot')
2019-02-06 11:12:27 [WARNING ] (13, 1, 'bot')
2019-02-06 11:12:27 [WARNING ] (13, 1, 'bot')
2019-02-06 11:12:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:12:27 [DEBUG   ] Finished updating board flags in 1.603 seconds
2019-02-06 11:12:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 11:13:01 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2019-02-06 11:13:21 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-06 11:13:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:13:27 [WARNING ] (13, 1, 'bot')
2019-02-06 11:13:27 [WARNING ] (13, 1, 'bot')
2019-02-06 11:13:27 [WARNING ] (13, 1, 'bot')
2019-02-06 11:13:27 [WARNING ] (13, 1, 'bot')
2019-02-06 11:13:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:13:27 [DEBUG   ] Finished updating board flags in 1.595 seconds
2019-02-06 11:13:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 11:14:01 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2019-02-06 11:14:21 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-06 11:14:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:14:27 [WARNING ] (13, 1, 'bot')
2019-02-06 11:14:27 [WARNING ] (13, 1, 'bot')
2019-02-06 11:14:27 [WARNING ] (13, 1, 'bot')
2019-02-06 11:14:27 [WARNING ] (13, 1, 'bot')
2019-02-06 11:14:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:14:27 [DEBUG   ] Finished updating board flags in 1.410 seconds
2019-02-06 11:14:41 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 11:15:01 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 11:15:11 [DEBUG   ] Got command RPT from MCS: ref #1418787
2019-02-06 11:15:11 [DEBUG   ] summary = ERROR
2019-02-06 11:15:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418787  13 58520 40511081 A  ERRORERROR'
2019-02-06 11:15:11 [DEBUG   ] Got command RPT from MCS: ref #1418788
2019-02-06 11:15:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 11:15:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418788  77 58520 40511285 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 11:15:11 [DEBUG   ] Got command RPT from MCS: ref #1418789
2019-02-06 11:15:11 [DEBUG   ] summary = ERROR
2019-02-06 11:15:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418789  13 58520 40511489 A  ERRORERROR'
2019-02-06 11:15:11 [DEBUG   ] Got command RPT from MCS: ref #1418791
2019-02-06 11:15:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 11:15:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418791  77 58520 40511681 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 11:15:11 [DEBUG   ] Got command RPT from MCS: ref #1418793
2019-02-06 11:15:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 11:15:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418793  12 58520 40511885 A  ERRORB˜™š'
2019-02-06 11:15:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 11:15:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:15:27 [WARNING ] (13, 1, 'bot')
2019-02-06 11:15:27 [WARNING ] (13, 1, 'bot')
2019-02-06 11:15:27 [WARNING ] (13, 1, 'bot')
2019-02-06 11:15:27 [WARNING ] (13, 1, 'bot')
2019-02-06 11:15:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:15:27 [DEBUG   ] Finished updating board flags in 1.387 seconds
2019-02-06 11:15:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 11:16:01 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-02-06 11:16:12 [DEBUG   ] Got command RPT from MCS: ref #1418797
2019-02-06 11:16:12 [DEBUG   ] summary = ERROR
2019-02-06 11:16:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418797  13 58520 40572209 A  ERRORERROR'
2019-02-06 11:16:12 [DEBUG   ] Got command RPT from MCS: ref #1418798
2019-02-06 11:16:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 11:16:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418798  77 58520 40572210 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 11:16:21 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-02-06 11:16:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:16:27 [WARNING ] (13, 1, 'bot')
2019-02-06 11:16:27 [WARNING ] (13, 1, 'bot')
2019-02-06 11:16:27 [WARNING ] (13, 1, 'bot')
2019-02-06 11:16:27 [WARNING ] (13, 1, 'bot')
2019-02-06 11:16:27 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:16:27 [DEBUG   ] Finished updating board flags in 1.378 seconds
2019-02-06 11:16:42 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-02-06 11:17:02 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-06 11:17:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 11:17:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:17:28 [WARNING ] (13, 1, 'bot')
2019-02-06 11:17:28 [WARNING ] (13, 1, 'bot')
2019-02-06 11:17:28 [WARNING ] (13, 1, 'bot')
2019-02-06 11:17:28 [WARNING ] (13, 1, 'bot')
2019-02-06 11:17:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:17:28 [DEBUG   ] Finished updating board flags in 2.054 seconds
2019-02-06 11:17:42 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 11:18:02 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-06 11:18:22 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-02-06 11:18:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:18:28 [WARNING ] (13, 1, 'bot')
2019-02-06 11:18:28 [WARNING ] (13, 1, 'bot')
2019-02-06 11:18:28 [WARNING ] (13, 1, 'bot')
2019-02-06 11:18:28 [WARNING ] (13, 1, 'bot')
2019-02-06 11:18:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:18:28 [DEBUG   ] Finished updating board flags in 1.984 seconds
2019-02-06 11:18:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 11:19:02 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 11:19:22 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-06 11:19:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:19:28 [WARNING ] (13, 1, 'bot')
2019-02-06 11:19:28 [WARNING ] (13, 1, 'bot')
2019-02-06 11:19:28 [WARNING ] (13, 1, 'bot')
2019-02-06 11:19:28 [WARNING ] (13, 1, 'bot')
2019-02-06 11:19:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:19:28 [DEBUG   ] Finished updating board flags in 1.820 seconds
2019-02-06 11:19:42 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-02-06 11:20:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 11:20:11 [DEBUG   ] Got command RPT from MCS: ref #1418818
2019-02-06 11:20:11 [DEBUG   ] summary = ERROR
2019-02-06 11:20:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418818  13 58520 40811169 A  ERRORERROR'
2019-02-06 11:20:11 [DEBUG   ] Got command RPT from MCS: ref #1418819
2019-02-06 11:20:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 11:20:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418819  77 58520 40811365 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 11:20:11 [DEBUG   ] Got command RPT from MCS: ref #1418820
2019-02-06 11:20:11 [DEBUG   ] summary = ERROR
2019-02-06 11:20:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418820  13 58520 40811569 A  ERRORERROR'
2019-02-06 11:20:11 [DEBUG   ] Got command RPT from MCS: ref #1418821
2019-02-06 11:20:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 11:20:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418821  77 58520 40811761 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 11:20:11 [DEBUG   ] Got command RPT from MCS: ref #1418822
2019-02-06 11:20:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 11:20:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418822  12 58520 40811965 A  ERRORB—™š'
2019-02-06 11:20:22 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-02-06 11:20:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:20:28 [WARNING ] (13, 1, 'bot')
2019-02-06 11:20:28 [WARNING ] (13, 1, 'bot')
2019-02-06 11:20:28 [WARNING ] (13, 1, 'bot')
2019-02-06 11:20:28 [WARNING ] (13, 1, 'bot')
2019-02-06 11:20:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:20:28 [DEBUG   ] Finished updating board flags in 1.811 seconds
2019-02-06 11:20:42 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-02-06 11:21:02 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-06 11:21:12 [DEBUG   ] Got command RPT from MCS: ref #1418827
2019-02-06 11:21:12 [DEBUG   ] summary = ERROR
2019-02-06 11:21:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418827  13 58520 40872209 A  ERRORERROR'
2019-02-06 11:21:12 [DEBUG   ] Got command RPT from MCS: ref #1418828
2019-02-06 11:21:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 11:21:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418828  77 58520 40872210 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 11:21:22 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 11:21:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:21:28 [WARNING ] (13, 1, 'bot')
2019-02-06 11:21:28 [WARNING ] (13, 1, 'bot')
2019-02-06 11:21:28 [WARNING ] (13, 1, 'bot')
2019-02-06 11:21:28 [WARNING ] (13, 1, 'bot')
2019-02-06 11:21:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:21:28 [DEBUG   ] Finished updating board flags in 1.767 seconds
2019-02-06 11:21:42 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 11:22:02 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-02-06 11:22:22 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-02-06 11:22:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:22:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-02-06 11:22:28 [WARNING ] (13, 1, 'bot')
2019-02-06 11:22:28 [WARNING ] (13, 1, 'bot')
2019-02-06 11:22:28 [WARNING ] (13, 1, 'bot')
2019-02-06 11:22:28 [WARNING ] (13, 1, 'bot')
2019-02-06 11:22:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:22:28 [DEBUG   ] Finished updating board flags in 1.617 seconds
2019-02-06 11:22:43 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-02-06 11:23:02 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-02-06 11:23:23 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2019-02-06 11:23:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:23:28 [WARNING ] (13, 1, 'bot')
2019-02-06 11:23:28 [WARNING ] (13, 1, 'bot')
2019-02-06 11:23:28 [WARNING ] (13, 1, 'bot')
2019-02-06 11:23:28 [WARNING ] (13, 1, 'bot')
2019-02-06 11:23:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:23:28 [DEBUG   ] Finished updating board flags in 1.586 seconds
2019-02-06 11:23:43 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-06 11:24:03 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-02-06 11:24:23 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 11:24:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:24:28 [WARNING ] (13, 1, 'bot')
2019-02-06 11:24:28 [WARNING ] (13, 1, 'bot')
2019-02-06 11:24:28 [WARNING ] (13, 1, 'bot')
2019-02-06 11:24:28 [WARNING ] (13, 1, 'bot')
2019-02-06 11:24:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:24:28 [DEBUG   ] Finished updating board flags in 1.419 seconds
2019-02-06 11:24:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 11:25:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 11:25:11 [DEBUG   ] Got command RPT from MCS: ref #1418850
2019-02-06 11:25:11 [DEBUG   ] summary = ERROR
2019-02-06 11:25:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418850  13 58520 41111241 A  ERRORERROR'
2019-02-06 11:25:11 [DEBUG   ] Got command RPT from MCS: ref #1418851
2019-02-06 11:25:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 11:25:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418851  77 58520 41111445 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 11:25:11 [DEBUG   ] Got command RPT from MCS: ref #1418852
2019-02-06 11:25:11 [DEBUG   ] summary = ERROR
2019-02-06 11:25:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418852  13 58520 41111649 A  ERRORERROR'
2019-02-06 11:25:11 [DEBUG   ] Got command RPT from MCS: ref #1418854
2019-02-06 11:25:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 11:25:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418854  77 58520 41111841 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 11:25:12 [DEBUG   ] Got command RPT from MCS: ref #1418856
2019-02-06 11:25:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 11:25:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418856  12 58520 41112045 A  ERRORB—™š'
2019-02-06 11:25:23 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-02-06 11:25:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-02-06 11:25:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:25:28 [WARNING ] (13, 1, 'bot')
2019-02-06 11:25:28 [WARNING ] (13, 1, 'bot')
2019-02-06 11:25:28 [WARNING ] (13, 1, 'bot')
2019-02-06 11:25:28 [WARNING ] (13, 1, 'bot')
2019-02-06 11:25:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:25:28 [DEBUG   ] Finished updating board flags in 1.383 seconds
2019-02-06 11:25:43 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-06 11:26:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 11:26:12 [DEBUG   ] Got command RPT from MCS: ref #1418860
2019-02-06 11:26:12 [DEBUG   ] summary = ERROR
2019-02-06 11:26:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418860  13 58520 41172221 A  ERRORERROR'
2019-02-06 11:26:12 [DEBUG   ] Got command RPT from MCS: ref #1418861
2019-02-06 11:26:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 11:26:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418861  77 58520 41172222 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 11:26:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 11:26:27 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 11:26:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:26:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-06 11:26:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-06 11:26:28 [WARNING ] (13, 1, 'bot')
2019-02-06 11:26:28 [WARNING ] (13, 1, 'bot')
2019-02-06 11:26:28 [WARNING ] (13, 1, 'bot')
2019-02-06 11:26:28 [WARNING ] (13, 1, 'bot')
2019-02-06 11:26:28 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:26:28 [DEBUG   ] Finished updating board flags in 1.362 seconds
2019-02-06 11:26:43 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 11:27:03 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 11:27:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 11:27:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 11:27:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:27:29 [WARNING ] (13, 1, 'bot')
2019-02-06 11:27:29 [WARNING ] (13, 1, 'bot')
2019-02-06 11:27:29 [WARNING ] (13, 1, 'bot')
2019-02-06 11:27:29 [WARNING ] (13, 1, 'bot')
2019-02-06 11:27:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:27:29 [DEBUG   ] Finished updating board flags in 2.055 seconds
2019-02-06 11:27:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 11:28:03 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-02-06 11:28:23 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 11:28:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:28:29 [WARNING ] (13, 1, 'bot')
2019-02-06 11:28:29 [WARNING ] (13, 1, 'bot')
2019-02-06 11:28:29 [WARNING ] (13, 1, 'bot')
2019-02-06 11:28:29 [WARNING ] (13, 1, 'bot')
2019-02-06 11:28:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:28:29 [DEBUG   ] Finished updating board flags in 2.020 seconds
2019-02-06 11:28:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-06 11:29:04 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2019-02-06 11:29:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 11:29:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:29:29 [WARNING ] (13, 1, 'bot')
2019-02-06 11:29:29 [WARNING ] (13, 1, 'bot')
2019-02-06 11:29:29 [WARNING ] (13, 1, 'bot')
2019-02-06 11:29:29 [WARNING ] (13, 1, 'bot')
2019-02-06 11:29:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:29:29 [DEBUG   ] Finished updating board flags in 1.985 seconds
2019-02-06 11:29:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 11:30:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 11:30:11 [DEBUG   ] Got command RPT from MCS: ref #1418885
2019-02-06 11:30:11 [DEBUG   ] summary = ERROR
2019-02-06 11:30:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418885  13 58520 41411321 A  ERRORERROR'
2019-02-06 11:30:11 [DEBUG   ] Got command RPT from MCS: ref #1418886
2019-02-06 11:30:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 11:30:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418886  77 58520 41411525 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 11:30:11 [DEBUG   ] Got command RPT from MCS: ref #1418887
2019-02-06 11:30:11 [DEBUG   ] summary = ERROR
2019-02-06 11:30:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418887  13 58520 41411729 A  ERRORERROR'
2019-02-06 11:30:11 [DEBUG   ] Got command RPT from MCS: ref #1418888
2019-02-06 11:30:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 11:30:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418888  77 58520 41411925 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 11:30:12 [DEBUG   ] Got command RPT from MCS: ref #1418889
2019-02-06 11:30:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 11:30:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418889  12 58520 41412129 A  ERRORB˜™š'
2019-02-06 11:30:24 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 11:30:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:30:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-06 11:30:29 [WARNING ] (13, 1, 'bot')
2019-02-06 11:30:29 [WARNING ] (13, 1, 'bot')
2019-02-06 11:30:29 [WARNING ] (13, 1, 'bot')
2019-02-06 11:30:29 [WARNING ] (13, 1, 'bot')
2019-02-06 11:30:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:30:29 [DEBUG   ] Finished updating board flags in 1.901 seconds
2019-02-06 11:30:44 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 11:31:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 11:31:12 [DEBUG   ] Got command RPT from MCS: ref #1418890
2019-02-06 11:31:12 [DEBUG   ] summary = ERROR
2019-02-06 11:31:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418890  13 58520 41472217 A  ERRORERROR'
2019-02-06 11:31:12 [DEBUG   ] Got command RPT from MCS: ref #1418891
2019-02-06 11:31:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 11:31:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418891  77 58520 41472218 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 11:31:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 11:31:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:31:29 [WARNING ] (13, 1, 'bot')
2019-02-06 11:31:29 [WARNING ] (13, 1, 'bot')
2019-02-06 11:31:29 [WARNING ] (13, 1, 'bot')
2019-02-06 11:31:29 [WARNING ] (13, 1, 'bot')
2019-02-06 11:31:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:31:29 [DEBUG   ] Finished updating board flags in 1.700 seconds
2019-02-06 11:31:44 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-02-06 11:32:04 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2019-02-06 11:32:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 11:32:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:32:29 [WARNING ] (13, 1, 'bot')
2019-02-06 11:32:29 [WARNING ] (13, 1, 'bot')
2019-02-06 11:32:29 [WARNING ] (13, 1, 'bot')
2019-02-06 11:32:29 [WARNING ] (13, 1, 'bot')
2019-02-06 11:32:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:32:29 [DEBUG   ] Finished updating board flags in 1.620 seconds
2019-02-06 11:32:44 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 11:33:04 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-02-06 11:33:24 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-02-06 11:33:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:33:29 [WARNING ] (13, 1, 'bot')
2019-02-06 11:33:29 [WARNING ] (13, 1, 'bot')
2019-02-06 11:33:29 [WARNING ] (13, 1, 'bot')
2019-02-06 11:33:29 [WARNING ] (13, 1, 'bot')
2019-02-06 11:33:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:33:29 [DEBUG   ] Finished updating board flags in 1.583 seconds
2019-02-06 11:33:45 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-02-06 11:34:05 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-02-06 11:34:25 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-02-06 11:34:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:34:29 [WARNING ] (13, 1, 'bot')
2019-02-06 11:34:29 [WARNING ] (13, 1, 'bot')
2019-02-06 11:34:29 [WARNING ] (13, 1, 'bot')
2019-02-06 11:34:29 [WARNING ] (13, 1, 'bot')
2019-02-06 11:34:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:34:29 [DEBUG   ] Finished updating board flags in 1.426 seconds
2019-02-06 11:34:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 11:35:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 11:35:11 [DEBUG   ] Got command RPT from MCS: ref #1418913
2019-02-06 11:35:11 [DEBUG   ] summary = ERROR
2019-02-06 11:35:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418913  13 58520 41711397 A  ERRORERROR'
2019-02-06 11:35:11 [DEBUG   ] Got command RPT from MCS: ref #1418914
2019-02-06 11:35:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 11:35:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418914  77 58520 41711601 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 11:35:11 [DEBUG   ] Got command RPT from MCS: ref #1418915
2019-02-06 11:35:11 [DEBUG   ] summary = ERROR
2019-02-06 11:35:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418915  13 58520 41711805 A  ERRORERROR'
2019-02-06 11:35:12 [DEBUG   ] Got command RPT from MCS: ref #1418917
2019-02-06 11:35:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 11:35:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418917  77 58520 41712009 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 11:35:12 [DEBUG   ] Got command RPT from MCS: ref #1418918
2019-02-06 11:35:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 11:35:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418918  12 58520 41712201 A  ERRORB—™š'
2019-02-06 11:35:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 11:35:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:35:29 [WARNING ] (13, 1, 'bot')
2019-02-06 11:35:29 [WARNING ] (13, 1, 'bot')
2019-02-06 11:35:29 [WARNING ] (13, 1, 'bot')
2019-02-06 11:35:29 [WARNING ] (13, 1, 'bot')
2019-02-06 11:35:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:35:29 [DEBUG   ] Finished updating board flags in 1.381 seconds
2019-02-06 11:35:45 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-06 11:36:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 11:36:12 [DEBUG   ] Got command RPT from MCS: ref #1418927
2019-02-06 11:36:12 [DEBUG   ] summary = ERROR
2019-02-06 11:36:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418927  13 58520 41772221 A  ERRORERROR'
2019-02-06 11:36:12 [DEBUG   ] Got command RPT from MCS: ref #1418928
2019-02-06 11:36:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 11:36:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418928  77 58520 41772222 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 11:36:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 11:36:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:36:29 [WARNING ] (13, 1, 'bot')
2019-02-06 11:36:29 [WARNING ] (13, 1, 'bot')
2019-02-06 11:36:29 [WARNING ] (13, 1, 'bot')
2019-02-06 11:36:29 [WARNING ] (13, 1, 'bot')
2019-02-06 11:36:29 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:36:29 [DEBUG   ] Finished updating board flags in 1.355 seconds
2019-02-06 11:36:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 11:37:05 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 11:37:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 11:37:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:37:30 [WARNING ] (13, 1, 'bot')
2019-02-06 11:37:30 [WARNING ] (13, 1, 'bot')
2019-02-06 11:37:30 [WARNING ] (13, 1, 'bot')
2019-02-06 11:37:30 [WARNING ] (13, 1, 'bot')
2019-02-06 11:37:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:37:30 [DEBUG   ] Finished updating board flags in 2.057 seconds
2019-02-06 11:37:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 11:38:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 11:38:25 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-02-06 11:38:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 11:38:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:38:30 [WARNING ] (13, 1, 'bot')
2019-02-06 11:38:30 [WARNING ] (13, 1, 'bot')
2019-02-06 11:38:30 [WARNING ] (13, 1, 'bot')
2019-02-06 11:38:30 [WARNING ] (13, 1, 'bot')
2019-02-06 11:38:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:38:30 [DEBUG   ] Finished updating board flags in 1.984 seconds
2019-02-06 11:38:46 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2019-02-06 11:39:06 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2019-02-06 11:39:26 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-02-06 11:39:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:39:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-06 11:39:30 [WARNING ] (13, 1, 'bot')
2019-02-06 11:39:30 [WARNING ] (13, 1, 'bot')
2019-02-06 11:39:30 [WARNING ] (13, 1, 'bot')
2019-02-06 11:39:30 [WARNING ] (13, 1, 'bot')
2019-02-06 11:39:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:39:30 [DEBUG   ] Finished updating board flags in 1.822 seconds
2019-02-06 11:39:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 11:40:06 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2019-02-06 11:40:11 [DEBUG   ] Got command RPT from MCS: ref #1418948
2019-02-06 11:40:11 [DEBUG   ] summary = ERROR
2019-02-06 11:40:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418948  13 58520 42011477 A  ERRORERROR'
2019-02-06 11:40:11 [DEBUG   ] Got command RPT from MCS: ref #1418949
2019-02-06 11:40:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 11:40:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418949  77 58520 42011681 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 11:40:11 [DEBUG   ] Got command RPT from MCS: ref #1418950
2019-02-06 11:40:11 [DEBUG   ] summary = ERROR
2019-02-06 11:40:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418950  13 58520 42011885 A  ERRORERROR'
2019-02-06 11:40:12 [DEBUG   ] Got command RPT from MCS: ref #1418951
2019-02-06 11:40:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 11:40:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418951  77 58520 42012089 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 11:40:12 [DEBUG   ] Got command RPT from MCS: ref #1418952
2019-02-06 11:40:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 11:40:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418952  12 58520 42012285 A  ERRORB—™š'
2019-02-06 11:40:26 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2019-02-06 11:40:29 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-02-06 11:40:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:40:30 [WARNING ] (13, 1, 'bot')
2019-02-06 11:40:30 [WARNING ] (13, 1, 'bot')
2019-02-06 11:40:30 [WARNING ] (13, 1, 'bot')
2019-02-06 11:40:30 [WARNING ] (13, 1, 'bot')
2019-02-06 11:40:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:40:30 [DEBUG   ] Finished updating board flags in 1.790 seconds
2019-02-06 11:40:46 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 11:41:07 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-02-06 11:41:12 [DEBUG   ] Got command RPT from MCS: ref #1418953
2019-02-06 11:41:12 [DEBUG   ] summary = ERROR
2019-02-06 11:41:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418953  13 58520 42072217 A  ERRORERROR'
2019-02-06 11:41:12 [DEBUG   ] Got command RPT from MCS: ref #1418954
2019-02-06 11:41:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 11:41:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418954  77 58520 42072218 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 11:41:27 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-02-06 11:41:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 11:41:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:41:30 [WARNING ] (13, 1, 'bot')
2019-02-06 11:41:30 [WARNING ] (13, 1, 'bot')
2019-02-06 11:41:30 [WARNING ] (13, 1, 'bot')
2019-02-06 11:41:30 [WARNING ] (13, 1, 'bot')
2019-02-06 11:41:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:41:30 [DEBUG   ] Finished updating board flags in 1.616 seconds
2019-02-06 11:41:47 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-06 11:42:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 11:42:27 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-02-06 11:42:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:42:30 [WARNING ] (13, 1, 'bot')
2019-02-06 11:42:30 [WARNING ] (13, 1, 'bot')
2019-02-06 11:42:30 [WARNING ] (13, 1, 'bot')
2019-02-06 11:42:30 [WARNING ] (13, 1, 'bot')
2019-02-06 11:42:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:42:30 [DEBUG   ] Finished updating board flags in 1.582 seconds
2019-02-06 11:42:47 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-02-06 11:43:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 11:43:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 11:43:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 11:43:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:43:30 [WARNING ] (13, 1, 'bot')
2019-02-06 11:43:30 [WARNING ] (13, 1, 'bot')
2019-02-06 11:43:30 [WARNING ] (13, 1, 'bot')
2019-02-06 11:43:30 [WARNING ] (13, 1, 'bot')
2019-02-06 11:43:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:43:30 [DEBUG   ] Finished updating board flags in 1.413 seconds
2019-02-06 11:43:47 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-02-06 11:44:07 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-06 11:44:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 11:44:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:44:30 [WARNING ] (13, 1, 'bot')
2019-02-06 11:44:30 [WARNING ] (13, 1, 'bot')
2019-02-06 11:44:30 [WARNING ] (13, 1, 'bot')
2019-02-06 11:44:30 [WARNING ] (13, 1, 'bot')
2019-02-06 11:44:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:44:30 [DEBUG   ] Finished updating board flags in 1.393 seconds
2019-02-06 11:44:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 11:45:07 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 11:45:11 [DEBUG   ] Got command RPT from MCS: ref #1418980
2019-02-06 11:45:11 [DEBUG   ] summary = ERROR
2019-02-06 11:45:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418980  13 58520 42311557 A  ERRORERROR'
2019-02-06 11:45:11 [DEBUG   ] Got command RPT from MCS: ref #1418981
2019-02-06 11:45:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 11:45:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418981  77 58520 42311761 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 11:45:11 [DEBUG   ] Got command RPT from MCS: ref #1418982
2019-02-06 11:45:11 [DEBUG   ] summary = ERROR
2019-02-06 11:45:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418982  13 58520 42311965 A  ERRORERROR'
2019-02-06 11:45:12 [DEBUG   ] Got command RPT from MCS: ref #1418984
2019-02-06 11:45:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 11:45:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418984  77 58520 42312169 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 11:45:12 [DEBUG   ] Got command RPT from MCS: ref #1418985
2019-02-06 11:45:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 11:45:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418985  12 58520 42312361 A  ERRORB˜™š'
2019-02-06 11:45:27 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 11:45:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:45:30 [WARNING ] (13, 1, 'bot')
2019-02-06 11:45:30 [WARNING ] (13, 1, 'bot')
2019-02-06 11:45:30 [WARNING ] (13, 1, 'bot')
2019-02-06 11:45:30 [WARNING ] (13, 1, 'bot')
2019-02-06 11:45:30 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:45:30 [DEBUG   ] Finished updating board flags in 1.365 seconds
2019-02-06 11:45:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 11:46:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 11:46:12 [DEBUG   ] Got command RPT from MCS: ref #1418990
2019-02-06 11:46:12 [DEBUG   ] summary = ERROR
2019-02-06 11:46:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418990  13 58520 42372217 A  ERRORERROR'
2019-02-06 11:46:12 [DEBUG   ] Got command RPT from MCS: ref #1418991
2019-02-06 11:46:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 11:46:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1418991  77 58520 42372218 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 11:46:27 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 11:46:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 11:46:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:46:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-06 11:46:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:46:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:46:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:46:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:46:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:46:31 [DEBUG   ] Finished updating board flags in 2.049 seconds
2019-02-06 11:46:47 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 11:47:08 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-02-06 11:47:28 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-02-06 11:47:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:47:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:47:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:47:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:47:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:47:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:47:31 [DEBUG   ] Finished updating board flags in 2.004 seconds
2019-02-06 11:47:48 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-02-06 11:48:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 11:48:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 11:48:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:48:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:48:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:48:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:48:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:48:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:48:31 [DEBUG   ] Finished updating board flags in 2.024 seconds
2019-02-06 11:48:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-06 11:49:08 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-06 11:49:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 11:49:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:49:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:49:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:49:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:49:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:49:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:49:31 [DEBUG   ] Finished updating board flags in 2.012 seconds
2019-02-06 11:49:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 11:50:08 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-02-06 11:50:11 [DEBUG   ] Got command RPT from MCS: ref #1419011
2019-02-06 11:50:11 [DEBUG   ] summary = ERROR
2019-02-06 11:50:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419011  13 58520 42611649 A  ERRORERROR'
2019-02-06 11:50:11 [DEBUG   ] Got command RPT from MCS: ref #1419012
2019-02-06 11:50:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 11:50:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419012  77 58520 42611841 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 11:50:12 [DEBUG   ] Got command RPT from MCS: ref #1419013
2019-02-06 11:50:12 [DEBUG   ] summary = ERROR
2019-02-06 11:50:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419013  13 58520 42612045 A  ERRORERROR'
2019-02-06 11:50:12 [DEBUG   ] Got command RPT from MCS: ref #1419014
2019-02-06 11:50:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 11:50:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419014  77 58520 42612249 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 11:50:12 [DEBUG   ] Got command RPT from MCS: ref #1419015
2019-02-06 11:50:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 11:50:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419015  12 58520 42612453 A  ERRORB—™š'
2019-02-06 11:50:28 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 11:50:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 11:50:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:50:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:50:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:50:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:50:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:50:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:50:31 [DEBUG   ] Finished updating board flags in 2.066 seconds
2019-02-06 11:50:48 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-02-06 11:51:08 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-06 11:51:12 [DEBUG   ] Got command RPT from MCS: ref #1419020
2019-02-06 11:51:12 [DEBUG   ] summary = ERROR
2019-02-06 11:51:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419020  13 58520 42672225 A  ERRORERROR'
2019-02-06 11:51:12 [DEBUG   ] Got command RPT from MCS: ref #1419021
2019-02-06 11:51:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 11:51:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419021  77 58520 42672226 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 11:51:29 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-02-06 11:51:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:51:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:51:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:51:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:51:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:51:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:51:31 [DEBUG   ] Finished updating board flags in 1.901 seconds
2019-02-06 11:51:49 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-06 11:52:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 11:52:29 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 11:52:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2019-02-06 11:52:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:52:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:52:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:52:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:52:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:52:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:52:31 [DEBUG   ] Finished updating board flags in 1.821 seconds
2019-02-06 11:52:49 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 11:53:09 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-02-06 11:53:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 11:53:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:53:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:53:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:53:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:53:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:53:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:53:31 [DEBUG   ] Finished updating board flags in 1.770 seconds
2019-02-06 11:53:49 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 11:54:09 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-02-06 11:54:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 11:54:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:54:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:54:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:54:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:54:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:54:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:54:31 [DEBUG   ] Finished updating board flags in 1.627 seconds
2019-02-06 11:54:49 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 11:55:09 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-06 11:55:11 [DEBUG   ] Got command RPT from MCS: ref #1419043
2019-02-06 11:55:11 [DEBUG   ] summary = ERROR
2019-02-06 11:55:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419043  13 58520 42911721 A  ERRORERROR'
2019-02-06 11:55:11 [DEBUG   ] Got command RPT from MCS: ref #1419044
2019-02-06 11:55:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 11:55:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419044  77 58520 42911925 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 11:55:12 [DEBUG   ] Got command RPT from MCS: ref #1419045
2019-02-06 11:55:12 [DEBUG   ] summary = ERROR
2019-02-06 11:55:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419045  13 58520 42912129 A  ERRORERROR'
2019-02-06 11:55:12 [DEBUG   ] Got command RPT from MCS: ref #1419047
2019-02-06 11:55:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 11:55:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419047  77 58520 42912333 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 11:55:12 [DEBUG   ] Got command RPT from MCS: ref #1419048
2019-02-06 11:55:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 11:55:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419048  12 58520 42912525 A  ERRORB˜™š'
2019-02-06 11:55:29 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 11:55:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:55:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:55:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:55:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:55:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:55:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:55:31 [DEBUG   ] Finished updating board flags in 1.596 seconds
2019-02-06 11:55:50 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-02-06 11:56:10 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2019-02-06 11:56:12 [DEBUG   ] Got command RPT from MCS: ref #1419053
2019-02-06 11:56:12 [DEBUG   ] summary = ERROR
2019-02-06 11:56:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419053  13 58520 42972221 A  ERRORERROR'
2019-02-06 11:56:12 [DEBUG   ] Got command RPT from MCS: ref #1419054
2019-02-06 11:56:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 11:56:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419054  77 58520 42972222 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 11:56:30 [DEBUG   ] Finished updating ant stats in 1.240 seconds
2019-02-06 11:56:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:56:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:56:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:56:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:56:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:56:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:56:31 [DEBUG   ] Finished updating board flags in 1.409 seconds
2019-02-06 11:56:50 [DEBUG   ] Finished updating ant stats in 1.162 seconds
2019-02-06 11:57:10 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 11:57:30 [DEBUG   ] Finished updating ant stats in 1.008 seconds
2019-02-06 11:57:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:57:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:57:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:57:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:57:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:57:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:57:31 [DEBUG   ] Finished updating board flags in 1.412 seconds
2019-02-06 11:57:50 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2019-02-06 11:58:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 11:58:30 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2019-02-06 11:58:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:58:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:58:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:58:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:58:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:58:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:58:31 [DEBUG   ] Finished updating board flags in 1.369 seconds
2019-02-06 11:58:50 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-06 11:59:10 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-06 11:59:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 11:59:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 11:59:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:59:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:59:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:59:31 [WARNING ] (13, 1, 'bot')
2019-02-06 11:59:31 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 11:59:31 [DEBUG   ] Finished updating board flags in 1.366 seconds
2019-02-06 11:59:50 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 12:00:10 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-02-06 12:00:11 [DEBUG   ] Got command RPT from MCS: ref #1419078
2019-02-06 12:00:11 [DEBUG   ] summary = ERROR
2019-02-06 12:00:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419078  13 58520 43211805 A  ERRORERROR'
2019-02-06 12:00:12 [DEBUG   ] Got command RPT from MCS: ref #1419079
2019-02-06 12:00:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 12:00:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419079  77 58520 43212009 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 12:00:12 [DEBUG   ] Got command RPT from MCS: ref #1419080
2019-02-06 12:00:12 [DEBUG   ] summary = ERROR
2019-02-06 12:00:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419080  13 58520 43212201 A  ERRORERROR'
2019-02-06 12:00:12 [DEBUG   ] Got command RPT from MCS: ref #1419081
2019-02-06 12:00:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 12:00:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419081  77 58520 43212409 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 12:00:12 [DEBUG   ] Got command RPT from MCS: ref #1419082
2019-02-06 12:00:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 12:00:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419082  12 58520 43212613 A  ERRORB—™š'
2019-02-06 12:00:30 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-02-06 12:00:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:00:32 [WARNING ] (13, 1, 'bot')
2019-02-06 12:00:32 [WARNING ] (13, 1, 'bot')
2019-02-06 12:00:32 [WARNING ] (13, 1, 'bot')
2019-02-06 12:00:32 [WARNING ] (13, 1, 'bot')
2019-02-06 12:00:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:00:32 [DEBUG   ] Finished updating board flags in 2.059 seconds
2019-02-06 12:00:51 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2019-02-06 12:01:10 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-02-06 12:01:12 [DEBUG   ] Got command RPT from MCS: ref #1419083
2019-02-06 12:01:12 [DEBUG   ] summary = ERROR
2019-02-06 12:01:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419083  13 58520 43272221 A  ERRORERROR'
2019-02-06 12:01:12 [DEBUG   ] Got command RPT from MCS: ref #1419084
2019-02-06 12:01:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 12:01:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419084  77 58520 43272222 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 12:01:31 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2019-02-06 12:01:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:01:32 [WARNING ] (13, 1, 'bot')
2019-02-06 12:01:32 [WARNING ] (13, 1, 'bot')
2019-02-06 12:01:32 [WARNING ] (13, 1, 'bot')
2019-02-06 12:01:32 [WARNING ] (13, 1, 'bot')
2019-02-06 12:01:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:01:32 [DEBUG   ] Finished updating board flags in 1.992 seconds
2019-02-06 12:01:51 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-06 12:02:11 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 12:02:31 [DEBUG   ] Finished updating ant stats in 1.246 seconds
2019-02-06 12:02:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:02:32 [WARNING ] (13, 1, 'bot')
2019-02-06 12:02:32 [WARNING ] (13, 1, 'bot')
2019-02-06 12:02:32 [WARNING ] (13, 1, 'bot')
2019-02-06 12:02:32 [WARNING ] (13, 1, 'bot')
2019-02-06 12:02:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:02:32 [DEBUG   ] Finished updating board flags in 1.799 seconds
2019-02-06 12:02:51 [DEBUG   ] Finished updating ant stats in 1.154 seconds
2019-02-06 12:03:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 12:03:31 [DEBUG   ] Finished updating ant stats in 1.048 seconds
2019-02-06 12:03:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:03:32 [WARNING ] (13, 1, 'bot')
2019-02-06 12:03:32 [WARNING ] (13, 1, 'bot')
2019-02-06 12:03:32 [WARNING ] (13, 1, 'bot')
2019-02-06 12:03:32 [WARNING ] (13, 1, 'bot')
2019-02-06 12:03:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:03:32 [DEBUG   ] Finished updating board flags in 1.610 seconds
2019-02-06 12:03:51 [DEBUG   ] Finished updating ant stats in 0.955 seconds
2019-02-06 12:04:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 12:04:31 [DEBUG   ] Finished updating ant stats in 0.852 seconds
2019-02-06 12:04:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:04:32 [WARNING ] (13, 1, 'bot')
2019-02-06 12:04:32 [WARNING ] (13, 1, 'bot')
2019-02-06 12:04:32 [WARNING ] (13, 1, 'bot')
2019-02-06 12:04:32 [WARNING ] (13, 1, 'bot')
2019-02-06 12:04:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:04:32 [DEBUG   ] Finished updating board flags in 1.588 seconds
2019-02-06 12:04:51 [DEBUG   ] Finished updating ant stats in 0.752 seconds
2019-02-06 12:05:11 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 12:05:11 [DEBUG   ] Got command RPT from MCS: ref #1419106
2019-02-06 12:05:11 [DEBUG   ] summary = ERROR
2019-02-06 12:05:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419106  13 58520 43511881 A  ERRORERROR'
2019-02-06 12:05:12 [DEBUG   ] Got command RPT from MCS: ref #1419107
2019-02-06 12:05:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 12:05:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419107  77 58520 43512085 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 12:05:12 [DEBUG   ] Got command RPT from MCS: ref #1419108
2019-02-06 12:05:12 [DEBUG   ] summary = ERROR
2019-02-06 12:05:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419108  13 58520 43512289 A  ERRORERROR'
2019-02-06 12:05:12 [DEBUG   ] Got command RPT from MCS: ref #1419110
2019-02-06 12:05:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 12:05:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419110  77 58520 43512493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 12:05:12 [DEBUG   ] Got command RPT from MCS: ref #1419111
2019-02-06 12:05:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 12:05:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419111  12 58520 43512685 A  ERRORB—™š'
2019-02-06 12:05:31 [DEBUG   ] Finished updating ant stats in 0.449 seconds
2019-02-06 12:05:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:05:32 [WARNING ] (13, 1, 'bot')
2019-02-06 12:05:32 [WARNING ] (13, 1, 'bot')
2019-02-06 12:05:32 [WARNING ] (13, 1, 'bot')
2019-02-06 12:05:32 [WARNING ] (13, 1, 'bot')
2019-02-06 12:05:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:05:32 [DEBUG   ] Finished updating board flags in 1.410 seconds
2019-02-06 12:05:52 [DEBUG   ] Finished updating ant stats in 1.356 seconds
2019-02-06 12:06:12 [DEBUG   ] Got command RPT from MCS: ref #1419120
2019-02-06 12:06:12 [DEBUG   ] summary = ERROR
2019-02-06 12:06:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419120  13 58520 43572229 A  ERRORERROR'
2019-02-06 12:06:12 [DEBUG   ] Got command RPT from MCS: ref #1419121
2019-02-06 12:06:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 12:06:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419121  77 58520 43572230 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 12:06:12 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-02-06 12:06:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:06:32 [DEBUG   ] Finished updating ant stats in 1.046 seconds
2019-02-06 12:06:32 [WARNING ] (13, 1, 'bot')
2019-02-06 12:06:32 [WARNING ] (13, 1, 'bot')
2019-02-06 12:06:32 [WARNING ] (13, 1, 'bot')
2019-02-06 12:06:32 [WARNING ] (13, 1, 'bot')
2019-02-06 12:06:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:06:32 [DEBUG   ] Finished updating board flags in 1.468 seconds
2019-02-06 12:06:52 [DEBUG   ] Finished updating ant stats in 0.958 seconds
2019-02-06 12:07:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 12:07:31 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 12:07:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:07:32 [DEBUG   ] Finished updating ant stats in 0.839 seconds
2019-02-06 12:07:32 [WARNING ] (13, 1, 'bot')
2019-02-06 12:07:32 [WARNING ] (13, 1, 'bot')
2019-02-06 12:07:32 [WARNING ] (13, 1, 'bot')
2019-02-06 12:07:32 [WARNING ] (13, 1, 'bot')
2019-02-06 12:07:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:07:32 [DEBUG   ] Finished updating board flags in 1.464 seconds
2019-02-06 12:07:52 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2019-02-06 12:08:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 12:08:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:08:32 [DEBUG   ] Finished updating ant stats in 0.648 seconds
2019-02-06 12:08:32 [WARNING ] (13, 1, 'bot')
2019-02-06 12:08:32 [WARNING ] (13, 1, 'bot')
2019-02-06 12:08:32 [WARNING ] (13, 1, 'bot')
2019-02-06 12:08:32 [WARNING ] (13, 1, 'bot')
2019-02-06 12:08:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:08:32 [DEBUG   ] Finished updating board flags in 1.432 seconds
2019-02-06 12:08:52 [DEBUG   ] Finished updating ant stats in 0.555 seconds
2019-02-06 12:09:12 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-06 12:09:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:09:32 [DEBUG   ] Finished updating ant stats in 0.448 seconds
2019-02-06 12:09:32 [WARNING ] (13, 1, 'bot')
2019-02-06 12:09:32 [WARNING ] (13, 1, 'bot')
2019-02-06 12:09:32 [WARNING ] (13, 1, 'bot')
2019-02-06 12:09:32 [WARNING ] (13, 1, 'bot')
2019-02-06 12:09:32 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:09:32 [DEBUG   ] Finished updating board flags in 1.456 seconds
2019-02-06 12:09:53 [DEBUG   ] Finished updating ant stats in 1.355 seconds
2019-02-06 12:10:11 [DEBUG   ] Got command RPT from MCS: ref #1419141
2019-02-06 12:10:11 [DEBUG   ] summary = ERROR
2019-02-06 12:10:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419141  13 58520 43811973 A  ERRORERROR'
2019-02-06 12:10:12 [DEBUG   ] Got command RPT from MCS: ref #1419142
2019-02-06 12:10:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 12:10:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419142  77 58520 43812166 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 12:10:12 [DEBUG   ] Got command RPT from MCS: ref #1419143
2019-02-06 12:10:12 [DEBUG   ] summary = ERROR
2019-02-06 12:10:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419143  13 58520 43812643 A  ERRORERROR'
2019-02-06 12:10:12 [DEBUG   ] Got command RPT from MCS: ref #1419144
2019-02-06 12:10:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 12:10:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419144  77 58520 43812644 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 12:10:12 [DEBUG   ] Got command RPT from MCS: ref #1419145
2019-02-06 12:10:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 12:10:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419145  12 58520 43812797 A  ERRORB˜™š'
2019-02-06 12:10:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 12:10:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:10:33 [DEBUG   ] Finished updating ant stats in 1.248 seconds
2019-02-06 12:10:33 [WARNING ] (13, 1, 'bot')
2019-02-06 12:10:33 [WARNING ] (13, 1, 'bot')
2019-02-06 12:10:33 [WARNING ] (13, 1, 'bot')
2019-02-06 12:10:33 [WARNING ] (13, 1, 'bot')
2019-02-06 12:10:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:10:33 [DEBUG   ] Finished updating board flags in 2.258 seconds
2019-02-06 12:10:53 [DEBUG   ] Finished updating ant stats in 1.156 seconds
2019-02-06 12:11:12 [DEBUG   ] Got command RPT from MCS: ref #1419146
2019-02-06 12:11:12 [DEBUG   ] summary = ERROR
2019-02-06 12:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419146  13 58520 43872225 A  ERRORERROR'
2019-02-06 12:11:12 [DEBUG   ] Got command RPT from MCS: ref #1419147
2019-02-06 12:11:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 12:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419147  77 58520 43872226 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 12:11:13 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-06 12:11:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 12:11:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:11:33 [DEBUG   ] Finished updating ant stats in 0.847 seconds
2019-02-06 12:11:33 [WARNING ] (13, 1, 'bot')
2019-02-06 12:11:33 [WARNING ] (13, 1, 'bot')
2019-02-06 12:11:33 [WARNING ] (13, 1, 'bot')
2019-02-06 12:11:33 [WARNING ] (13, 1, 'bot')
2019-02-06 12:11:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:11:33 [DEBUG   ] Finished updating board flags in 2.182 seconds
2019-02-06 12:11:53 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2019-02-06 12:12:13 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2019-02-06 12:12:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:12:33 [DEBUG   ] Finished updating ant stats in 0.643 seconds
2019-02-06 12:12:33 [WARNING ] (13, 1, 'bot')
2019-02-06 12:12:33 [WARNING ] (13, 1, 'bot')
2019-02-06 12:12:33 [WARNING ] (13, 1, 'bot')
2019-02-06 12:12:33 [WARNING ] (13, 1, 'bot')
2019-02-06 12:12:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:12:33 [DEBUG   ] Finished updating board flags in 2.034 seconds
2019-02-06 12:12:53 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2019-02-06 12:13:13 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-02-06 12:13:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:13:33 [WARNING ] (13, 1, 'bot')
2019-02-06 12:13:33 [WARNING ] (13, 1, 'bot')
2019-02-06 12:13:33 [WARNING ] (13, 1, 'bot')
2019-02-06 12:13:33 [WARNING ] (13, 1, 'bot')
2019-02-06 12:13:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:13:33 [DEBUG   ] Finished updating board flags in 1.983 seconds
2019-02-06 12:13:34 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2019-02-06 12:13:54 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-06 12:14:14 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 12:14:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:14:34 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-06 12:14:34 [WARNING ] (13, 1, 'bot')
2019-02-06 12:14:34 [WARNING ] (13, 1, 'bot')
2019-02-06 12:14:34 [WARNING ] (13, 1, 'bot')
2019-02-06 12:14:34 [WARNING ] (13, 1, 'bot')
2019-02-06 12:14:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:14:34 [DEBUG   ] Finished updating board flags in 2.897 seconds
2019-02-06 12:14:54 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-02-06 12:15:12 [DEBUG   ] Got command RPT from MCS: ref #1419173
2019-02-06 12:15:12 [DEBUG   ] summary = ERROR
2019-02-06 12:15:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419173  13 58520 44112049 A  ERRORERROR'
2019-02-06 12:15:12 [DEBUG   ] Got command RPT from MCS: ref #1419174
2019-02-06 12:15:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 12:15:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419174  77 58520 44112253 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 12:15:12 [DEBUG   ] Got command RPT from MCS: ref #1419175
2019-02-06 12:15:12 [DEBUG   ] summary = ERROR
2019-02-06 12:15:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419175  13 58520 44112457 A  ERRORERROR'
2019-02-06 12:15:12 [DEBUG   ] Got command RPT from MCS: ref #1419177
2019-02-06 12:15:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 12:15:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419177  77 58520 44112661 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 12:15:12 [DEBUG   ] Got command RPT from MCS: ref #1419178
2019-02-06 12:15:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 12:15:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419178  12 58520 44112853 A  ERRORB—™š'
2019-02-06 12:15:14 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-02-06 12:15:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:15:33 [WARNING ] (13, 1, 'bot')
2019-02-06 12:15:33 [WARNING ] (13, 1, 'bot')
2019-02-06 12:15:33 [WARNING ] (13, 1, 'bot')
2019-02-06 12:15:33 [WARNING ] (13, 1, 'bot')
2019-02-06 12:15:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:15:33 [DEBUG   ] Finished updating board flags in 1.691 seconds
2019-02-06 12:15:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 12:15:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 12:16:12 [DEBUG   ] Got command RPT from MCS: ref #1419183
2019-02-06 12:16:12 [DEBUG   ] summary = ERROR
2019-02-06 12:16:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419183  13 58520 44172221 A  ERRORERROR'
2019-02-06 12:16:12 [DEBUG   ] Got command RPT from MCS: ref #1419184
2019-02-06 12:16:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 12:16:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419184  77 58520 44172222 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 12:16:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 12:16:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:16:33 [WARNING ] (13, 1, 'bot')
2019-02-06 12:16:33 [WARNING ] (13, 1, 'bot')
2019-02-06 12:16:33 [WARNING ] (13, 1, 'bot')
2019-02-06 12:16:33 [WARNING ] (13, 1, 'bot')
2019-02-06 12:16:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:16:33 [DEBUG   ] Finished updating board flags in 1.587 seconds
2019-02-06 12:16:34 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-06 12:16:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 12:17:14 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 12:17:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:17:34 [DEBUG   ] Finished updating ant stats in 0.642 seconds
2019-02-06 12:17:34 [WARNING ] (13, 1, 'bot')
2019-02-06 12:17:34 [WARNING ] (13, 1, 'bot')
2019-02-06 12:17:34 [WARNING ] (13, 1, 'bot')
2019-02-06 12:17:34 [WARNING ] (13, 1, 'bot')
2019-02-06 12:17:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:17:34 [DEBUG   ] Finished updating board flags in 2.455 seconds
2019-02-06 12:17:54 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2019-02-06 12:18:15 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-02-06 12:18:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:18:33 [WARNING ] (13, 1, 'bot')
2019-02-06 12:18:33 [WARNING ] (13, 1, 'bot')
2019-02-06 12:18:33 [WARNING ] (13, 1, 'bot')
2019-02-06 12:18:33 [WARNING ] (13, 1, 'bot')
2019-02-06 12:18:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:18:33 [DEBUG   ] Finished updating board flags in 1.321 seconds
2019-02-06 12:18:35 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-06 12:18:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 12:19:15 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 12:19:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:19:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-06 12:19:33 [WARNING ] (13, 1, 'bot')
2019-02-06 12:19:33 [WARNING ] (13, 1, 'bot')
2019-02-06 12:19:33 [WARNING ] (13, 1, 'bot')
2019-02-06 12:19:33 [WARNING ] (13, 1, 'bot')
2019-02-06 12:19:33 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:19:33 [DEBUG   ] Finished updating board flags in 1.356 seconds
2019-02-06 12:19:35 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2019-02-06 12:19:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 12:20:12 [DEBUG   ] Got command RPT from MCS: ref #1419204
2019-02-06 12:20:12 [DEBUG   ] summary = ERROR
2019-02-06 12:20:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419204  13 58520 44412129 A  ERRORERROR'
2019-02-06 12:20:12 [DEBUG   ] Got command RPT from MCS: ref #1419205
2019-02-06 12:20:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 12:20:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419205  77 58520 44412334 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 12:20:12 [DEBUG   ] Got command RPT from MCS: ref #1419206
2019-02-06 12:20:12 [DEBUG   ] summary = ERROR
2019-02-06 12:20:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419206  13 58520 44412537 A  ERRORERROR'
2019-02-06 12:20:12 [DEBUG   ] Got command RPT from MCS: ref #1419207
2019-02-06 12:20:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 12:20:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419207  77 58520 44412741 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 12:20:12 [DEBUG   ] Got command RPT from MCS: ref #1419208
2019-02-06 12:20:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 12:20:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419208  12 58520 44412933 A  ERRORB—™š'
2019-02-06 12:20:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 12:20:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:20:34 [WARNING ] (13, 1, 'bot')
2019-02-06 12:20:34 [WARNING ] (13, 1, 'bot')
2019-02-06 12:20:34 [WARNING ] (13, 1, 'bot')
2019-02-06 12:20:34 [WARNING ] (13, 1, 'bot')
2019-02-06 12:20:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:20:34 [DEBUG   ] Finished updating board flags in 2.093 seconds
2019-02-06 12:20:35 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 12:20:55 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-06 12:21:12 [DEBUG   ] Got command RPT from MCS: ref #1419213
2019-02-06 12:21:12 [DEBUG   ] summary = ERROR
2019-02-06 12:21:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419213  13 58520 44472225 A  ERRORERROR'
2019-02-06 12:21:12 [DEBUG   ] Got command RPT from MCS: ref #1419214
2019-02-06 12:21:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 12:21:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419214  77 58520 44472226 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 12:21:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 12:21:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:21:34 [WARNING ] (13, 1, 'bot')
2019-02-06 12:21:34 [WARNING ] (13, 1, 'bot')
2019-02-06 12:21:34 [WARNING ] (13, 1, 'bot')
2019-02-06 12:21:34 [WARNING ] (13, 1, 'bot')
2019-02-06 12:21:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:21:34 [DEBUG   ] Finished updating board flags in 2.007 seconds
2019-02-06 12:21:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 12:21:55 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 12:22:15 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 12:22:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:22:34 [WARNING ] (13, 1, 'bot')
2019-02-06 12:22:34 [WARNING ] (13, 1, 'bot')
2019-02-06 12:22:34 [WARNING ] (13, 1, 'bot')
2019-02-06 12:22:34 [WARNING ] (13, 1, 'bot')
2019-02-06 12:22:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:22:34 [DEBUG   ] Finished updating board flags in 1.995 seconds
2019-02-06 12:22:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 12:22:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 12:23:15 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 12:23:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 12:23:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:23:34 [WARNING ] (13, 1, 'bot')
2019-02-06 12:23:34 [WARNING ] (13, 1, 'bot')
2019-02-06 12:23:34 [WARNING ] (13, 1, 'bot')
2019-02-06 12:23:34 [WARNING ] (13, 1, 'bot')
2019-02-06 12:23:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:23:34 [DEBUG   ] Finished updating board flags in 1.821 seconds
2019-02-06 12:23:35 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 12:23:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-06 12:24:16 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-02-06 12:24:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:24:34 [WARNING ] (13, 1, 'bot')
2019-02-06 12:24:34 [WARNING ] (13, 1, 'bot')
2019-02-06 12:24:34 [WARNING ] (13, 1, 'bot')
2019-02-06 12:24:34 [WARNING ] (13, 1, 'bot')
2019-02-06 12:24:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:24:34 [DEBUG   ] Finished updating board flags in 1.740 seconds
2019-02-06 12:24:36 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-02-06 12:24:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 12:25:12 [DEBUG   ] Got command RPT from MCS: ref #1419236
2019-02-06 12:25:12 [DEBUG   ] summary = ERROR
2019-02-06 12:25:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419236  13 58520 44712213 A  ERRORERROR'
2019-02-06 12:25:12 [DEBUG   ] Got command RPT from MCS: ref #1419237
2019-02-06 12:25:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 12:25:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419237  77 58520 44712417 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 12:25:12 [DEBUG   ] Got command RPT from MCS: ref #1419238
2019-02-06 12:25:12 [DEBUG   ] summary = ERROR
2019-02-06 12:25:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419238  13 58520 44712621 A  ERRORERROR'
2019-02-06 12:25:12 [DEBUG   ] Got command RPT from MCS: ref #1419240
2019-02-06 12:25:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 12:25:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419240  77 58520 44712813 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 12:25:13 [DEBUG   ] Got command RPT from MCS: ref #1419241
2019-02-06 12:25:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 12:25:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419241  12 58520 44713017 A  ERRORB—™š'
2019-02-06 12:25:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 12:25:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 12:25:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:25:34 [WARNING ] (13, 1, 'bot')
2019-02-06 12:25:34 [WARNING ] (13, 1, 'bot')
2019-02-06 12:25:34 [WARNING ] (13, 1, 'bot')
2019-02-06 12:25:34 [WARNING ] (13, 1, 'bot')
2019-02-06 12:25:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:25:34 [DEBUG   ] Finished updating board flags in 1.622 seconds
2019-02-06 12:25:36 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 12:25:56 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 12:26:12 [DEBUG   ] Got command RPT from MCS: ref #1419246
2019-02-06 12:26:12 [DEBUG   ] summary = ERROR
2019-02-06 12:26:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419246  13 58520 44772233 A  ERRORERROR'
2019-02-06 12:26:12 [DEBUG   ] Got command RPT from MCS: ref #1419247
2019-02-06 12:26:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 12:26:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419247  77 58520 44772234 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 12:26:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 12:26:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:26:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-02-06 12:26:34 [WARNING ] (13, 1, 'bot')
2019-02-06 12:26:34 [WARNING ] (13, 1, 'bot')
2019-02-06 12:26:34 [WARNING ] (13, 1, 'bot')
2019-02-06 12:26:34 [WARNING ] (13, 1, 'bot')
2019-02-06 12:26:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:26:34 [DEBUG   ] Finished updating board flags in 1.583 seconds
2019-02-06 12:26:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 12:26:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 12:27:16 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-06 12:27:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:27:34 [WARNING ] (13, 1, 'bot')
2019-02-06 12:27:34 [WARNING ] (13, 1, 'bot')
2019-02-06 12:27:34 [WARNING ] (13, 1, 'bot')
2019-02-06 12:27:34 [WARNING ] (13, 1, 'bot')
2019-02-06 12:27:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:27:34 [DEBUG   ] Finished updating board flags in 1.438 seconds
2019-02-06 12:27:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 12:27:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 12:28:16 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 12:28:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:28:34 [WARNING ] (13, 1, 'bot')
2019-02-06 12:28:34 [WARNING ] (13, 1, 'bot')
2019-02-06 12:28:34 [WARNING ] (13, 1, 'bot')
2019-02-06 12:28:34 [WARNING ] (13, 1, 'bot')
2019-02-06 12:28:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:28:34 [DEBUG   ] Finished updating board flags in 1.370 seconds
2019-02-06 12:28:36 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 12:28:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 12:29:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 12:29:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:29:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-02-06 12:29:34 [WARNING ] (13, 1, 'bot')
2019-02-06 12:29:34 [WARNING ] (13, 1, 'bot')
2019-02-06 12:29:34 [WARNING ] (13, 1, 'bot')
2019-02-06 12:29:34 [WARNING ] (13, 1, 'bot')
2019-02-06 12:29:34 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:29:34 [DEBUG   ] Finished updating board flags in 1.377 seconds
2019-02-06 12:29:36 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 12:29:57 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2019-02-06 12:30:12 [DEBUG   ] Got command RPT from MCS: ref #1419271
2019-02-06 12:30:12 [DEBUG   ] summary = ERROR
2019-02-06 12:30:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419271  13 58520 45012301 A  ERRORERROR'
2019-02-06 12:30:12 [DEBUG   ] Got command RPT from MCS: ref #1419272
2019-02-06 12:30:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 12:30:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419272  77 58520 45012493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 12:30:12 [DEBUG   ] Got command RPT from MCS: ref #1419273
2019-02-06 12:30:12 [DEBUG   ] summary = ERROR
2019-02-06 12:30:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419273  13 58520 45012697 A  ERRORERROR'
2019-02-06 12:30:12 [DEBUG   ] Got command RPT from MCS: ref #1419274
2019-02-06 12:30:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 12:30:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419274  77 58520 45012901 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 12:30:13 [DEBUG   ] Got command RPT from MCS: ref #1419275
2019-02-06 12:30:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 12:30:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419275  12 58520 45013093 A  ERRORB–™š'
2019-02-06 12:30:17 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-06 12:30:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:30:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-02-06 12:30:35 [WARNING ] (13, 1, 'bot')
2019-02-06 12:30:35 [WARNING ] (13, 1, 'bot')
2019-02-06 12:30:35 [WARNING ] (13, 1, 'bot')
2019-02-06 12:30:35 [WARNING ] (13, 1, 'bot')
2019-02-06 12:30:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:30:35 [DEBUG   ] Finished updating board flags in 2.032 seconds
2019-02-06 12:30:37 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 12:30:57 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 12:31:12 [DEBUG   ] Got command RPT from MCS: ref #1419276
2019-02-06 12:31:12 [DEBUG   ] summary = ERROR
2019-02-06 12:31:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419276  13 58520 45072269 A  ERRORERROR'
2019-02-06 12:31:12 [DEBUG   ] Got command RPT from MCS: ref #1419277
2019-02-06 12:31:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 12:31:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419277  77 58520 45072560 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 12:31:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 12:31:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:31:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-06 12:31:35 [WARNING ] (13, 1, 'bot')
2019-02-06 12:31:35 [WARNING ] (13, 1, 'bot')
2019-02-06 12:31:35 [WARNING ] (13, 1, 'bot')
2019-02-06 12:31:35 [WARNING ] (13, 1, 'bot')
2019-02-06 12:31:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:31:35 [DEBUG   ] Finished updating board flags in 1.985 seconds
2019-02-06 12:31:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 12:31:57 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-06 12:32:17 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 12:32:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:32:35 [WARNING ] (13, 1, 'bot')
2019-02-06 12:32:35 [WARNING ] (13, 1, 'bot')
2019-02-06 12:32:35 [WARNING ] (13, 1, 'bot')
2019-02-06 12:32:35 [WARNING ] (13, 1, 'bot')
2019-02-06 12:32:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:32:35 [DEBUG   ] Finished updating board flags in 1.817 seconds
2019-02-06 12:32:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 12:32:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 12:33:17 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 12:33:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:33:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-06 12:33:35 [WARNING ] (13, 1, 'bot')
2019-02-06 12:33:35 [WARNING ] (13, 1, 'bot')
2019-02-06 12:33:35 [WARNING ] (13, 1, 'bot')
2019-02-06 12:33:35 [WARNING ] (13, 1, 'bot')
2019-02-06 12:33:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:33:35 [DEBUG   ] Finished updating board flags in 1.793 seconds
2019-02-06 12:33:37 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 12:33:58 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-02-06 12:34:18 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-02-06 12:34:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:34:35 [WARNING ] (13, 1, 'bot')
2019-02-06 12:34:35 [WARNING ] (13, 1, 'bot')
2019-02-06 12:34:35 [WARNING ] (13, 1, 'bot')
2019-02-06 12:34:35 [WARNING ] (13, 1, 'bot')
2019-02-06 12:34:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:34:35 [DEBUG   ] Finished updating board flags in 1.607 seconds
2019-02-06 12:34:38 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-02-06 12:34:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 12:35:12 [DEBUG   ] Got command RPT from MCS: ref #1419299
2019-02-06 12:35:12 [DEBUG   ] summary = ERROR
2019-02-06 12:35:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419299  13 58520 45312373 A  ERRORERROR'
2019-02-06 12:35:12 [DEBUG   ] Got command RPT from MCS: ref #1419300
2019-02-06 12:35:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 12:35:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419300  77 58520 45312577 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 12:35:12 [DEBUG   ] Got command RPT from MCS: ref #1419301
2019-02-06 12:35:12 [DEBUG   ] summary = ERROR
2019-02-06 12:35:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419301  13 58520 45312781 A  ERRORERROR'
2019-02-06 12:35:12 [DEBUG   ] Got command RPT from MCS: ref #1419303
2019-02-06 12:35:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 12:35:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419303  77 58520 45312973 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 12:35:13 [DEBUG   ] Got command RPT from MCS: ref #1419304
2019-02-06 12:35:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 12:35:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419304  12 58520 45313177 A  ERRORB—™š'
2019-02-06 12:35:18 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 12:35:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:35:35 [WARNING ] (13, 1, 'bot')
2019-02-06 12:35:35 [WARNING ] (13, 1, 'bot')
2019-02-06 12:35:35 [WARNING ] (13, 1, 'bot')
2019-02-06 12:35:35 [WARNING ] (13, 1, 'bot')
2019-02-06 12:35:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:35:35 [DEBUG   ] Finished updating board flags in 1.590 seconds
2019-02-06 12:35:38 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-06 12:35:58 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-06 12:36:12 [DEBUG   ] Got command RPT from MCS: ref #1419313
2019-02-06 12:36:12 [DEBUG   ] summary = ERROR
2019-02-06 12:36:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419313  13 58520 45372225 A  ERRORERROR'
2019-02-06 12:36:12 [DEBUG   ] Got command RPT from MCS: ref #1419314
2019-02-06 12:36:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 12:36:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419314  77 58520 45372226 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 12:36:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 12:36:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:36:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-06 12:36:35 [WARNING ] (13, 1, 'bot')
2019-02-06 12:36:35 [WARNING ] (13, 1, 'bot')
2019-02-06 12:36:35 [WARNING ] (13, 1, 'bot')
2019-02-06 12:36:35 [WARNING ] (13, 1, 'bot')
2019-02-06 12:36:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:36:35 [DEBUG   ] Finished updating board flags in 1.418 seconds
2019-02-06 12:36:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 12:36:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 12:37:18 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-02-06 12:37:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:37:35 [WARNING ] (13, 1, 'bot')
2019-02-06 12:37:35 [WARNING ] (13, 1, 'bot')
2019-02-06 12:37:35 [WARNING ] (13, 1, 'bot')
2019-02-06 12:37:35 [WARNING ] (13, 1, 'bot')
2019-02-06 12:37:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:37:35 [DEBUG   ] Finished updating board flags in 1.407 seconds
2019-02-06 12:37:38 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2019-02-06 12:37:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 12:38:19 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2019-02-06 12:38:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:38:35 [WARNING ] (13, 1, 'bot')
2019-02-06 12:38:35 [WARNING ] (13, 1, 'bot')
2019-02-06 12:38:35 [WARNING ] (13, 1, 'bot')
2019-02-06 12:38:35 [WARNING ] (13, 1, 'bot')
2019-02-06 12:38:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:38:35 [DEBUG   ] Finished updating board flags in 1.421 seconds
2019-02-06 12:38:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 12:38:59 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 12:39:19 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 12:39:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:39:35 [WARNING ] (13, 1, 'bot')
2019-02-06 12:39:35 [WARNING ] (13, 1, 'bot')
2019-02-06 12:39:35 [WARNING ] (13, 1, 'bot')
2019-02-06 12:39:35 [WARNING ] (13, 1, 'bot')
2019-02-06 12:39:35 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:39:35 [DEBUG   ] Finished updating board flags in 1.377 seconds
2019-02-06 12:39:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 12:39:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 12:40:12 [DEBUG   ] Got command RPT from MCS: ref #1419334
2019-02-06 12:40:12 [DEBUG   ] summary = ERROR
2019-02-06 12:40:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419334  13 58520 45612457 A  ERRORERROR'
2019-02-06 12:40:12 [DEBUG   ] Got command RPT from MCS: ref #1419335
2019-02-06 12:40:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 12:40:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419335  77 58520 45612661 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 12:40:12 [DEBUG   ] Got command RPT from MCS: ref #1419336
2019-02-06 12:40:12 [DEBUG   ] summary = ERROR
2019-02-06 12:40:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419336  13 58520 45612853 A  ERRORERROR'
2019-02-06 12:40:13 [DEBUG   ] Got command RPT from MCS: ref #1419337
2019-02-06 12:40:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 12:40:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419337  77 58520 45613057 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 12:40:13 [DEBUG   ] Got command RPT from MCS: ref #1419338
2019-02-06 12:40:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 12:40:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419338  12 58520 45613261 A  ERRORB–™š'
2019-02-06 12:40:19 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 12:40:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:40:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:40:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:40:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:40:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:40:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:40:36 [DEBUG   ] Finished updating board flags in 2.211 seconds
2019-02-06 12:40:39 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-06 12:40:59 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-06 12:41:12 [DEBUG   ] Got command RPT from MCS: ref #1419339
2019-02-06 12:41:12 [DEBUG   ] summary = ERROR
2019-02-06 12:41:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419339  13 58520 45672287 A  ERRORERROR'
2019-02-06 12:41:12 [DEBUG   ] Got command RPT from MCS: ref #1419340
2019-02-06 12:41:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 12:41:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419340  77 58520 45672287 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 12:41:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 12:41:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:41:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:41:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:41:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:41:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:41:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:41:36 [DEBUG   ] Finished updating board flags in 2.179 seconds
2019-02-06 12:41:39 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 12:41:59 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 12:42:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 12:42:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 12:42:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:42:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:42:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:42:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:42:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:42:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:42:36 [DEBUG   ] Finished updating board flags in 2.017 seconds
2019-02-06 12:42:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 12:42:59 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 12:43:19 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 12:43:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:43:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:43:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:43:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:43:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:43:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:43:36 [DEBUG   ] Finished updating board flags in 2.014 seconds
2019-02-06 12:43:40 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-02-06 12:44:00 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-02-06 12:44:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 12:44:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 12:44:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:44:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-06 12:44:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:44:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:44:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:44:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:44:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:44:36 [DEBUG   ] Finished updating board flags in 1.970 seconds
2019-02-06 12:44:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 12:45:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 12:45:12 [DEBUG   ] Got command RPT from MCS: ref #1419366
2019-02-06 12:45:12 [DEBUG   ] summary = ERROR
2019-02-06 12:45:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419366  13 58520 45912537 A  ERRORERROR'
2019-02-06 12:45:12 [DEBUG   ] Got command RPT from MCS: ref #1419367
2019-02-06 12:45:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 12:45:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419367  77 58520 45912741 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 12:45:12 [DEBUG   ] Got command RPT from MCS: ref #1419368
2019-02-06 12:45:12 [DEBUG   ] summary = ERROR
2019-02-06 12:45:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419368  13 58520 45912933 A  ERRORERROR'
2019-02-06 12:45:13 [DEBUG   ] Got command RPT from MCS: ref #1419370
2019-02-06 12:45:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 12:45:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419370  77 58520 45913137 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 12:45:13 [DEBUG   ] Got command RPT from MCS: ref #1419371
2019-02-06 12:45:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 12:45:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419371  12 58520 45913341 A  ERRORB—™š'
2019-02-06 12:45:20 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 12:45:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 12:45:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:45:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:45:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:45:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:45:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:45:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:45:36 [DEBUG   ] Finished updating board flags in 1.887 seconds
2019-02-06 12:45:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 12:46:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 12:46:12 [DEBUG   ] Got command RPT from MCS: ref #1419376
2019-02-06 12:46:12 [DEBUG   ] summary = ERROR
2019-02-06 12:46:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419376  13 58520 45972233 A  ERRORERROR'
2019-02-06 12:46:12 [DEBUG   ] Got command RPT from MCS: ref #1419377
2019-02-06 12:46:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 12:46:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419377  77 58520 45972234 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 12:46:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 12:46:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 12:46:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:46:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:46:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:46:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:46:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:46:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:46:36 [DEBUG   ] Finished updating board flags in 1.732 seconds
2019-02-06 12:46:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 12:47:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 12:47:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 12:47:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:47:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:47:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:47:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:47:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:47:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:47:36 [DEBUG   ] Finished updating board flags in 1.613 seconds
2019-02-06 12:47:40 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-02-06 12:48:00 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 12:48:20 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 12:48:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:48:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:48:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:48:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:48:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:48:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:48:36 [DEBUG   ] Finished updating board flags in 1.584 seconds
2019-02-06 12:48:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 12:49:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 12:49:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 12:49:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:49:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:49:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:49:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:49:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:49:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:49:36 [DEBUG   ] Finished updating board flags in 1.433 seconds
2019-02-06 12:49:40 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-06 12:50:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 12:50:12 [DEBUG   ] Got command RPT from MCS: ref #1419397
2019-02-06 12:50:12 [DEBUG   ] summary = ERROR
2019-02-06 12:50:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419397  13 58520 46212621 A  ERRORERROR'
2019-02-06 12:50:12 [DEBUG   ] Got command RPT from MCS: ref #1419398
2019-02-06 12:50:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 12:50:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419398  77 58520 46212813 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 12:50:13 [DEBUG   ] Got command RPT from MCS: ref #1419399
2019-02-06 12:50:13 [DEBUG   ] summary = ERROR
2019-02-06 12:50:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419399  13 58520 46213021 A  ERRORERROR'
2019-02-06 12:50:13 [DEBUG   ] Got command RPT from MCS: ref #1419400
2019-02-06 12:50:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 12:50:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419400  77 58520 46213213 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 12:50:13 [DEBUG   ] Got command RPT from MCS: ref #1419401
2019-02-06 12:50:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 12:50:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419401  12 58520 46213417 A  ERRORB—™š'
2019-02-06 12:50:20 [DEBUG   ] Finished updating ant stats in 0.808 seconds
2019-02-06 12:50:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:50:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:50:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:50:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:50:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:50:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:50:36 [DEBUG   ] Finished updating board flags in 1.434 seconds
2019-02-06 12:50:40 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-02-06 12:51:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 12:51:12 [DEBUG   ] Got command RPT from MCS: ref #1419406
2019-02-06 12:51:12 [DEBUG   ] summary = ERROR
2019-02-06 12:51:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419406  13 58520 46272237 A  ERRORERROR'
2019-02-06 12:51:12 [DEBUG   ] Got command RPT from MCS: ref #1419407
2019-02-06 12:51:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 12:51:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419407  77 58520 46272238 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 12:51:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 12:51:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:51:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:51:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:51:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:51:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:51:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:51:36 [DEBUG   ] Finished updating board flags in 1.433 seconds
2019-02-06 12:51:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 12:52:00 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 12:52:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 12:52:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:52:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:52:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:52:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:52:36 [WARNING ] (13, 1, 'bot')
2019-02-06 12:52:36 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:52:36 [DEBUG   ] Finished updating board flags in 1.543 seconds
2019-02-06 12:52:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 12:53:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 12:53:20 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 12:53:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:53:37 [WARNING ] (13, 1, 'bot')
2019-02-06 12:53:37 [WARNING ] (13, 1, 'bot')
2019-02-06 12:53:37 [WARNING ] (13, 1, 'bot')
2019-02-06 12:53:37 [WARNING ] (13, 1, 'bot')
2019-02-06 12:53:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:53:37 [DEBUG   ] Finished updating board flags in 2.278 seconds
2019-02-06 12:53:40 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2019-02-06 12:54:00 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-06 12:54:20 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-06 12:54:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:54:37 [WARNING ] (13, 1, 'bot')
2019-02-06 12:54:37 [WARNING ] (13, 1, 'bot')
2019-02-06 12:54:37 [WARNING ] (13, 1, 'bot')
2019-02-06 12:54:37 [WARNING ] (13, 1, 'bot')
2019-02-06 12:54:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:54:37 [DEBUG   ] Finished updating board flags in 2.079 seconds
2019-02-06 12:54:41 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-02-06 12:55:01 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2019-02-06 12:55:12 [DEBUG   ] Got command RPT from MCS: ref #1419429
2019-02-06 12:55:12 [DEBUG   ] summary = ERROR
2019-02-06 12:55:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419429  13 58520 46512701 A  ERRORERROR'
2019-02-06 12:55:12 [DEBUG   ] Got command RPT from MCS: ref #1419430
2019-02-06 12:55:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 12:55:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419430  77 58520 46512893 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 12:55:13 [DEBUG   ] Got command RPT from MCS: ref #1419431
2019-02-06 12:55:13 [DEBUG   ] summary = ERROR
2019-02-06 12:55:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419431  13 58520 46513097 A  ERRORERROR'
2019-02-06 12:55:13 [DEBUG   ] Got command RPT from MCS: ref #1419432
2019-02-06 12:55:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 12:55:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419432  77 58520 46513301 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 12:55:13 [DEBUG   ] Got command RPT from MCS: ref #1419434
2019-02-06 12:55:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 12:55:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419434  12 58520 46513493 A  ERRORB–™š'
2019-02-06 12:55:21 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-02-06 12:55:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:55:37 [WARNING ] (13, 1, 'bot')
2019-02-06 12:55:37 [WARNING ] (13, 1, 'bot')
2019-02-06 12:55:37 [WARNING ] (13, 1, 'bot')
2019-02-06 12:55:37 [WARNING ] (13, 1, 'bot')
2019-02-06 12:55:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:55:37 [DEBUG   ] Finished updating board flags in 2.017 seconds
2019-02-06 12:55:41 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 12:56:01 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-06 12:56:12 [DEBUG   ] Got command RPT from MCS: ref #1419439
2019-02-06 12:56:12 [DEBUG   ] summary = ERROR
2019-02-06 12:56:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419439  13 58520 46572233 A  ERRORERROR'
2019-02-06 12:56:12 [DEBUG   ] Got command RPT from MCS: ref #1419440
2019-02-06 12:56:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 12:56:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419440  77 58520 46572234 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 12:56:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 12:56:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:56:37 [WARNING ] (13, 1, 'bot')
2019-02-06 12:56:37 [WARNING ] (13, 1, 'bot')
2019-02-06 12:56:37 [WARNING ] (13, 1, 'bot')
2019-02-06 12:56:37 [WARNING ] (13, 1, 'bot')
2019-02-06 12:56:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:56:37 [DEBUG   ] Finished updating board flags in 1.993 seconds
2019-02-06 12:56:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 12:57:01 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2019-02-06 12:57:21 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2019-02-06 12:57:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:57:37 [WARNING ] (13, 1, 'bot')
2019-02-06 12:57:37 [WARNING ] (13, 1, 'bot')
2019-02-06 12:57:37 [WARNING ] (13, 1, 'bot')
2019-02-06 12:57:37 [WARNING ] (13, 1, 'bot')
2019-02-06 12:57:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:57:37 [DEBUG   ] Finished updating board flags in 1.807 seconds
2019-02-06 12:57:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 12:58:01 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2019-02-06 12:58:21 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2019-02-06 12:58:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:58:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2019-02-06 12:58:37 [WARNING ] (13, 1, 'bot')
2019-02-06 12:58:37 [WARNING ] (13, 1, 'bot')
2019-02-06 12:58:37 [WARNING ] (13, 1, 'bot')
2019-02-06 12:58:37 [WARNING ] (13, 1, 'bot')
2019-02-06 12:58:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:58:37 [DEBUG   ] Finished updating board flags in 1.794 seconds
2019-02-06 12:58:42 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2019-02-06 12:59:02 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2019-02-06 12:59:22 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 12:59:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 12:59:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 12:59:37 [WARNING ] (13, 1, 'bot')
2019-02-06 12:59:37 [WARNING ] (13, 1, 'bot')
2019-02-06 12:59:37 [WARNING ] (13, 1, 'bot')
2019-02-06 12:59:37 [WARNING ] (13, 1, 'bot')
2019-02-06 12:59:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 12:59:37 [DEBUG   ] Finished updating board flags in 1.618 seconds
2019-02-06 12:59:42 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2019-02-06 13:00:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 13:00:12 [DEBUG   ] Got command RPT from MCS: ref #1419464
2019-02-06 13:00:12 [DEBUG   ] summary = ERROR
2019-02-06 13:00:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419464  13 58520 46812781 A  ERRORERROR'
2019-02-06 13:00:12 [DEBUG   ] Got command RPT from MCS: ref #1419465
2019-02-06 13:00:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 13:00:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419465  77 58520 46812973 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 13:00:13 [DEBUG   ] Got command RPT from MCS: ref #1419466
2019-02-06 13:00:13 [DEBUG   ] summary = ERROR
2019-02-06 13:00:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419466  13 58520 46813177 A  ERRORERROR'
2019-02-06 13:00:13 [DEBUG   ] Got command RPT from MCS: ref #1419467
2019-02-06 13:00:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 13:00:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419467  77 58520 46813381 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 13:00:13 [DEBUG   ] Got command RPT from MCS: ref #1419468
2019-02-06 13:00:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 13:00:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419468  12 58520 46813585 A  ERRORB˜™š'
2019-02-06 13:00:22 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2019-02-06 13:00:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 13:00:37 [WARNING ] (13, 1, 'bot')
2019-02-06 13:00:37 [WARNING ] (13, 1, 'bot')
2019-02-06 13:00:37 [WARNING ] (13, 1, 'bot')
2019-02-06 13:00:37 [WARNING ] (13, 1, 'bot')
2019-02-06 13:00:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 13:00:37 [DEBUG   ] Finished updating board flags in 1.584 seconds
2019-02-06 13:00:42 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2019-02-06 13:01:02 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-06 13:01:12 [DEBUG   ] Got command RPT from MCS: ref #1419469
2019-02-06 13:01:12 [DEBUG   ] summary = ERROR
2019-02-06 13:01:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419469  13 58520 46872240 A  ERRORERROR'
2019-02-06 13:01:12 [DEBUG   ] Got command RPT from MCS: ref #1419470
2019-02-06 13:01:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 13:01:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419470  77 58520 46872240 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 13:01:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 13:01:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 13:01:37 [WARNING ] (13, 1, 'bot')
2019-02-06 13:01:37 [WARNING ] (13, 1, 'bot')
2019-02-06 13:01:37 [WARNING ] (13, 1, 'bot')
2019-02-06 13:01:37 [WARNING ] (13, 1, 'bot')
2019-02-06 13:01:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 13:01:37 [DEBUG   ] Finished updating board flags in 1.426 seconds
2019-02-06 13:01:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 13:02:02 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 13:02:22 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-02-06 13:02:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 13:02:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-02-06 13:02:37 [WARNING ] (13, 1, 'bot')
2019-02-06 13:02:37 [WARNING ] (13, 1, 'bot')
2019-02-06 13:02:37 [WARNING ] (13, 1, 'bot')
2019-02-06 13:02:37 [WARNING ] (13, 1, 'bot')
2019-02-06 13:02:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 13:02:37 [DEBUG   ] Finished updating board flags in 1.387 seconds
2019-02-06 13:02:43 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2019-02-06 13:03:02 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2019-02-06 13:03:23 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2019-02-06 13:03:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 13:03:37 [WARNING ] (13, 1, 'bot')
2019-02-06 13:03:37 [WARNING ] (13, 1, 'bot')
2019-02-06 13:03:37 [WARNING ] (13, 1, 'bot')
2019-02-06 13:03:37 [WARNING ] (13, 1, 'bot')
2019-02-06 13:03:37 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 13:03:37 [DEBUG   ] Finished updating board flags in 1.357 seconds
2019-02-06 13:03:43 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2019-02-06 13:04:03 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 13:04:23 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2019-02-06 13:04:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 13:04:38 [WARNING ] (13, 1, 'bot')
2019-02-06 13:04:38 [WARNING ] (13, 1, 'bot')
2019-02-06 13:04:38 [WARNING ] (13, 1, 'bot')
2019-02-06 13:04:38 [WARNING ] (13, 1, 'bot')
2019-02-06 13:04:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 13:04:38 [DEBUG   ] Finished updating board flags in 2.052 seconds
2019-02-06 13:04:43 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2019-02-06 13:05:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 13:05:12 [DEBUG   ] Got command RPT from MCS: ref #1419492
2019-02-06 13:05:12 [DEBUG   ] summary = ERROR
2019-02-06 13:05:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419492  13 58520 47112853 A  ERRORERROR'
2019-02-06 13:05:13 [DEBUG   ] Got command RPT from MCS: ref #1419493
2019-02-06 13:05:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 13:05:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419493  77 58520 47113057 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 13:05:13 [DEBUG   ] Got command RPT from MCS: ref #1419494
2019-02-06 13:05:13 [DEBUG   ] summary = ERROR
2019-02-06 13:05:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419494  13 58520 47113261 A  ERRORERROR'
2019-02-06 13:05:13 [DEBUG   ] Got command RPT from MCS: ref #1419496
2019-02-06 13:05:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 13:05:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419496  77 58520 47113453 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 13:05:13 [DEBUG   ] Got command RPT from MCS: ref #1419497
2019-02-06 13:05:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 13:05:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419497  12 58520 47113657 A  ERRORB–™š'
2019-02-06 13:05:23 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2019-02-06 13:05:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 13:05:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-02-06 13:05:38 [WARNING ] (13, 1, 'bot')
2019-02-06 13:05:38 [WARNING ] (13, 1, 'bot')
2019-02-06 13:05:38 [WARNING ] (13, 1, 'bot')
2019-02-06 13:05:38 [WARNING ] (13, 1, 'bot')
2019-02-06 13:05:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 13:05:38 [DEBUG   ] Finished updating board flags in 1.988 seconds
2019-02-06 13:05:43 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2019-02-06 13:06:03 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-06 13:06:12 [DEBUG   ] Got command RPT from MCS: ref #1419506
2019-02-06 13:06:12 [DEBUG   ] summary = ERROR
2019-02-06 13:06:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419506  13 58520 47172241 A  ERRORERROR'
2019-02-06 13:06:12 [DEBUG   ] Got command RPT from MCS: ref #1419507
2019-02-06 13:06:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 13:06:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419507  77 58520 47172242 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 13:06:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 13:06:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 13:06:38 [WARNING ] (13, 1, 'bot')
2019-02-06 13:06:38 [WARNING ] (13, 1, 'bot')
2019-02-06 13:06:38 [WARNING ] (13, 1, 'bot')
2019-02-06 13:06:38 [WARNING ] (13, 1, 'bot')
2019-02-06 13:06:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 13:06:38 [DEBUG   ] Finished updating board flags in 1.815 seconds
2019-02-06 13:06:43 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 13:07:03 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2019-02-06 13:07:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2019-02-06 13:07:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 13:07:38 [WARNING ] (13, 1, 'bot')
2019-02-06 13:07:38 [WARNING ] (13, 1, 'bot')
2019-02-06 13:07:38 [WARNING ] (13, 1, 'bot')
2019-02-06 13:07:38 [WARNING ] (13, 1, 'bot')
2019-02-06 13:07:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 13:07:38 [DEBUG   ] Finished updating board flags in 1.791 seconds
2019-02-06 13:07:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2019-02-06 13:08:03 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2019-02-06 13:08:23 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2019-02-06 13:08:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 13:08:38 [WARNING ] (13, 1, 'bot')
2019-02-06 13:08:38 [WARNING ] (13, 1, 'bot')
2019-02-06 13:08:38 [WARNING ] (13, 1, 'bot')
2019-02-06 13:08:38 [WARNING ] (13, 1, 'bot')
2019-02-06 13:08:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 13:08:38 [DEBUG   ] Finished updating board flags in 1.631 seconds
2019-02-06 13:08:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2019-02-06 13:09:04 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2019-02-06 13:09:24 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2019-02-06 13:09:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 13:09:38 [WARNING ] (13, 1, 'bot')
2019-02-06 13:09:38 [WARNING ] (13, 1, 'bot')
2019-02-06 13:09:38 [WARNING ] (13, 1, 'bot')
2019-02-06 13:09:38 [WARNING ] (13, 1, 'bot')
2019-02-06 13:09:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 13:09:38 [DEBUG   ] Finished updating board flags in 1.576 seconds
2019-02-06 13:09:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 13:10:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 13:10:12 [DEBUG   ] Got command RPT from MCS: ref #1419527
2019-02-06 13:10:12 [DEBUG   ] summary = ERROR
2019-02-06 13:10:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419527  13 58520 47412941 A  ERRORERROR'
2019-02-06 13:10:13 [DEBUG   ] Got command RPT from MCS: ref #1419528
2019-02-06 13:10:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 13:10:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419528  77 58520 47413133 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 13:10:13 [DEBUG   ] Got command RPT from MCS: ref #1419529
2019-02-06 13:10:13 [DEBUG   ] summary = ERROR
2019-02-06 13:10:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419529  13 58520 47413337 A  ERRORERROR'
2019-02-06 13:10:13 [DEBUG   ] Got command RPT from MCS: ref #1419530
2019-02-06 13:10:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 13:10:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419530  77 58520 47413541 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 13:10:13 [DEBUG   ] Got command RPT from MCS: ref #1419531
2019-02-06 13:10:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 13:10:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419531  12 58520 47413745 A  ERRORB—™š'
2019-02-06 13:10:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 13:10:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 13:10:38 [WARNING ] (13, 1, 'bot')
2019-02-06 13:10:38 [WARNING ] (13, 1, 'bot')
2019-02-06 13:10:38 [WARNING ] (13, 1, 'bot')
2019-02-06 13:10:38 [WARNING ] (13, 1, 'bot')
2019-02-06 13:10:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 13:10:38 [DEBUG   ] Finished updating board flags in 1.446 seconds
2019-02-06 13:10:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 13:11:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 13:11:12 [DEBUG   ] Got command RPT from MCS: ref #1419532
2019-02-06 13:11:12 [DEBUG   ] summary = ERROR
2019-02-06 13:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419532  13 58520 47472372 A  ERRORERROR'
2019-02-06 13:11:12 [DEBUG   ] Got command RPT from MCS: ref #1419533
2019-02-06 13:11:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 13:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419533  77 58520 47472373 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 13:11:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 13:11:37 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 13:11:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 13:11:38 [WARNING ] (13, 1, 'bot')
2019-02-06 13:11:38 [WARNING ] (13, 1, 'bot')
2019-02-06 13:11:38 [WARNING ] (13, 1, 'bot')
2019-02-06 13:11:38 [WARNING ] (13, 1, 'bot')
2019-02-06 13:11:38 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 13:11:38 [DEBUG   ] Finished updating board flags in 1.366 seconds
2019-02-06 13:11:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 13:12:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 13:12:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 13:12:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 13:12:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 13:12:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:12:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:12:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:12:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:12:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 13:12:39 [DEBUG   ] Finished updating board flags in 2.239 seconds
2019-02-06 13:12:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 13:13:04 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 13:13:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 13:13:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 13:13:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:13:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:13:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:13:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:13:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 13:13:39 [DEBUG   ] Finished updating board flags in 2.272 seconds
2019-02-06 13:13:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 13:14:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 13:14:24 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 13:14:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 13:14:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:14:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:14:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:14:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:14:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 13:14:39 [DEBUG   ] Finished updating board flags in 2.088 seconds
2019-02-06 13:14:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 13:15:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 13:15:13 [DEBUG   ] Got command RPT from MCS: ref #1419559
2019-02-06 13:15:13 [DEBUG   ] summary = ERROR
2019-02-06 13:15:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419559  13 58520 47713025 A  ERRORERROR'
2019-02-06 13:15:13 [DEBUG   ] Got command RPT from MCS: ref #1419560
2019-02-06 13:15:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 13:15:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419560  77 58520 47713217 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 13:15:13 [DEBUG   ] Got command RPT from MCS: ref #1419561
2019-02-06 13:15:13 [DEBUG   ] summary = ERROR
2019-02-06 13:15:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419561  13 58520 47713421 A  ERRORERROR'
2019-02-06 13:15:13 [DEBUG   ] Got command RPT from MCS: ref #1419563
2019-02-06 13:15:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 13:15:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419563  77 58520 47713625 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 13:15:13 [DEBUG   ] Got command RPT from MCS: ref #1419565
2019-02-06 13:15:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 13:15:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419565  12 58520 47713829 A  ERRORB—™š'
2019-02-06 13:15:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 13:15:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 13:15:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:15:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:15:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:15:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:15:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 13:15:39 [DEBUG   ] Finished updating board flags in 2.046 seconds
2019-02-06 13:15:44 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 13:16:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 13:16:12 [DEBUG   ] Got command RPT from MCS: ref #1419569
2019-02-06 13:16:12 [DEBUG   ] summary = ERROR
2019-02-06 13:16:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419569  13 58520 47772241 A  ERRORERROR'
2019-02-06 13:16:12 [DEBUG   ] Got command RPT from MCS: ref #1419570
2019-02-06 13:16:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 13:16:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419570  77 58520 47772242 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 13:16:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 13:16:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 13:16:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:16:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:16:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:16:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:16:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 13:16:39 [DEBUG   ] Finished updating board flags in 1.963 seconds
2019-02-06 13:16:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 13:17:04 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 13:17:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 13:17:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 13:17:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:17:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:17:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:17:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:17:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 13:17:39 [DEBUG   ] Finished updating board flags in 1.818 seconds
2019-02-06 13:17:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 13:18:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 13:18:24 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 13:18:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 13:18:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2019-02-06 13:18:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:18:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:18:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:18:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:18:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 13:18:39 [DEBUG   ] Finished updating board flags in 1.888 seconds
2019-02-06 13:18:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2019-02-06 13:19:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 13:19:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2019-02-06 13:19:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 13:19:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-06 13:19:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:19:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:19:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:19:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:19:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 13:19:39 [DEBUG   ] Finished updating board flags in 1.695 seconds
2019-02-06 13:19:44 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2019-02-06 13:20:04 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2019-02-06 13:20:13 [DEBUG   ] Got command RPT from MCS: ref #1419590
2019-02-06 13:20:13 [DEBUG   ] summary = ERROR
2019-02-06 13:20:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419590  13 58520 48013101 A  ERRORERROR'
2019-02-06 13:20:13 [DEBUG   ] Got command RPT from MCS: ref #1419591
2019-02-06 13:20:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 13:20:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419591  77 58520 48013306 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 13:20:13 [DEBUG   ] Got command RPT from MCS: ref #1419592
2019-02-06 13:20:13 [DEBUG   ] summary = ERROR
2019-02-06 13:20:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419592  13 58520 48013509 A  ERRORERROR'
2019-02-06 13:20:13 [DEBUG   ] Got command RPT from MCS: ref #1419593
2019-02-06 13:20:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 13:20:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419593  77 58520 48013701 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 13:20:13 [DEBUG   ] Got command RPT from MCS: ref #1419594
2019-02-06 13:20:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2019-02-06 13:20:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419594  12 58520 48013905 A  ERRORB—™š'
2019-02-06 13:20:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 13:20:38 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2019-02-06 13:20:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 13:20:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:20:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:20:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:20:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:20:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 13:20:39 [DEBUG   ] Finished updating board flags in 1.617 seconds
2019-02-06 13:20:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 13:21:04 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2019-02-06 13:21:12 [DEBUG   ] Got command RPT from MCS: ref #1419599
2019-02-06 13:21:12 [DEBUG   ] summary = ERROR
2019-02-06 13:21:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419599  13 58520 48072245 A  ERRORERROR'
2019-02-06 13:21:12 [DEBUG   ] Got command RPT from MCS: ref #1419600
2019-02-06 13:21:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2019-02-06 13:21:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT  1419600  77 58520 48072246 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2019-02-06 13:21:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2019-02-06 13:21:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 13:21:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:21:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:21:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:21:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:21:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 13:21:39 [DEBUG   ] Finished updating board flags in 1.607 seconds
2019-02-06 13:21:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2019-02-06 13:22:04 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2019-02-06 13:22:24 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 13:22:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 13:22:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2019-02-06 13:22:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:22:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:22:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:22:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:22:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 13:22:39 [DEBUG   ] Finished updating board flags in 1.620 seconds
2019-02-06 13:22:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 13:23:04 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2019-02-06 13:23:24 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 13:23:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 13:23:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:23:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:23:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:23:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:23:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 13:23:39 [DEBUG   ] Finished updating board flags in 1.584 seconds
2019-02-06 13:23:44 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2019-02-06 13:24:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2019-02-06 13:24:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2019-02-06 13:24:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2019-02-06 13:24:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:24:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:24:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:24:39 [WARNING ] (13, 1, 'bot')
2019-02-06 13:24:39 [CRITICAL] MGT underflow detected on beam(s) 1
2019-02-06 13:24:39 [DEBUG   ] Finished updating board flags in 1.396 seconds
2019-02-06 13:24:44 [DEBUG   ] Finished updating ant stats in 0.799 seconds
